Can my PC run Stable Diffusion, Flux and Wan?
FLUX.1 dev has 12B parameters and needs about 26 GB of graphics memory at full precision (FP16), with its working memory for a 1024 × 1024 image; about 14 GB at FP8; and about 10 GB as a GGUF Q4_K_M file, so it runs entirely on a 12 GB card or bigger.
| Model | Runs? | Time |
|---|
The model file and the working memory it needs on the card, with about 0.8 GB more kept for the driver and the screen. 8-bit (FP8 or Q8_0) looks almost the same as full precision; GGUF Q4 loses some fine detail.
| Precision | Model | On the card | Fits a card with |
|---|---|---|---|
| FP16 | 24.0 GB | 26.5 GB | 32 GB |
| FP8 | 12.0 GB | 14.5 GB | 16 GB |
| GGUF Q8_0 | 12.8 GB | 15.2 GB | 20 GB |
| GGUF Q6_K | 9.8 GB | 12.3 GB | 16 GB |
| GGUF Q5_K_M | 8.5 GB | 11.0 GB | 12 GB |
| GGUF Q4_K_M | 7.3 GB | 9.8 GB | 12 GB |
The text encoder, CLIP-L and T5-XXL, reads your prompt first, about 5.1 GB at 8 bits; ComfyUI moves it off the card before drawing, so it needs system memory rather than graphics memory.
Time for a 1024 × 1024 image at 20 steps, at the largest precision that fits, in a PC with 32 GB of system memory.
| Graphics card | Runs? | Precision | Time |
|---|---|---|---|
| RTX 3060 12 GB | On the card | GGUF Q5_K_M | 49 s–2 min |
| RTX 4060 (8 GB) | Partly in system memory | GGUF Q4_K_M | 75 s–2 min |
| RTX 4060 Ti 16 GB | On the card | FP8 | 27 s–53 s |
| RTX 5060 Ti 16 GB | On the card | FP8 | 24 s–49 s |
| RTX 4070 (12 GB) | On the card | GGUF Q5_K_M | 23 s–45 s |
| RTX 5070 (12 GB) | On the card | GGUF Q5_K_M | 20 s–40 s |
| RTX 4070 Ti SUPER (16 GB) | On the card | FP8 | 13 s–26 s |
| RTX 5070 Ti (16 GB) | On the card | FP8 | 13 s–26 s |
| RTX 3090 (24 GB) | On the card | FP8 | 18 s–35 s |
| RTX 4080 SUPER (16 GB) | On the card | FP8 | 11 s–22 s |
| RTX 5080 (16 GB) | On the card | FP8 | 11 s–22 s |
| RTX 4090 (24 GB) | On the card | FP8 | 8 s–15 s |
| RTX 5090 (32 GB) | On the card | FP16 | 6 s–13 s |
| Radeon RX 9070 XT (16 GB) | On the card | FP8 | — |
| Radeon RX 7900 XTX (24 GB) | On the card | FP8 | — |
| Arc B580 (12 GB) | On the card | GGUF Q5_K_M | — |
AMD and Intel cards: whether it fits, but no time, which depends too much on the software.
| Made by | Black Forest Labs |
|---|---|
| Released | August 2024 |
| Makes | 1024 × 1024 images |
| Parameters | 12B |
| Licence | FLUX.1 [dev] Non-Commercial License |
Its files are on Hugging Face. ComfyUI runs it with a ready-made workflow; GGUF files need the ComfyUI-GGUF add-on. Bottleneck is not connected with Black Forest Labs.
Image and video models are limited by the graphics card’s arithmetic rather than its memory speed, so each card’s speed here comes from its measured arithmetic in llama.cpp’s benchmark (the same figure the AI model calculator uses for reading prompts), and each model’s time per step is anchored to measured times: FLUX.1 dev at about 1.85 steps a second on an RTX 4090, SDXL at about 4.2 a second on an RTX 3090, and Wan 2.2 5B taking about nine minutes for a 720p clip on an RTX 4090, its makers’ own figure. Other models scale from those by size. Memory is the model at each precision plus its working memory at the usual resolution, with about 0.8 GB kept for the driver and the screen. Speeds are for NVIDIA cards; AMD and Intel cards run these models through ROCm, ZLUDA, DirectML or Intel’s own builds, whose speed varies too much with the software to estimate. A real time is usually within the range shown; speed-up add-ons such as fewer-step LoRAs, TensorRT or SageAttention make it faster.
Bottleneck’s free app reads your graphics card, how much of its memory other programs are holding, your memory’s speed and channels, and the settings that slow a PC down, and says how to fix each. Its AI models screen lists the chat models your PC runs, and checks one you already run with Ollama or LM Studio.
The free version gives each check’s verdict, with no time limit and no account. Pro, $9 once, explains the cause and the fix. Compare the versions