When a consumer GPU is enough
- Image generation with SDXL or Flux at normal resolution.
- Inference of models up to about 13B parameters (24 GB on the 4090, 32 GB on the 5090).
- LoRA fine-tuning of small models and experiments.
When it is not
Consumer cards have no ECC memory, limited memory per card and are often hosted outside datacenters. For 30–70B models, video generation at high resolution or production traffic, a 96 GB RTX PRO 6000 replaces two to four consumer cards and runs in a Tier III datacenter.

