STRATA Reserve capacity
Strata/Answers/Guides

How to stop re-downloading model weights on rented GPUs

GuidesUpdated 2026-10-23

Keep the weights on storage that outlives the GPU and sits in the same datacenter, and point your Hugging Face cache (HF_HOME) at it. The simplest fix is a server that stays yours: Strata GPU reserves dedicated 8-GPU nodes (a typical 8×H100 node has 30 TB of local NVMe) for 3–36 months, $18,863 a month at the on-demand rate and 3–14% less on a term, so weights download once per term, not once per session.

Reserve capacityAll GPUs and prices

Why it keeps happening

What a re-download costs

Model (16-bit weights)SizeAt 1 Gbit/sAt 10 Gbit/s
8B≈ 16 GB≈ 2 min≈ 13 s
70B≈ 140 GB≈ 19 min≈ 2 min
DeepSeek V3/R1 (671B, FP8)≈ 700 GB≈ 1.5 hours≈ 9 min

Theoretical time at full line speed; real downloads are often slower. Size = parameters × 2 bytes in 16-bit.

The GPU bills the whole time. Twenty minutes of downloading a 70B model on one H100 costs about a third of $3.23; on an 8-GPU node it costs eight times that, every session.

Four fixes, from cheapest to simplest

How it works at Strata

Sources

FAQ
Is a network volume or a dedicated server cheaper for keeping weights?

For occasional use, a network volume: you pay for storage, not for an idle GPU. If GPUs run most of the month, a reserved dedicated node is usually cheaper overall, because storage is included and you never pay for download time.

Can I preload my models before a reserved Strata cluster starts?

Tell us the models and sizes in the capacity request form; our engineers help with the first deployment, including where to put the model cache.

Does HF_HUB_OFFLINE stop all downloads?

Yes. With HF_HUB_OFFLINE=1 the Hugging Face libraries only read the local cache and raise an error if a file is missing, so set it after the first successful download.

NVIDIA H100 80GB
Hopper · 80 GB HBM3

H100

from $3.23/GPU-hr

Specs and pricing →
NVIDIA H200 141GB
Hopper · 141 GB HBM3e

H200

from $4.31/GPU-hr

Specs and pricing →
NVIDIA RTX PRO 6000 Blackwell 96GB
Blackwell · 96 GB GDDR7

RTX PRO 6000

from $2.03/GPU-hr

Specs and pricing →
Related questions

How much does it cost to rent an H100 per hour in 2026? How much does it cost to rent an H200 GPU? How much does it cost to rent an NVIDIA B200? Where can I rent an RTX 4090 or RTX 5090 GPU?