Rent a GPU

GLM-5.3 Flash 320B-A18B hardware requirements

321B parameters (18B active, mixture of experts). Needs about 195.3 GB at Q4_K_M with 8K context.

Parameters321B18B active (MoE)
Q4_K_M · 8K195.3 GBthe usual download
FP16 · 8K642.7 GBfull precision
Runs well on0/51GPUs and Macs we track

Memory needed at each quantization

Weights, KV cache and runtime overhead, at 8K and 32K tokens of context.

QuantQuality8K context32K context
FP16Full quality642.7 GB643 GB
Q8_0Near-lossless341.8 GB342 GB
Q6_KExcellent263.9 GB264.2 GB
Q5_K_MVery good229 GB229.3 GB
Q4_K_MGood, most popular195.3 GB195.6 GB
Q3_K_MNoticeably degraded157.6 GB157.9 GB
Q2_KHeavily degraded121.1 GB121.3 GB

Model card

zai-org/GLM-5.3-Flash on Hugging Face: licence, prompt format and GGUF builds.

Run it in the cloud

Run GLM-5.3 Flash 320B-A18B on a rented GPU today.

It needs about 195.3 GB at Q4_K_M: a rented 4× A100 / H100 runs it for about $4.44 to $15.96 an hour. Compare with Claude and APIs or see how it scores against them.

RunPodRent a GPU on RunPodVast.aiRent a GPU on Vast.ai

Every GPU and Mac checked

Sorted by memory. Bars show how much of each card GLM-5.3 Flash 320B-A18B fills at the best quant that fits.

2 Fits with heavy quantization

NameMemory usedBest quantSpeed

49 Too big

NameMemory usedBest quantSpeed

Other GLM models