Rent a GPU

Qwen3.8 Flash Next hardware requirements

180B parameters (6B active, mixture of experts). Needs about 109.9 GB at Q4_K_M with 8K context.

Parameters180B6B active (MoE)
Q4_K_M · 8K109.9 GBthe usual download
FP16 · 8K360.8 GBfull precision
Runs well on2/51GPUs and Macs we track

Memory needed at each quantization

Weights, KV cache and runtime overhead, at 8K and 32K tokens of context.

QuantQuality8K context32K context
FP16Full quality360.8 GB361.4 GB
Q8_0Near-lossless192.1 GB192.7 GB
Q6_KExcellent148.4 GB149 GB
Q5_K_MVery good128.8 GB129.4 GB
Q4_K_MGood, most popular109.9 GB110.5 GB
Q3_K_MNoticeably degraded88.8 GB89.4 GB
Q2_KHeavily degraded68.3 GB68.9 GB

Model card

Qwen/Qwen3.8-Flash-Next on Hugging Face: licence, prompt format and GGUF builds.

Run it in the cloud

Run Qwen3.8 Flash Next on a rented GPU today.

It needs about 109.9 GB at Q4_K_M: a rented H200 runs it for about $5.29 an hour. Compare with Claude and APIs or see how it scores against them.

RunPodRent a GPU on RunPodVast.aiRent a GPU on Vast.ai

Every GPU and Mac checked

Sorted by memory. Bars show how much of each card Qwen3.8 Flash Next fills at the best quant that fits.

2 Runs well

NameMemory usedBest quantSpeed

2 Fits with heavy quantization

NameMemory usedBest quantSpeed

47 Too big

NameMemory usedBest quantSpeed

Other Qwen models