Best GPU for local LLMs under $800

Every graphics card we track that launched at $800 or less, ranked by how many local AI models it runs well, then by speed. Our top pick is the NVIDIA RTX 5070 Ti.

Top pickRTX 5070 Ti16 GB · $749 at launch

Runs well28/69models at Q4_K_M or better

Largest modelgpt-oss 20Bthat runs well

Cheapest optionIntel Arc B58012 GB · $249

Check RTX 5070 Ti prices See every model it runs

Every card under $800, ranked

Speed columns are estimated tokens per second at the best quant that fits, 8K context.

GPU	VRAM	Launch price	Runs well	Largest model	Llama 3.1 8B	Qwen3 14B	Qwen3 32B
RTX 5070 Ti	16 GB	$749	28/69	gpt-oss 20B	~63 tok/s	~44 tok/s	tight	Prices
RTX 4070 Ti Super	16 GB	$799	28/69	gpt-oss 20B	~47 tok/s	~33 tok/s	tight	Prices
Radeon RX 9070	16 GB	$549	28/69	gpt-oss 20B	~45 tok/s	~32 tok/s	tight	Prices
Radeon RX 9070 XT	16 GB	$599	28/69	gpt-oss 20B	~45 tok/s	~32 tok/s	tight	Prices
Radeon RX 7800 XT	16 GB	$499	28/69	gpt-oss 20B	~44 tok/s	~31 tok/s	tight	Prices
Intel Arc A770 16GB	16 GB	$349	28/69	gpt-oss 20B	~39 tok/s	~28 tok/s	tight	Prices
Radeon RX 6800 XT	16 GB	$649	28/69	gpt-oss 20B	~36 tok/s	~25 tok/s	tight	Prices
RTX 5060 Ti 16GB	16 GB	$429	28/69	gpt-oss 20B	~32 tok/s	~22 tok/s	tight	Prices
Radeon RX 9060 XT 16GB	16 GB	$349	28/69	gpt-oss 20B	~23 tok/s	~16 tok/s	tight	Prices
Radeon RX 7600 XT	16 GB	$329	28/69	gpt-oss 20B	~20 tok/s	~14 tok/s	tight	Prices
RTX 4060 Ti 16GB	16 GB	$499	28/69	gpt-oss 20B	~20 tok/s	~14 tok/s	tight	Prices
RTX 5070	12 GB	$549	27/69	Qwen3 14B	~47 tok/s	~45 tok/s	too big	Prices
RTX 4070	12 GB	$599	27/69	Qwen3 14B	~35 tok/s	~34 tok/s	too big	Prices
RTX 4070 Super	12 GB	$599	27/69	Qwen3 14B	~35 tok/s	~34 tok/s	too big	Prices
RTX 4070 Ti	12 GB	$799	27/69	Qwen3 14B	~35 tok/s	~34 tok/s	too big	Prices
Intel Arc B580	12 GB	$249	27/69	Qwen3 14B	~32 tok/s	~30 tok/s	too big	Prices
RTX 3060 12GB	12 GB	$329	27/69	Qwen3 14B	~25 tok/s	~24 tok/s	too big	Prices
RTX 3080 10GB	10 GB	$699	21/69	Mistral Nemo 12B	~69 tok/s	tight	too big	Prices
RTX 5060	8 GB	$299	17/69	Qwen3 8B	~47 tok/s	tight	too big	Prices
RTX 5060 Ti 8GB	8 GB	$379	17/69	Qwen3 8B	~47 tok/s	tight	too big	Prices
RTX 3060 Ti	8 GB	$399	17/69	Qwen3 8B	~47 tok/s	tight	too big	Prices
RTX 3070	8 GB	$499	17/69	Qwen3 8B	~47 tok/s	tight	too big	Prices
RTX 4060 Ti 8GB	8 GB	$399	17/69	Qwen3 8B	~30 tok/s	tight	too big	Prices
RTX 4060	8 GB	$299	17/69	Qwen3 8B	~29 tok/s	tight	too big	Prices

Prices are US launch prices (MSRP) for comparison; street prices change daily. Links go to Amazon, where we earn a commission at no cost to you.

Other budgets

Frequently asked questions

What is the best GPU for local LLMs under $800?

The NVIDIA RTX 5070 Ti (16 GB, $749 at launch). It runs 28 of the 69 models we track at Q4_K_M or better, up to gpt-oss 20B.

Does VRAM or speed matter more?

VRAM first: it decides which models fit at all. Memory bandwidth then sets how many tokens per second you get. A slower card with more VRAM usually beats a faster card that cannot fit the model.

Is a used RTX 3090 worth it?

For local AI it often is: 24 GB of VRAM and high bandwidth for well under its launch price on the used market. Check the seller, the card's condition and that your power supply can handle it.

Run it in the cloud

Not ready to buy? Try it on a rented GPU first.

Rent the card you are considering by the hour and see how your models actually run.

RunPodRent a GPU on RunPod Vast.aiRent a GPU on Vast.ai