hard.bargains

Local AI

What will run your model?

Updated

What you want to runWhat you run it on todayNothing suitableA PC with an Nvidia cardA MacNot sure
7B–14BLlama 3.1 8B: 4.5GB to load, 7.5GB for long documents · also Qwen3 14BNothing yetBuyMac mini M4$749 used market · last read Nvidia PCBuyRTX 5060 Ti 16GB$790 Newegg · last read A MacKeepKeep it with 12GB or moreelse $749 used market · last read Not sureCheckCheck what it runs first
20B–32BQwen 3.5 27B: 15.5GB to load, 25.9GB for long documents · also gpt-oss-20b, Qwen3 30B-A3BNothing yetBuyMac Studio M5 Max$2,499 Apple · last read Nvidia PCBuyRTX 3090 24GB$1,032 eBay · last read Loads it, not long documentsA MacKeepKeep it with 36GB or moreelse $2,499 Apple · last read Not sureCheckCheck what it runs first
70BLlama 3.3 70B: 39.1GB to load, 65.2GB for long documentsNothing yetBuyGMKtec EVO-X2$3,499 GMKtec · last read Nvidia PCBuyTwo used RTX 3090s$2,064 eBay · last read Loads it, not long documentsA MacKeepKeep it with 96GB or moreelse $3,499 GMKtec · last read Not sureCheckCheck what it runs first
120B classgpt-oss-120b: 65.4GB to load, 109GB for long documentsNothing yetBuyGMKtec EVO-X2$3,499 GMKtec · last read Nvidia PCBuyGMKtec EVO-X2$3,499 GMKtec · last read A MacKeepKeep it with 192GB or moreelse $3,499 GMKtec · last read Not sureCheckCheck what it runs first
235B and upQwen3-235B-A22B: 131.3GB to load, 218.9GB for long documents · also DeepSeek R1 671BNothing yetNothing fits235B-class models, or frontier qualityNvidia PCNothing fits235B-class models, or frontier qualityA MacKeepKeep it with 512GB or moreelse $17,448 used market · last read Not sureCheckCheck what it runs first
Memory a model needs, and what each route gives it, on one scale. Prices read through
Memory a model needs against memory each route gives it, on one scaleLog scale from 8GB to 512GB. 7B–14B models need 7.5GB, 13GB for long documents; 20B–32B models need 19.6GB, 25.9GB, 27.9GB for long documents; 70B models need 65.2GB for long documents; 120B class models need 109GB for long documents; 235B and up models need 218.9GB, 624.9GB for long documents. Below the axis, each dot is a route placed at the memory a model can use on it; labeled dots are the cheapest route at that amount.8GB163264128256512GB7–14B 7.5–13GB4.5GB loads it7.5GB for long documents20–32B 19.6–27.9GB15.5GB loads it25.9GB for long documents70B 65.2GB39.1GB loads it65.2GB for long documents120B 109GB65.4GB loads it109GB for long documents235B+ 219–625GB131.3GB loads it218.9GB for long documentsA card for a PC you own$790$1,032$2,064A whole machine$749$2,499$3,199$3,499$9,999$17,448

Above the line, the memory each model needs for long documents (canirun.ai's recommended figure). Choose a size and a solid line marks its weights, what loads it for short prompts, and a dashed line its long-documents figure. Below, the memory a model can use on each route: all of a card's, about two-thirds of a Mac's at 32GB or less and three-quarters above. Labeled prices are the cheapest route at that amount.

The figures as a table
What each model needs, and the cheapest route the tool names for long documents
ModelTo loadLong documentsCheapest cardCheapest whole machine
Llama 3.1 8B4.5GB7.5GBRTX 5060 Ti 16GB, new $790 Newegg · last read Mac mini M4, 16GB / 256GB, used $749 used market · last read
Qwen3 14B7.8GB13GBRTX 5060 Ti 16GB, new $790 Newegg · last read Mac Studio M5 Max, 36GB, new $2,499 Apple · last read
gpt-oss-20b11.7GB19.6GBRTX 3090 24GB, used $1,032 eBay · last read Mac Studio M5 Max, 36GB, new $2,499 Apple · last read
Qwen 3.5 27B15.5GB25.9GBTwo used RTX 3090s $2,064 eBay · last read Mac Studio M5 Max, 36GB, new $2,499 Apple · last read
Qwen3 30B-A3B16.8GB27.9GBTwo used RTX 3090s $2,064 eBay · last read Mac mini M5 Pro, 64GB / 1TB, new $3,199 Apple · last read
Llama 3.3 70B39.1GB65.2GBnone we can sourceGMKtec EVO-X2, Ryzen AI Max+ 395, 128GB $3,499 GMKtec · last read
gpt-oss-120b65.4GB109GBnone we can sourceGMKtec EVO-X2, Ryzen AI Max+ 395, 128GB $3,499 GMKtec · last read
Qwen3-235B-A22B131.3GB218.9GBnone we can sourceMac Studio M3 Ultra, 512GB, used $17,448 used market · last read
DeepSeek R1 671B375GB624.9GBnone we can sourcenone we can source
Every route, by the memory a model can use on it
RouteUsablePrice
Mac mini M4, 16GB / 256GB, used10.7GB of 16GB$749 used market · last read
Mac mini M6, 16GB / 256GB, new10.7GB of 16GB$899 Apple · last read
RTX 5060 Ti 16GB, new16GB$790 Newegg · last read
RTX 5070 Ti 16GB, new16GB$1,150 Newegg · last read
RTX 3090 24GB, used24GB$1,032 eBay · last read
Mac Studio M5 Max, 36GB, new27GB of 36GB$2,499 Apple · last read
RTX 5090 32GB, new32GB$6,700 Newegg · last read
Two used RTX 3090s48GB$2,064 eBay · last read
Mac mini M5 Pro, 64GB / 1TB, new48GB of 64GB$3,199 Apple · last read
Mac Studio M5 Max, 40-core GPU, 64GB, new48GB of 64GBabout $3,500 Apple · last read
Mac Studio M5 Ultra, 96GB, new72GB of 96GB$5,499 Apple · last read
Mac Studio M1 Ultra, 128GB, used96GB of 128GB$5,249 used market · last read
GMKtec EVO-X2, Ryzen AI Max+ 395, 128GB128GB$3,499 GMKtec · last read
Nvidia DGX Spark, 128GB128GB$4,699 reported in our August comparison · last read
Framework Desktop, 128GB128GB$3,584 Framework · last read out of stock (Framework's store, rechecked Sept. 16, 2026)
Mac Studio M3 Ultra, 256GB, used192GB of 256GB$9,999 used market · last read
Mac Studio M3 Ultra, 512GB, used384GB of 512GB$17,448 used market · last read

Decision guides

  1. Add a card to a PC you ownBuyIntel Arc Pro B60 24GBfrom $649.99 Newegg · last read
  2. What each budget buys, from $0BuyRTX 3090 24GBfrom $1,032 eBay · last read
  3. No desktop, and a 70B or 120B modelBuyGMKtec EVO-X2from $3,499 GMKtec · last read
  4. Check what your computer runs firstKeepNo price on this answer
  5. Your exact model, budget and machineToolKeep it, add a card or buy a machineNo price on this answer
Everything in Local AI13