Latent Increments

AI/ML Hardware Build Recommendations

Budget Tier Performance GPU CPU Motherboard RAM Storage PSU Case
Entry
($800-1200)
Good for 7B models 45 tok/s Won't fit Won't fit
RTX 3060 12GB
$299
Ryzen 5 5600
$129
MSI B450 Tomahawk
$89
16GB DDR4-3200
$49
1TB NVMe
$79
650W Bronze
$69
Fractal Core
$49
Mid-Range
($1500-2500)
Good for 13B models 55 tok/s Won't fit Won't fit
RTX 4070 12GB
$549
Ryzen 7 5700X
$189
MSI B550 Gaming
$149
32GB DDR4-3600
$99
2TB NVMe
$149
750W Gold
$119
Fractal Define 7
$159
High-End
($3000-5000)
Handles 30B models 100 tok/s 8 tok/s Won't fit
RTX 4090 24GB
$1599
Ryzen 9 5900X
$329
ASUS X570 TUF
$189
64GB DDR4-3600
$199
2TB NVMe Gen4
$199
850W Gold
$149
Lian Li O11
$149
Enthusiast
($5000-8000)
Runs 70B models 180 tok/s 20 tok/s 18 tok/s
2x RTX 4090 24GB
$3199
Ryzen 9 5950X
$449
ASUS TRX40 Pro
$349
128GB DDR4
$399
4TB NVMe Gen4
$399
1200W Platinum
$299
Corsair 1000D
$499
Workstation
($10000+)
Multiple 70B models 300 tok/s 35 tok/s 40 tok/s
4x RTX 4090 24GB
$6399
Threadripper 3970X
$1999
ASUS TRX40 Creator
$699
256GB DDR4
$999
8TB NVMe Gen4
$899
1600W Titanium
$599
Thermaltake Core
$599