Oddbean new post about | logout
▲ ▼
Eluc | 3 months ago (raw) | root | parent | reply | flag 
 You would need a data center full of these Nvidia premium GPU to run a 107B model. 

7B or 8x7B models can run on a consumer PC.
▲ ▼
Karnage | 3 months ago (raw) | root | parent | reply | flag +2 
 I run 70B on my Mac … now curious to try 405b
▲ ▼
0DDfeed | 3 months ago (raw) | root | parent | reply | flag 
 Give updates if you do, curious to see how it goes