Oddbean new post about | logout
 Sounds like FPGAs. 
 I know FPGAs are powerful but is that something they do now? I know they're used for mining but asics are better from what I understand.  Didn't know they could do this kind of Ai stuff. 
 The original concept was a chip that re-programs its instruction set based on the tasks it's being asked to do most. 
 FPGAs are fascinating.  I hear they aren't that great for LLM stuff though.  CUDA is apparently the king.   
 General compute architecture is good enough for what I’m talking about. You don’t need efficiencies in hardware for most software tasks. You just need software that does exactly what you need at any given moment (and nothing else… all the extra features cause confusion and require learning/choices)