FPGAs are fascinating.  I hear they aren't that great for LLM stuff though.  CUDA is apparently the king.