The newer 7B models like Llama3 or Mistrel work great on well-resourced devices like the ones we sell.

No real harm in running it alongside Bitcoin and Lightning, but you also don't have to. It's your server, only install what you want.