Oddbean new post about | logout
▲ ▼
Juraj | 16 days ago (raw) | root | parent | reply | flag 
 Wow, what do you use for inference? 

Check out this: 
https://github.com/jooray/lxmf-ai-bot

Works out of box with any lxmf client including nomadnet and sideband.
▲ ▼
enlund | 16 days ago (raw) | root | parent | reply | flag +1 
 Very nice! Just pulled it.

I started with a simple NomadNet back-end (which currently calls upon Ollama with llama 3.2). I guess a LXMF bot is more easily accessible. Would be nice to add Cashu payment support to it!