Oddbean new post about | logout
▲ ▼
supersu | 4 months ago (raw) | root | parent | reply | flag +2 
 ChatGPT and Gemini are the worst things that have happened to privacy. You need to self-host LLMs if you care about your privacy and if your system can handle it.

Holesail makes locally running LLM accessible from anywhere on any device!

nostr:note169s0wet48nudvkkcdwscct9pf7fzggwxhkp5yavje2s6g3s756uqtkqgz8
▲ ▼
Polymathic Pedagogue | 4 months ago (raw) | root | parent | reply | flag +1 
 I just started looking into Holesail, so forgive me if this is a total noob question.

Would Holesail allow a university or other institution to host their own LLM and then provide access to all students and academics? Or is it more for one-to-one access?
▲ ▼
supersu | 4 months ago (raw) | root | parent | reply | flag +2 
 It is for both and yes what you are talking about is possible.
▲ ▼
Polymathic Pedagogue | 4 months ago (raw) | root | parent | reply | flag +1 
 Thanks for the speedy reply! That sounds brilliant. Are there any specific, self-hosted LLMs you'd recommend for such a use case?
▲ ▼
supersu | 4 months ago (raw) | root | parent | reply | flag +2 
 I like Mixtral 8b7x something with 32k context limit.