Oddbean new post about | logout
 Unleashed.Chat v0.1.1 is live!

Now hit 1k+ users, this release adds more scalable infrastructure

-Vector embeddings of nostr notes now stored in Redis–fast again!
-Key infra components are now automated
- App health monitoring and automatic remediation in case of container crashes or similar

https://m.primal.net/HWfv.png 
 Go capybara app, go!!!! 🥰🙌 
 Are you going to release a native app? 
 This is the only LLM chat that I’m recommending to anyone. Appreciate you and your team!  
 Although not immediately visible to the user, this release is a big one and paves the way for adding more cool features.

It's been awesome working on this project. So much learning!

nostr:note1jzl7plppdszvkdzhmtsjat2yq0gsrq64n08mh97g5q67myt0wclq64mhsh  
 Awesome! 
When Mixtral? 
 Nostr already has a Grok competitor. And these guys keep shipping. 💪🚀

nostr:note1jzl7plppdszvkdzhmtsjat2yq0gsrq64n08mh97g5q67myt0wclq64mhsh  
 Capy is the way 🫡 
 Any chance for an Unleashed.chat powered nostr bot? 
 Maybe 
 What are you using for inference if I can ask, just curiosity  
 Which interface? 
 No for the text generation inference (the server that runs the llms), I was researching the different options available, some cool ones are huggingface tgi, llama.cpp, vllm 
 Interesting....

nostr:nevent1qqsfp0lqlsskcpxtx3ta4cfw44zq85gpsd2ehnamjly2qd0dj9hhv0spz3mhxue69uhkummnw3ezummcw3ezuer9wcpzp6y2dy0f3kvc0jty2gwl7cqztas8qqmc5jrerqxuhw622qnc2pq3qvzqqqqqqyp35crq 
 Capy slay 
 I was planning to build my own LLM a few months ago, but this project is making my life a lot easier. Not sure how many sats it's going to cost me to upload all my project's data... Hopefully less than a graphics card.

nostr:nevent1qqsfp0lqlsskcpxtx3ta4cfw44zq85gpsd2ehnamjly2qd0dj9hhv0spr4mhxue69uhkummnw3ez6ur4vgh8wetvd3hhyer9wghxuet5qgsw3znfr6vdnxrujezjrhlkqqjlvpcqx79ys7gcph9mkjjsy7zsgygrqsqqqqqpf03lcg 
 Much less. 
 Nostr login would be cool. 
 I don't want ppls private data mixed with their persona IDs. 
 I wish people used nostr ids more like gpg keys and made new ones for new services if they want privacy. 
 🫸                                 🫷