Oddbean new post about login | logout envisioning a future of a Signal-grade private social network, where you have local llms privately translating, summarizing, and building algos of your feed. It’s not far off, we have the technology today. damn this is cool and cyberpunk af.
wen beta?
LLM translation is still far off but would be great… the quality of translations still are suboptimal with the big clouds, so on device, especially for some languages, will need time to mature also, I feel like finetuned models designed for content curation and summarization will be the way. the more specific the tool the more accurate it is for a task.
One things they are really good at today, even in the 2gb 6b param models, is summarization. I want to put together a demo on notedeck where it downloads the model and uses it to summarize threads when you open a large one.
When I first heard about Nostr ~1.5yrs ago, I heard Guy Swann talk about how you could build a Signal using Nostr. Is that accurate?
I think that an advanced search module is already a great step to start with.
definitely. going to have that soom™️ for damus local search
we'd appreciate an invite
Have you seen the LLM Farm app? I’ve got Phi-3-Mini & Llama-3-8B running locally on my iPhone
Listened to your rip with Odell on the trip to BTC++ in Austin today - so good! What a life changing journey Nostr appears to be for you. Stoked you are still fired up.
Got a link?
Bullish AF 👌🏼
Espero muito que as IAs façam isso, que traduzam e organizem localmente os conteúdos, inclusive no Nostr, já que a maioria dos clientes ainda traduzem muito mal e quebram formatações como links e a sintaxe markdown... nostr:nevent1qqsv3e5832ygv05qqjfnu63a0flengl5qmjfx556vpvde88u5nq5kaqpzemhxue69uhhyetvv9ujumn0wd68ytnzv9hxgq3qxtscya34g58tk0z605fvr788k263gsu6cy9x0mhnm87echrgufzsxpqqqqqqzqctj5w
