Oddbean new post about | logout
 Maybe I'm pessimistic, but unless there's some centralized, organizing hub that assigns specific data to specific users for storage, so that it's guaranteed that all of the data is archived, I don't see it happening.

Because what will happen without such a coordinating structure is that certain data will be popular, and stored by many people while less popular, or esoteric data will have fewer willing archivers. It would lead to a situation where holes in the data develop making it difficult to access, or lost to time altogether.

I know we're just talking about the general idea, but I think this is something that will have to be precisely coordinated, and choreographed to effectively and completely pull off.

Obviously not saying it's impossible, but I don't think it's as simple as we're making out.

I think it would have to be a system that allows people to sign up to be archivers, and they basically just commit to storing data while some mechanism allocates the data without regard to its nature. So, users wouldn't be able to choose which data they archive. And that could be coordinated and executed by some decentralized mechanism.  
 United States Department of Congress is online 

Is most all of that decentralized? Meaning it’s still constantly bouncing so no one can break it? 

Many don’t even pay attention to that. 

Speaking of: how can I make a BOT 🤖 TO make a NARA update bot 🤖 with publishing’s  
 I don't think Congress has the same level of data as the entire internet going back 30 years. It makes sense for Congress to be centralized due to their specific circumstances and responsibilities. And while most don't think about that, I guarantee someone on the backend did. 

Archiving the internet is a massive undertaking, and without a massive war chest and paid staff, a decentralized architecture makes to most sense. On the user end, it could be as simple as installing an app, and specifying the amount of local space you want to contribute while the app transparently handles data allocation.

It would would be similar to running a tor or bitcoin node. User provides the resources while the backend handles the dynamics.  
 I’m kinda in love 🥰  
 So you all handle my data allocation with the alts 

#BELOVE  
 YAY 🥳… cause we’re all just pixels and kids at heart ❤️ at our best. 🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰👇👇🧒🧒🥰🥰🤣🤣🤣🥰🤣🤣
https://nostrcheck.me/media/2aadfb8ac7d43aca6d164ed99248147910048269601ff60d4463c4d5b3abfdcd/1f83b563bd15011557cfafa01afaa888cdc807fe62c4cf6fb43c7ab8a080d6e8.webp 
 I should have written more carefully - I don't expect the _entire_ Internet to be archived by disorganized individuals. 

I expect groups will archive what is important to them, and keep it online as long as they care to. 
Not unlike Nostr relays - you might end up with some central ones that do a lot and everyone relies on. ...and then there is the dark forest of private relays and communities that you don't even know exist but their network is extremely valuable.  
 Sort of like monks in medieval times. Good luck getting access to those stashes of wisdom. 
 It's up to them if I get access (and at what cost). 
As it should be.