Oddbean new post about | logout
 We're going to decentralize the Wayback Machine. Every person will maintain a personal offline archive (privately) of the internet based on all of their activity.

They will choose to share some of this. Federated together, the entirety of the world's archived shards will be an uncensorable record of the contemporary information landscape.

And nobody will be able to stop it. 
 It sounds awesome. Buuuut, how? 
 https://opfn.co 
 Let me know if you have questions. We have extensive documentation about _how_ the stack works, but not exactly on _how to build on it_ (yet). 
It's mostly appropriate functional programming language enthusiasts at the moment, but we are actively building end-user-facing demos and products as fast as we can.  
 Holy shit burgers Batman, thats some
Ambition 
 Sounds sorta easy once you have the right tools! 
 Federated meaning what? That seems to take on various meanings.  
 And where is all the distributed storage space coming from? I don't think you can keep an archive of the Internet on a thumb drive.  
 Satellites said what. We can only go so far into space before it’s a burden on humanity. So who pays for space research anyway? 

You want me to bridge 🌉 cybersecurity with actual spaces AND SPACECRAFT and X. That’s a lot of asks for the owner of Tesla.  
 Each user can determine how much they want to store. From a thumb drive to an old laptop to a server in their closet to rented cloud VPSes with dozens of terabytes.  
 Maybe I'm pessimistic, but unless there's some centralized, organizing hub that assigns specific data to specific users for storage, so that it's guaranteed that all of the data is archived, I don't see it happening.

Because what will happen without such a coordinating structure is that certain data will be popular, and stored by many people while less popular, or esoteric data will have fewer willing archivers. It would lead to a situation where holes in the data develop making it difficult to access, or lost to time altogether.

I know we're just talking about the general idea, but I think this is something that will have to be precisely coordinated, and choreographed to effectively and completely pull off.

Obviously not saying it's impossible, but I don't think it's as simple as we're making out.

I think it would have to be a system that allows people to sign up to be archivers, and they basically just commit to storing data while some mechanism allocates the data without regard to its nature. So, users wouldn't be able to choose which data they archive. And that could be coordinated and executed by some decentralized mechanism.  
 United States Department of Congress is online 

Is most all of that decentralized? Meaning it’s still constantly bouncing so no one can break it? 

Many don’t even pay attention to that. 

Speaking of: how can I make a BOT 🤖 TO make a NARA update bot 🤖 with publishing’s  
 I don't think Congress has the same level of data as the entire internet going back 30 years. It makes sense for Congress to be centralized due to their specific circumstances and responsibilities. And while most don't think about that, I guarantee someone on the backend did. 

Archiving the internet is a massive undertaking, and without a massive war chest and paid staff, a decentralized architecture makes to most sense. On the user end, it could be as simple as installing an app, and specifying the amount of local space you want to contribute while the app transparently handles data allocation.

It would would be similar to running a tor or bitcoin node. User provides the resources while the backend handles the dynamics.  
 I’m kinda in love 🥰  
 So you all handle my data allocation with the alts 

#BELOVE  
 YAY 🥳… cause we’re all just pixels and kids at heart ❤️ at our best. 🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰👇👇🧒🧒🥰🥰🤣🤣🤣🥰🤣🤣
https://nostrcheck.me/media/2aadfb8ac7d43aca6d164ed99248147910048269601ff60d4463c4d5b3abfdcd/1f83b563bd15011557cfafa01afaa888cdc807fe62c4cf6fb43c7ab8a080d6e8.webp 
 I should have written more carefully - I don't expect the _entire_ Internet to be archived by disorganized individuals. 

I expect groups will archive what is important to them, and keep it online as long as they care to. 
Not unlike Nostr relays - you might end up with some central ones that do a lot and everyone relies on. ...and then there is the dark forest of private relays and communities that you don't even know exist but their network is extremely valuable.  
 Sort of like monks in medieval times. Good luck getting access to those stashes of wisdom. 
 It's up to them if I get access (and at what cost). 
As it should be.  
 I meant it loosely. Take it to mean "arbitrarily share with each other however each person deems appropriate". From making everything public to joining a private sub-network that shares paywalled sites with each other