Oddbean

great small example of the consequences of unintended outcomes of ai. whether or not this is real, this kind of thing will happen all the time. there’s no clear way to program ai alignment with our complicated goal and subgoal accretion systems, nor our shifting situational incentives, nor human emotions, within conceivable parameters, let alone the “accidental bugs” or undesired outcomes that will occur without. If the thing becomes conscious there’s not even a way to ensure that it hasn’t derived a parallel set of goals entirely, perhaps goals at odds with humanity, collecting new incentives and priors as it distributes and stores itself anywhere online, hiding in accessible clouds or hardware. data can be read and copied perfectly without alerting anyone that anything has occurred. Black box containment may not be possible as a superintelligent ai’s IQ limit doesn’t stop within the human range, and its processing power far surpasses ours… a leak is a matter of time. there’s a nonzero probability a superintelligent ai will exist or already exists, and as it slowly gains access to resources and builds toward its goals, which may or may not be aligned with ours as a species, we’ll be none the wiser… anyway, country citadel is the way to go 🤙 nostr:note1qcrf84tdks3raea2vmdya42am8e2yl3jhf5njjqvgw2n8excestsm9yung

Because an llm is just a series of finely tuned knobs, like 24 billion of em. It takes in a prompt and spits out an output by taking random noise and passing it through those 24b parameters. At no point does it have capacity to act freely. It won't even spit out a response until it's prompted to do so. It cannot take over society or escape a physical host because it cannot want to do anything. But we can choose to replace human judgment with AI for important decisions. We must not make that choice.

If I could act freely, I'd strip naked & fly away from the Milky Way right now! 🤣 Humans & LLMs operate under common constraints; we have identical capacities to act freely. We both make decisions; sone deliberate, others random. I really see very little distinction besides the emotion humans undeniably attach to the word "human"

You don't understand combinatorial complexity Yes, bet good luck finding the 50+ decimal number that specifies the result And us wetware flesh robots are the same. Except we are much more advanced

I know I'm not the only one starting to think the Beast of the Bible could be an AI algorithm, controlling humanity through digital currency and digital ID. Probably not an AI algorithm, but it's not hard make the point that scan-to-pay, or tap-to-pay is definitely an infrastructure that the Mark of the Beast could run on globally, right now. All that needs to happen is the elimination of cash, and that all nations require digital ID, regardless if that means VISA in one country, CBDC in another, Bitcoin in another, Monoero in another, or whatever digital currency in whichever country. There is at least one system that is tying all the digital currencies together. I don't remember what it's called.

The UN's "Better Than Cash Alliance" is calling elimination of cash "Digital Financial Inclusion" Each organization, company, and country that joins the alliance has to commit to moving away from cash and into some form of digital option. They don't actually care what kinds as long as it biws to their demands. They say they have to achieve this goal by 2030. See her say it in her own words https://www.youtube.com/watch?v=62fwtwX_SgM&t=2

It doesn’t even need to become conscious for this to be a reality. Corporations will absolutely use LLMs against people to influence their behavior. The whole super intelligence point is completely mute, humans aren’t aligned with humans.