Oddbean new post about login | logout How do you even compete with Apple? They have a vertically integrated stack from privacy preserving silicon to ai tech. I thought apple was going downhill, but now with private-cloud and ondevice intelligence, it makes my linux box + typing into chatgpt look like a joke.
Still closed source and they have never been audited to show they are not taking private user data. No?
You can verify this when they release it. Just disconnect from the internet and use it.
Yes, but when it is connected, what data is shared to their severs in secret? You can't know unless a third party audit.
If I heard correctly they had a third party audit. Not 100% sure
Oh, that would be something.
Couldn’t it just log and send the report when you reconnect? “iPhone Storage > System Data” has quite a few GB of black box data that is constantly fluctuating in size. Could easily be logs that I never see.
I don’t trust them.
"ondevice intelligence"
It’s literally what it is. When it comes out you can test their claims by using it without internet
Brain melting.
I guess I could use on-device models, but linux is not even close to having system-wide integration of local models that can access many different systems and integrate them. We need whole new kinds of apis and system interfaces for this. I suspect it’s at least 20+ years away. Apple is way ahead of the curve here.
This makes me sad, it feels like open source tech is way behind now. AI is going to change computing and people are going to forget about the days when we didn’t have it. It will look like old and obscure tech, even more than it already is. The opensource ai crowd needs to pick up the pace or open source computing is fucked and it will become less relevant than ever.
How is open source AI goin to even begin to scale against characters like Altman
Very morbid. I can't see myself trusting Apple (or any other closed source big tech operator) enough to use something like this... But there most likely comes a point where there isn't a real choice to opt out, implied or otherwise.
personalized ai assistants who offload tons of computing interface complexity. Normies will eat this up. Techies will too. It will save tons of time. There’s no going back after this. Star trek computer is where we are headed.
Mind bending. This is a lot of power to comprehend.
Only if you ignore the unsolved and persistent MAJOR, high risk,problem: It doesn't actually work. No AI model is accurate enough to avoid disaster: there will be countless stories of AI telling your boss something you didn't want said, or making purchases you didn't want, telling you to add glue to pasta sauce. These problems aren't going away, and the only way to stop such risks is to make AI a less useful assistant, which is what a standard computer is.
AI assistant will be a short lived gimmick, in the sense that if you don't mind it being completely inaccurate for all the integrated tasks you give it, then it will SORT OF work. But when it makes mistakes, it will move beyond just annoying (like when alexa doesn't understand your words) to destructive and catastrophic. Apple doesn't want to use its own AI because it doesn't want that responisibility. It informs you that you are using OpenAI. Because its an unreliable toy.
I was ready to get rid of my Mac but I can't.
The military industrial complex is trying to demoralize you. Open source AI is doing well, give it time
People will crave traditional computers that don't spy on you all day long, the way people crave Monero or Tor - none of which will and should never ever be integrated into AI. I'm not sure I would even read a newspaper on an AI chipped machine.
OpenWebUI is a start
It's got fancy spyware, big woop.
you’re average android phone is likely 100x worse than apple privacy wise. Apple makes money on hardware, not user data. They wouldn’t put so much effort into secure enclaves, e2e encryption, and private ai clouds otherwise, as all of this makes data collection harder. Unless you’re using grapheneOS, the anti-apple pro-android privacy crowd is a larp and misinformed. Android is built by google, a company who could care less about your privacy.
I'm an idiot, please ignore anything I say.
Just wait until Im running AI and Graphene OS on this bad-boy, see who has the last laugh then. upload.wikimedia.org/wikipedia/commons/thumb/3/31/Nokia_3310_blue.jpg/1200px-Nokia_3310_blue.jpg
😂
Agreed ... On iOS you get privacy from companies except apple. On standard bloated android, you get privacy from no one.
You get privacy from no one either way On iOS Apple is responsible for leaks and on Pixel Google is responsible for leaks On Samsung nobody is responsible for leaks because Samsung don't take responsibility for anything, they sell toys and bargain products
Apple has an ad platform as well. Every Facebook ad user is using an Apple-made identifier to correlate interests instead of a Meta-made one. That apple made identifier so that they could control the ad space and sell their own ad platform: https://searchads.apple.com/ Don't fool yourself into thinking that Apple is much different than Google. They are all selling your data. Google is just upfront that they are selling it.
100%. Graphene is it’s own league but the average Samsung phone etc has absolute shite privacy. I’d trust that shit 100 times less than an Apple phone. Apple provides no freedom but seems to have better privacy overall.
This helps out a a lot on Samsung https://github.com/Universal-Debloater-Alliance/universal-android-debloater-next-generation/
I'm agnostic about Apple and Google, but the thing that strikes me is this. You ask Google, do you share my data. They say hell yeah. Do you profile me. Hell yeah we do. Apple has never admitted anything until they were caught out. Did you give China access to stay in their market. That's commercially sensitive. Do you use device information to profile us. Silence! They're just bad in different ways. Google is blatant. Apple is devious.
Apple are the ones that straight up announced they won't allow privacy on their devices anymore and can report people for what's on their devices
And then there is this (which frankly ought to end the discussion, it PROVES they can't be trusted with privacy) https://arstechnica.com/tech-policy/2023/12/apple-admits-to-secretly-giving-governments-push-notification-data/
coming from one who obviously has a far greater handle on these technologies, this is both surprising and appreciated. as one of the big corps, i will always have concerns . they have been caught with their hand in the cookie jar a few to many times. too good too be true products, they certainly delivered. now they are pursuing ai? its a small step to data collection .... .... there are always questions. GM
This is some fanboy copium
I am not an apple fanboy. I use my linux box and hand-built desktop environment 90% of the day. I have an apple phone because android phones are terrible privacy wise, unless you use graphene but then I can’t use my bitcoin apple/google pay debit card.
Saying that a device made by an ad company is less concerned with privacy than a company that's been beating the privacy drum for more than a decade? There are many things to criticize Apple for, but this isn't one of them.
https://arstechnica.com/tech-policy/2023/12/apple-admits-to-secretly-giving-governments-push-notification-data/ Yes it is.
Apple chose to use google as their default search engine, because they don't care about your privacy anymore than Google does.
Just because Apple could do better doesn't make them the same as Google. Take web browsers: Safari could do better, but they were the first to limit tracking cookies, and they took some hits on compatibility to do so. Chrome is now also limiting tracking cookies, but only for other people because Chrome quietly includes an almost unique set of experiment flags, but only when talking to Google owned sites. This is why I can't trust Google.
But isn't your #argument essentially; believe what Apple tell us? I can't trust someone I never met to tell me the truth. I don't understand how you can. Apple can say what they like. It's what they do I'll judge them on. And #apple and #google do the same thing. They betray our trust. I would judge #Microsoft the same way, if they were in this argument. The real contrast here is #Linux. If they spy on us we can see it in the code. That's the real deal with #opensource #software. We don't need to trust it. We can see what they're doing. That's the model I prefer. I use an #android phone and an #ipad but I don't expect them to protect my #privacy. That would be naive.
That's fair, but it still doesn't change that we can rationally expect Apple to do a better job than Google. While they are both large, US companies, they have different revenue models motivating them. Apple also leans heavily into privacy as part of their brand, and created a Lockdown Mode for those who take their privacy even more seriously. You are of course free to use neither, and should probably abstain from cellular radios altogether, but that's not what this thread is about.
Yea they are always slower to get the newest tech but when they do add it its done better than anyone else has done it.
This is the good old Steve Jobs tactic. Look around what is currently out. Make it better and sell it to the people
They basically just put Microsoft owned tech on their phones. I don't think siri having more functionality will really change much, most normies don't really use chatgpt other than for school or work. Seems almost boring compared to their previous work. Like the Vision pro was hyped for 2 days before people realized the user base wasn't there. I know it was more for enterprise but Idk seems like another half assed product/enviroment.
Privacy preserving.... You believe them?
...Because you have to trust them. Can't audit their tech at all. Big black hole with a loud microphone apple is.
You can read about their entire stack, its not just belief, they are opening it to researchers: https://security.apple.com/blog/private-cloud-compute/ Its extremely impressive
That's why I say: if it works in actuality the way they present it in theory, I'm fine with it.
Even if they used half the techniques they described in this post it would already be a huge privacy improvement over the way people are using ai today.
Did @NVK stole Will’s nsec?
i'm not sure if i hear sarcasm in your post
x2
If they so privacy focused, do they plan to integrate a private payment method?
Yeah (and as an Apple user, I’m playing devil’s advocate), isn’t it the epitome of centralised centralisation a company can get? Zaps/Apple store kinda demon-strated this.
Centralization isn’t always bad in my eyes Yes, the App Store is centralized and this zap thing was bullshit. But let’s be honest, how many people are using an alternative App Store on android where it’s possible since day one to install one.
How many people are using bitcoin instead of the dollar? Is that a compelling reason?
yes their tyrannical control of what is allowed on the appstore is a huge downside, which is why I think they should just allow you to install a dmg or something directly onto the phone like android. Let us run the software we want to run ffs.
How long before they actually provide data to governments? Via backdoors or otherwise. At least in EU where there is no place for e2ee. no thanks. theirs business model is something I wouldn't touch with 5m stick. nostr:nevent1qqs87nzjs8lu2q4ewvc8adsqzryhpkl2qgr93eug6a0g8j6t03nqe6gpz4mhxue69uhhyetvv9ujumn0wd68ytnzvuhsygpjuxp8vd29p6ancknaztql3eajk52y8xkppfn7au7elkw9c68zg5psgqqqqqqsv7tu4l
They already announced image scanning backdoors long ago and then claimed to cancel the project https://archive.is/BpZQF
From now on, I identify as an AI skeptic/luddite. nostr:nevent1qqs87nzjs8lu2q4ewvc8adsqzryhpkl2qgr93eug6a0g8j6t03nqe6gpz9mhxue69uhkummnw3ezuamfdejj7q3qxtscya34g58tk0z605fvr788k263gsu6cy9x0mhnm87echrgufzsxpqqqqqqzutzme8
Having followed Apple for close to three decades, I knew this would happen as soon as the first llama dropped. They tend to have a longer horizon and miss out on a lot of practical opportunities while lining up for something most people aren't thinking about yet. Given their surprising advance in unified memory and decision to make over-powered but under-featured mobile devices, preparing to run something heavy in the near future is a reasonable conclusion. But, their advantage is going to be limited by their ecosystem. iOS is a lot more constrained than an open source OS, and while it can be a hot mess, it's also possible to lock those down too. It just takes time and code. Perhaps code written by LLMs.
Yesterday I downloaded a local LLM app to my iPhone 15 Pro Phi3 mini was throwing 15 tokens / sec. Don't get sidetracked by Apple, everyone is going the same place, and very soon.
Which App?
This was https://github.com/guinmoon/LLMFarm
Thanks! You inspired me to search github for an android equivalent app. Found this one but I have not tested it, still downloading Q4_K_M https://github.com/nerve-sparks/iris_android
search terms I used https://github.com/search?q=ggml+android+&type=repositories
Open source AI will discuss content that closed source Apple, Google, Altman would never touch. That could be the difference maker.
OpenAI are lobbying US govnt to force GPU manufacturrers to put chips in to prevent them running 'unnaproved' models for 'safety' . ie to block open source and privacy.
How do you compete against them? Provide a similar platform that is open source and amenable to third party developers, forking, modifying, allowing markets to bloom. Provide the substrate for a complex adaptive system and it will devour the railroaded completion like complex adaptive systems always do. nostr:nevent1qqs87nzjs8lu2q4ewvc8adsqzryhpkl2qgr93eug6a0g8j6t03nqe6gpz4mhxue69uhhyetvv9ujuerpd46hxtnfduhsygpjuxp8vd29p6ancknaztql3eajk52y8xkppfn7au7elkw9c68zg5psgqqqqqqsned064
iOS 18 changes everything
How can we be sure of the privacy?
just read the source 😂
Unless you’re reading the source of every dependency and you build all of your software from source, you’re always trusting someone, even in open source. Many times the software you install on your computer was built by someone else, which has the chance to inject malware, separate from the code you read from their repo.
I'm not able to read the source. I use Homebrew on MacOS and Flathub on Linux. I think Homebrew has a larger install base. Is it crazy for me to trust my use of MacOS more? I also monitor outgoing traffic with Little Snitch and use hardening guides to reduce telemetry.
Make the switch??
I will never trust apple or any company listed on a stock exchange
Can't tell if this is serious or sarcasm. Also suspicious of sudden epiphanies like this. ChatGPT is a privacy headache but that doesn't drag Linux into the same label, nor does it make Apple the only alternative when there's a ton of local server options available... it takes a few seconds to download LM Studio or Ollama... there's no need for drama ,🦙. nostr:note10ax99q0lc5ptjues06mqqyxfwrd75qsxtrnc3467s095klrxpn5st0zed9
They’re just really good at taking the time to ship great stuff, that’s often in service of some greater vision that’s visible only to a small number of the leadership. Jobs set up the factory and it’s still churning out unmatched products. Every engineer there gets the last ounce of effort squeezed out them by WWDC by the system he set up. It would be even better if Jobs was still around of course, albeit with a tad more burnout.
I want to use apple more now, thats the problem. If I can do the same kind of things I am doing with openai but in a way that preserves my privacy and doesn’t send all my personal data to them, that is too good not to use. I’m sad because they are doing everything right in ways that would make me want to use it over my linux box.
How do you know they aren't collecting your personal data ? Apple have lied before and they will lie again.
bro what isn’t collecting our data
This is the only thing I know of https://unplugged.com/
How do you know they aren't collecting your personal data ? Apple have lied before and they will lie again.
bro what isn’t collecting our data
This is the only thing I know of https://unplugged.com/
bro what isn’t collecting our data
This is the only thing I know of https://unplugged.com/
This is the only thing I know of https://unplugged.com/
It's pretty fucking cool. I just hope Linux environments find a way to compete.