Oddbean new post about login | logout As far as I can tell, the only thing that delineates an AI-capable computer for one that's not is decent specs and a good cooling system.
not sure about that My M3 sweats hard on llama3 70b Think we are 3 years from self hosting. models will get smaller and more task specific and processors will get better It's a bit daft that the model I use for coding also knows ancient Greek and sumarian for example
In all fairness, I'm not really going to do anything AI-related on this computer. If I do that, I'll build a dedicated server for it. But when I'm looking at high-end laptops, they all have the same AI-ready marketing shtick.
exactly it's bullshit they are AI ready with Chrome to connect to chatgpt I'm only interested in self hosted AI. it's gonna be huge in three years OpenAI = ABC News Self Hosted = Library of Alexandria
Yeah, I don't disagree, but right now, at least as far as I can tell, it seems like a marketing term. So I'm just looking at specs and going from there and ignoring pretty much everything else. It's pretty funny. They've revised the way that we recall works after all of that backlash.
Well shit looks like I'm going to be getting some intentionally older hardware. The newer processor that I was looking at from Intel I guess has something called an NPU or a neural processing unit which not only doesn't have a lot of Linux support at the moment from what I'm aware of. It's a processing unit specifically designed to help with AI task loads and since I'm not doing anything AI related on this computer I'm not sure I want that in my computer. Glad I took a closer look at this. 😅
Yeah! That's what I was talking about. 😤 Sucks that you're stuck with older hardware choices, though.