Oddbean new post about login | logout There’s still some final touches but this thing has been reliably crunching numbers for 3 days now. This thing is solid 🔥🔥 Running Prem Ai with Vicuna 3b, Whisper, and Stable Diffusion. All are cruising nicely. So cool having my own Ai to work with. Exploring some coding specific models tomorrow. https://v.nostr.build/azoQ.mov
Nice. What is the card with the two fans on the top level?
Just liquid cooling for my CPU
Very sexy.
very cool setup. Did you try running Mistral 7b?
Not yet, but saw it in Prem I think
Prem doesn’t have it. But you can directly pull from huggingface and run it.
Badass. Just putting the finishing touches on my own home rig as well. https://i.nostr.build/Y8je.jpg
This is very cool. Makes me hopeful for the future. "GPT, print me an FGC-9"
YEEEEESSS
Like a Boss
I’ll be fine, ill be waiting patiently, and come running into my open arms. Open up your eyes. Dont say you want me, don’t say you need me, it’s understood. - its no good
That's sexy 💯
I think I understand the scale of what I'm looking at but not sure. Putting a quarter or pencil or something commonly known in the shot would help us not technical folks understand what we're seeing a bit more 🫡
Banana for scale?
Banana is the standard.
Sure that would work. As long as there's something to show how big the banana is🤣🤣
Very cool. How are you using whisper exactly?
Right now for drag and drop transcription of all my video and audio work. https://youtu.be/ZDw8ZNFBKes?si=yzys1uT9lh1FNgNe
Estimated investment for a machine like this?
If I had gone used I could’ve done this for probably a lot less than I did, but right now I think there’s 4K or so in this machine… not counting the multiple motherboards and the nightmare of buying like 8 sticks of RAM to troubleshoot some reeeaaaalllly annoying problems.
Looks nice! What's the specs on that beast? Since I have some serious space constraints I went for a used laptop with i7 CPU/64GB, with a mobile RTX 5000 / 16GB VRAM. Not the fastest, but combined with a used 3090 24GB eGPU it can load quite big models. All for about 2600 USD.
i9 CPU 192GB of RAM 3090 w 24GB of VRAM 11 HDD slots (will have 2x 32TB RAIDs)
