Oddbean new post about login | logout If I did everything correctly, when you open this website, you should be able to run any AI language model locally in your browser, any device. It will utilize your native hardware with new WebGPU API to run these models. This is just a demo; I am working on a proper interface for NostrNet.work users. Demo: https://ai.nostrnet.work
running locally mined AI on a pc as native app is resource intensive already. i think this will be even more so
Yes, it entirely runs on your hardware. On upcoming NostrNet PWA, you should even be able to turn off your internet, and it will still work. There are numerous options, including 1 billion models that can also run on your phone. Click on ""model name" on top centre, it will show you the list of all the models.
I get this: https://image.nostr.build/c49eb6968aec97ab2fbda46d8df57c5c4d4bc60eaf8da1b8eab14aab0355ae49.jpg#m=image%2Fjpeg&dim=864x1920&blurhash=%5B24.0pspS1WU%5E%2Bs%3AW%3BWB%3FHoLWoay%25MbHofaytQWVofj%5BS_WVt7j%5BbtWBs%3AofozWBs%3BkC%252aeofof&x=3b96a77c2fe2ab6132b2f8f4336eaed7eaead68cf49ca0fb3c54839cf49207fd
Safari/iOS WebKit does not support the WebGPU API yet; it works on every other device. You can try it on a PC, Android, Mac Additionally, Apple is planning to enable WebGPU for Safari, so you will have it very soon.
Running Graphene OS on Pixel 7a...
I get that same message on my Android...
Chrome?
Vanadium, in my case...
Kiwi Browser. But I just tried Chrome and got the same message again.
I encountered the same issue on Kiwi, but it works fine on Chrome. Have you attempted to switch models? The primary problem with this app is that the webGPU API it is using is not supported by all browsers. However, it is expected to be supported by all major browsers very soon.
I'm not sure what you mean by switch models? I just tried to open nostrnet.work on Chrome and got the message that I needed to install it as a Progressive Web App. So I did that and then tried to open ai.nostrnet.work from the PWA and still get that same message.
Error on iOS/Safari https://image.nostr.build/d09453af478a2f8ee9f981b77d38667d9ba01b04dfb3f4dc89a0e8eb51a3e9de.jpg
Safari/iOS WebKit does not support the WebGPU API yet; it works on every other device. You can try it on a PC, Android, Mac Additionally, Apple is planning to enable WebGPU for Safari, so you will have it very soon.
Sweet! I’ll try it out on my laptop this evening 🤙
Getting stuck in Pixel 6 stock using chrome/brave at: [System Initalize] Finish loading on WebGPU - arm Any chance in future to use the tensor TPU for quicker responses?
