Oddbean new post about | logout
 nostr:npub1rysx3lwfv2d7x9c43l4gh0skvg4m70eekd2v47zvx89vafulem0qav5m9t nostr:npub1w8p9la2m762ujtl4yf6cl5x6d5rxjeh94hwyhgfcr8w2fsgq8mns5c0wl2 nostr:npub15fkerqqyp9mlh7n8xd6d5k9s27etuvaarvnp2vqed83dw9c603pqs5j9gr nostr:npub1pyy99xge0464jlmylqqgflk3y9a8gzfhemnz4ue55qp5qtxl57qsaljuws 

So if you use AI with a CPU, it loads all the models into RAM from the start. When you use a GPU, are you saying it loads it all on the GPU instead of RAM?