I insta-paid the yearly, lol Honestly can’t tell the difference between Venice, anthropic, and ChatGPT except for I know I hit the context window a little faster on Venice than the others. But output is generally great. In fact I used OpenAI the other day for chapter markers on my YouTube video and they were completely nonsensical. It was all topics we discussed, but it had exactly zero matching of the time codes despite being throughout the file. Llama (Venice) did a better job, but stopped early on the file because it was a huge transcript. Had to cut it up.
Appreciate the context, no pun intended. For 50 bucks a year, still, I am in.
Install a local LLM software and use the biggest models through deepinfra with their API. It's a few cents a months only, highly recommended.
Oh damn will check this one out. Thanks for the info!
I’ve spent the last couple days digging into providers that I can use with work and deepinfra is incredible. It’s shocking how bad the data privacy terms of the OpenAI API is compared to deepinfra. At first I was confused why they don’t have as many models as OpenRouter, but I imagine a lot of it comes down to being able to maintain their terms of service that are user friendly. Thanks again for sharing!