option to use Antropic Claude instead of GPT-3/4
Claude is better for page summaries, asking questions about what's on the page a lot of the time because it has a larger context window. Many pages are too long for GPT-3.5/4 so they fail to do a decent job at summaries.
Comments5
Oliver Sauter
Oct 31, 2023
@BenThis is now live. We still use OpenAI for shorter texts so that people can still use their API keys, but have gotten access to Anthropic's AI and use it for longer form videos & texts.
Speed improvement is massive. For a 2h video down from 40s to less than 10s.
Once Anthropic gives more broad access for people to have personal API keys we'll also add that and make it possible to fully swap between the models.
Also, we've added chapter summaries to Youtube videos.
In this changelog post you find a demo video of both.
Ben Woodward
Oct 31, 2023
fantastic! thank you
[Deleted User]
Oct 30, 2023
It would also be good idea to use customizable service (as in - user enter url and keys). It's possible to have local Raven/Mistral installs after all. It would also prevent any potential issues with clear data being sent to external service.
Oliver Sauter
Nov 1, 2023
That sounds like a good idea though not sure how customisable this is by just adding url and keys. Wondering mostly about their output format - as already GPT and Anthropic were different enough to need customisation per service.
Oliver Sauter
Oct 9, 2023
Open to that idea! Actually quite some work to work around the context window being often too small.
Do you have anything to to read for me about their performance?