I’ve just discovered OmniGPT that seems to be a chat where you can interact with different LLM (Claude, GPT-4, Llama, Gemini, etc.) and costs $16/month (it was $7/month until a week ago 🤦♂️). I’ve read on a Reddit post that it uses the APIs of all the provider that is a thing that can be done for free using a personal account (since the API limit seems to be high). Do you know something like OminGPT that can be self hosted that uses users API keys?
I think KoboldAI Lite is what you’re asking for. I’m not sure how it works, but it seems to be able to use OpenAI, Claude, Gemini, Horde and OpenRouter.
I think this is the repo for the website: https://github.com/LostRuins/lite.koboldai.net
The website is a bit ugly.
I believe Librechat would achieve your goals, but you’d need a PC or server to host it in. It supports all major API.
Kobold light might with as well, and doesn’t need to be hosted locally, but I don’t think it supports Claude haiku specifically, for unknown reasons.
Additionally, the official Claude api workshop is pretty good on desktop, but it only supports Claude.
check out NextChat and LibreChat