LiteLLM

Fast AI gateway — call 100+ LLM providers through one OpenAI-compatible API, as proxy or SDK.