LiteLLM
Route model requests through one gateway.
Free plan availableIs LiteLLM right for you?
Good for
- AI engineering teams looking for model routing and ai cost monitoring.
- Route model requests through one gateway.
Keep in mind
- Evaluate deployment requirements, data handling, and workload costs before choosing infrastructure.
- The open-source gateway is free to self-host. Enterprise controls and support are paid; model-provider usage and hosting costs are separate.
- Workflows that require final outputs without human review.
Pricing and access
More about LiteLLM
LiteLLM gives teams an OpenAI-compatible gateway for multiple model providers, with spending controls, request routing, and self-hosting options.
Available on
Web
Alternatives to LiteLLM
Choose around the work you need to do.