LiteLLM
NewTrialOpen Sourcev1.52Latest release: November 20, 2024
Unified interface for 100+ LLM providers
llmabstractionopen-sourceproxy
Advantages
- OpenAI-compatible API
- Self-hostable proxy
- Budget controls
- Load balancing
- Active development
Considerations
- Configuration complexity
- Proxy overhead
- Rapid changes
PricingFree tier: Fully open sourceEnterprise available
Use Cases
Multi-provider abstraction
Self-hosted LLM gateway
Budget management
Fallback routing
Release History
1.52November 20, 2024
View release notes 1.0February 15, 2024Major Release
View release notes