valknar/docker-compose
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
cdb8d2ef34c7404edd116a14392b995d6e298690
docker-compose/ai/litellm-config.yaml

30 lines
797 B
YAML
Raw Normal View History

feat: add LiteLLM proxy for Anthropic Claude models Added LiteLLM as an OpenAI-compatible proxy for Anthropic's API to enable Claude models in Open WebUI. **New Service: litellm** - Image: ghcr.io/berriai/litellm:main-latest - Internal proxy on port 4000 - Converts Anthropic API to OpenAI-compatible format - Health check with 30s intervals - Not exposed via Traefik (internal only) **LiteLLM Configuration (litellm-config.yaml)** - Claude Sonnet 4 (claude-sonnet-4-20250514) - Claude Sonnet 4.5 (claude-sonnet-4-5-20250929) - Claude 3.5 Sonnet (claude-3-5-sonnet-20241022) - Claude 3 Opus (claude-3-opus-20240229) - Claude 3 Haiku (claude-3-haiku-20240307) **Open WebUI Configuration Updates** - Changed OPENAI_API_BASE_URLS to point to LiteLLM proxy - URL: http://litellm:4000/v1 - Added litellm as dependency for webui service - Dummy API key for proxy authentication **Why LiteLLM?** Anthropic's API uses different endpoint structure and authentication headers compared to OpenAI. LiteLLM acts as a translation layer, allowing Open WebUI to use Claude models through its OpenAI-compatible interface. **Available Models in Open WebUI** - claude-sonnet-4 (latest Claude Sonnet 4) - claude-sonnet-4.5 (Claude Sonnet 4.5) - claude-3-5-sonnet - claude-3-opus - claude-3-haiku 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-08 22:58:09 +01:00
model_list:
- model_name: claude-sonnet-4
litellm_params:
model: anthropic/claude-sonnet-4-20250514
fix: correct LiteLLM environment variable syntax Changed API key reference from ${ANTHROPIC_API_KEY} to os.environ/ANTHROPIC_API_KEY to match LiteLLM's documented syntax. The os.environ/ prefix tells LiteLLM to use os.getenv() to retrieve the environment variable at runtime, which is the correct way to reference environment variables in LiteLLM config files. Reference: https://docs.litellm.ai/docs/proxy/deploy 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-09 00:30:07 +01:00
api_key: os.environ/ANTHROPIC_API_KEY
feat: add LiteLLM proxy for Anthropic Claude models Added LiteLLM as an OpenAI-compatible proxy for Anthropic's API to enable Claude models in Open WebUI. **New Service: litellm** - Image: ghcr.io/berriai/litellm:main-latest - Internal proxy on port 4000 - Converts Anthropic API to OpenAI-compatible format - Health check with 30s intervals - Not exposed via Traefik (internal only) **LiteLLM Configuration (litellm-config.yaml)** - Claude Sonnet 4 (claude-sonnet-4-20250514) - Claude Sonnet 4.5 (claude-sonnet-4-5-20250929) - Claude 3.5 Sonnet (claude-3-5-sonnet-20241022) - Claude 3 Opus (claude-3-opus-20240229) - Claude 3 Haiku (claude-3-haiku-20240307) **Open WebUI Configuration Updates** - Changed OPENAI_API_BASE_URLS to point to LiteLLM proxy - URL: http://litellm:4000/v1 - Added litellm as dependency for webui service - Dummy API key for proxy authentication **Why LiteLLM?** Anthropic's API uses different endpoint structure and authentication headers compared to OpenAI. LiteLLM acts as a translation layer, allowing Open WebUI to use Claude models through its OpenAI-compatible interface. **Available Models in Open WebUI** - claude-sonnet-4 (latest Claude Sonnet 4) - claude-sonnet-4.5 (Claude Sonnet 4.5) - claude-3-5-sonnet - claude-3-opus - claude-3-haiku 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-08 22:58:09 +01:00
- model_name: claude-sonnet-4.5
litellm_params:
model: anthropic/claude-sonnet-4-5-20250929
fix: correct LiteLLM environment variable syntax Changed API key reference from ${ANTHROPIC_API_KEY} to os.environ/ANTHROPIC_API_KEY to match LiteLLM's documented syntax. The os.environ/ prefix tells LiteLLM to use os.getenv() to retrieve the environment variable at runtime, which is the correct way to reference environment variables in LiteLLM config files. Reference: https://docs.litellm.ai/docs/proxy/deploy 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-09 00:30:07 +01:00
api_key: os.environ/ANTHROPIC_API_KEY
feat: add LiteLLM proxy for Anthropic Claude models Added LiteLLM as an OpenAI-compatible proxy for Anthropic's API to enable Claude models in Open WebUI. **New Service: litellm** - Image: ghcr.io/berriai/litellm:main-latest - Internal proxy on port 4000 - Converts Anthropic API to OpenAI-compatible format - Health check with 30s intervals - Not exposed via Traefik (internal only) **LiteLLM Configuration (litellm-config.yaml)** - Claude Sonnet 4 (claude-sonnet-4-20250514) - Claude Sonnet 4.5 (claude-sonnet-4-5-20250929) - Claude 3.5 Sonnet (claude-3-5-sonnet-20241022) - Claude 3 Opus (claude-3-opus-20240229) - Claude 3 Haiku (claude-3-haiku-20240307) **Open WebUI Configuration Updates** - Changed OPENAI_API_BASE_URLS to point to LiteLLM proxy - URL: http://litellm:4000/v1 - Added litellm as dependency for webui service - Dummy API key for proxy authentication **Why LiteLLM?** Anthropic's API uses different endpoint structure and authentication headers compared to OpenAI. LiteLLM acts as a translation layer, allowing Open WebUI to use Claude models through its OpenAI-compatible interface. **Available Models in Open WebUI** - claude-sonnet-4 (latest Claude Sonnet 4) - claude-sonnet-4.5 (Claude Sonnet 4.5) - claude-3-5-sonnet - claude-3-opus - claude-3-haiku 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-08 22:58:09 +01:00
- model_name: claude-3-5-sonnet
litellm_params:
model: anthropic/claude-3-5-sonnet-20241022
fix: correct LiteLLM environment variable syntax Changed API key reference from ${ANTHROPIC_API_KEY} to os.environ/ANTHROPIC_API_KEY to match LiteLLM's documented syntax. The os.environ/ prefix tells LiteLLM to use os.getenv() to retrieve the environment variable at runtime, which is the correct way to reference environment variables in LiteLLM config files. Reference: https://docs.litellm.ai/docs/proxy/deploy 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-09 00:30:07 +01:00
api_key: os.environ/ANTHROPIC_API_KEY
feat: add LiteLLM proxy for Anthropic Claude models Added LiteLLM as an OpenAI-compatible proxy for Anthropic's API to enable Claude models in Open WebUI. **New Service: litellm** - Image: ghcr.io/berriai/litellm:main-latest - Internal proxy on port 4000 - Converts Anthropic API to OpenAI-compatible format - Health check with 30s intervals - Not exposed via Traefik (internal only) **LiteLLM Configuration (litellm-config.yaml)** - Claude Sonnet 4 (claude-sonnet-4-20250514) - Claude Sonnet 4.5 (claude-sonnet-4-5-20250929) - Claude 3.5 Sonnet (claude-3-5-sonnet-20241022) - Claude 3 Opus (claude-3-opus-20240229) - Claude 3 Haiku (claude-3-haiku-20240307) **Open WebUI Configuration Updates** - Changed OPENAI_API_BASE_URLS to point to LiteLLM proxy - URL: http://litellm:4000/v1 - Added litellm as dependency for webui service - Dummy API key for proxy authentication **Why LiteLLM?** Anthropic's API uses different endpoint structure and authentication headers compared to OpenAI. LiteLLM acts as a translation layer, allowing Open WebUI to use Claude models through its OpenAI-compatible interface. **Available Models in Open WebUI** - claude-sonnet-4 (latest Claude Sonnet 4) - claude-sonnet-4.5 (Claude Sonnet 4.5) - claude-3-5-sonnet - claude-3-opus - claude-3-haiku 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-08 22:58:09 +01:00
- model_name: claude-3-opus
litellm_params:
model: anthropic/claude-3-opus-20240229
fix: correct LiteLLM environment variable syntax Changed API key reference from ${ANTHROPIC_API_KEY} to os.environ/ANTHROPIC_API_KEY to match LiteLLM's documented syntax. The os.environ/ prefix tells LiteLLM to use os.getenv() to retrieve the environment variable at runtime, which is the correct way to reference environment variables in LiteLLM config files. Reference: https://docs.litellm.ai/docs/proxy/deploy 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-09 00:30:07 +01:00
api_key: os.environ/ANTHROPIC_API_KEY
feat: add LiteLLM proxy for Anthropic Claude models Added LiteLLM as an OpenAI-compatible proxy for Anthropic's API to enable Claude models in Open WebUI. **New Service: litellm** - Image: ghcr.io/berriai/litellm:main-latest - Internal proxy on port 4000 - Converts Anthropic API to OpenAI-compatible format - Health check with 30s intervals - Not exposed via Traefik (internal only) **LiteLLM Configuration (litellm-config.yaml)** - Claude Sonnet 4 (claude-sonnet-4-20250514) - Claude Sonnet 4.5 (claude-sonnet-4-5-20250929) - Claude 3.5 Sonnet (claude-3-5-sonnet-20241022) - Claude 3 Opus (claude-3-opus-20240229) - Claude 3 Haiku (claude-3-haiku-20240307) **Open WebUI Configuration Updates** - Changed OPENAI_API_BASE_URLS to point to LiteLLM proxy - URL: http://litellm:4000/v1 - Added litellm as dependency for webui service - Dummy API key for proxy authentication **Why LiteLLM?** Anthropic's API uses different endpoint structure and authentication headers compared to OpenAI. LiteLLM acts as a translation layer, allowing Open WebUI to use Claude models through its OpenAI-compatible interface. **Available Models in Open WebUI** - claude-sonnet-4 (latest Claude Sonnet 4) - claude-sonnet-4.5 (Claude Sonnet 4.5) - claude-3-5-sonnet - claude-3-opus - claude-3-haiku 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-08 22:58:09 +01:00
- model_name: claude-3-haiku
litellm_params:
model: anthropic/claude-3-haiku-20240307
fix: correct LiteLLM environment variable syntax Changed API key reference from ${ANTHROPIC_API_KEY} to os.environ/ANTHROPIC_API_KEY to match LiteLLM's documented syntax. The os.environ/ prefix tells LiteLLM to use os.getenv() to retrieve the environment variable at runtime, which is the correct way to reference environment variables in LiteLLM config files. Reference: https://docs.litellm.ai/docs/proxy/deploy 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-09 00:30:07 +01:00
api_key: os.environ/ANTHROPIC_API_KEY
feat: add LiteLLM proxy for Anthropic Claude models Added LiteLLM as an OpenAI-compatible proxy for Anthropic's API to enable Claude models in Open WebUI. **New Service: litellm** - Image: ghcr.io/berriai/litellm:main-latest - Internal proxy on port 4000 - Converts Anthropic API to OpenAI-compatible format - Health check with 30s intervals - Not exposed via Traefik (internal only) **LiteLLM Configuration (litellm-config.yaml)** - Claude Sonnet 4 (claude-sonnet-4-20250514) - Claude Sonnet 4.5 (claude-sonnet-4-5-20250929) - Claude 3.5 Sonnet (claude-3-5-sonnet-20241022) - Claude 3 Opus (claude-3-opus-20240229) - Claude 3 Haiku (claude-3-haiku-20240307) **Open WebUI Configuration Updates** - Changed OPENAI_API_BASE_URLS to point to LiteLLM proxy - URL: http://litellm:4000/v1 - Added litellm as dependency for webui service - Dummy API key for proxy authentication **Why LiteLLM?** Anthropic's API uses different endpoint structure and authentication headers compared to OpenAI. LiteLLM acts as a translation layer, allowing Open WebUI to use Claude models through its OpenAI-compatible interface. **Available Models in Open WebUI** - claude-sonnet-4 (latest Claude Sonnet 4) - claude-sonnet-4.5 (Claude Sonnet 4.5) - claude-3-5-sonnet - claude-3-opus - claude-3-haiku 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-08 22:58:09 +01:00
litellm_settings:
drop_params: true
fix: configure LiteLLM without database requirement
2025-11-08 23:02:07 +01:00
set_verbose: true
Reference in New Issue Copy Permalink