valknar/docker-compose
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: disable LiteLLM cache to avoid Redis requirement

Browse Source 
Disabled cache setting that requires Redis configuration.
Prompt caching at the Anthropic API level is still enabled
via supports_prompt_caching setting.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
Sebastian Krüger
2025-11-16 16:04:39 +01:00
parent 8a18ae753d
commit 5cec1415ad
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
ai/litellm-config.yaml
View File

@@ -30,8 +30,8 @@ model_list:
litellm_settings: litellm_settings:
drop_params: true drop_params: true
set_verbose: false # Disable verbose logging for better performance set_verbose: false # Disable verbose logging for better performance
# Enable prompt caching for better performance # Disable LiteLLM caching (prompt caching at API level is separate)
cache: true cache: false
# Force strip specific parameters globally # Force strip specific parameters globally
allowed_fails: 0 allowed_fails: 0
# Modify params before sending to provider # Modify params before sending to provider