perf: optimize LiteLLM for better performance
Reduce database logging overhead and enable prompt caching: - Disabled verbose logging (set_verbose: false) - Disabled spend tracking logs to reduce DB writes - Disabled tag tracking and daily spend logs - Removed success/failure callbacks - Enabled prompt caching for claude-sonnet-4.5 - Set log level to ERROR only - Removed --detailed_debug flag from command This should significantly improve response times by eliminating unnecessary database writes for every request. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
@@ -99,6 +99,9 @@ services:
|
||||
LITELLM_DROP_PARAMS: 'true'
|
||||
NO_DOCS: 'true'
|
||||
NO_REDOC: 'true'
|
||||
# Performance optimizations
|
||||
LITELLM_LOG: 'ERROR' # Only log errors
|
||||
LITELLM_MODE: 'PRODUCTION' # Production mode for better performance
|
||||
volumes:
|
||||
- ./litellm-config.yaml:/app/litellm-config.yaml:ro
|
||||
command:
|
||||
@@ -109,7 +112,6 @@ services:
|
||||
'0.0.0.0',
|
||||
'--port',
|
||||
'4000',
|
||||
'--detailed_debug',
|
||||
'--drop_params'
|
||||
]
|
||||
depends_on:
|
||||
|
||||
Reference in New Issue
Block a user