valknar/docker-compose
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix(ai): add 600s timeout for qwen model requests via Tailscale

Browse Source
This commit is contained in:
Sebastian Krüger
2025-11-21 17:06:01 +01:00
parent 6aea9d018e
commit 92a7436716
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
ai/litellm-config.yaml
View File

@@ -37,6 +37,8 @@ model_list:
api_key: dummy api_key: dummy
rpm: 1000 rpm: 1000
tpm: 100000 tpm: 100000
timeout: 600 # 10 minutes for generation
stream_timeout: 600
# Image Generation # Image Generation
- model_name: flux-schnell - model_name: flux-schnell