Sebastian Krüger 62fcf832da feat: add direct RunPod orchestrator connection to WebUI for streaming bypass ...

- Configure WebUI with both LiteLLM and direct orchestrator API base URLs
- This bypasses LiteLLM's streaming issues for the qwen-2.5-7b model
- WebUI will now show models from both endpoints
- Allows testing if LiteLLM is the bottleneck for streaming

Related to streaming fix in RunPod models/vllm/server.py

2025-11-21 18:38:31 +01:00

..

postgres/init

feat: add PostgreSQL initialization script for AI stack

2025-11-09 18:36:50 +01:00

compose.yaml

feat: add direct RunPod orchestrator connection to WebUI for streaming bypass

2025-11-21 18:38:31 +01:00

disable-nsfw-filter.patch

fix: correct patch for Facefusion 3.5.0 content_analyser.py

2025-11-13 04:28:50 +00:00

Dockerfile

fix: update content_analyser hash check in core.py for patched version

2025-11-13 06:16:14 +01:00

entrypoint.sh

fix: add Gradio environment variables and remove conflicting command

2025-11-13 05:52:13 +01:00

litellm-config.yaml

fix: add /v1 suffix to vLLM api_base for proper endpoint routing

2025-11-21 18:00:53 +01:00