valknar/runpod
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: update service_script path to vllm/server.py

Browse Source 
🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
Sebastian Krüger
2025-11-23 13:29:51 +01:00
parent b94df17845
commit d351ec7172
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
model-orchestrator/models.yaml
View File

@@ -6,7 +6,7 @@ models:
qwen-2.5-7b: qwen-2.5-7b:
type: text type: text
framework: vllm framework: vllm
service_script: models/vllm/server.py service_script: vllm/server.py
port: 8000 port: 8000
vram_gb: 14 vram_gb: 14
startup_time_seconds: 120 startup_time_seconds: 120
@@ -16,7 +16,7 @@ models:
llama-3.1-8b: llama-3.1-8b:
type: text type: text
framework: vllm framework: vllm
service_script: models/vllm/server.py service_script: vllm/server.py
port: 8001 port: 8001
vram_gb: 17 vram_gb: 17
startup_time_seconds: 120 startup_time_seconds: 120