Files
runpod-ai-orchestrator/services/vllm/config_bge.yaml
Sebastian Krüger eaa8e0ebab
All checks were successful
Build and Push RunPod Docker Image / build-and-push (push) Successful in 14s
fix: vllm gpu utilization
2025-11-27 00:50:42 +01:00

6 lines
112 B
YAML

model: BAAI/bge-large-en-v1.5
host: "0.0.0.0"
port: 8002
uvicorn-log-level: "info"
gpu-memory-utilization: 0.25