Files
runpod-ai-orchestrator/services/vllm/config_bge.yaml

6 lines
112 B
YAML
Raw Normal View History

2025-11-26 15:31:41 +01:00
model: BAAI/bge-large-en-v1.5
host: "0.0.0.0"
port: 8002
uvicorn-log-level: "info"
2025-11-27 00:50:42 +01:00
gpu-memory-utilization: 0.25