Files
runpod-ai-orchestrator/services/vllm/config_bge.yaml

6 lines
111 B
YAML
Raw Normal View History

2025-11-26 15:31:41 +01:00
model: BAAI/bge-large-en-v1.5
host: "0.0.0.0"
port: 8002
uvicorn-log-level: "info"
2025-11-27 00:57:14 +01:00
gpu-memory-utilization: 0.1