services/vllm/config_llama.yaml

model: meta-llama/Llama-3.1-8B-Instruct
host: "0.0.0.0"
port: 8001
uvicorn-log-level: "info"
gpu-memory-utilization: 0.9
max-model-len: 20480
Initial commit 2025-11-26 15:31:41 +01:00			`model: meta-llama/Llama-3.1-8B-Instruct`
			`host: "0.0.0.0"`
			`port: 8001`
			`uvicorn-log-level: "info"`
fix: vllm gpu utilization 2 2025-11-27 00:57:14 +01:00			`gpu-memory-utilization: 0.9`
fix: vllm gpu utilization 2025-11-27 00:50:42 +01:00			`max-model-len: 20480`