services/vllm/config_llama.yaml

model: meta-llama/Llama-3.1-8B-Instruct
host: "0.0.0.0"
port: 8001
uvicorn-log-level: "info"
gpu-memory-utilization: 0.95
max-model-len: 20480
dtype: auto
enforce-eager: false
Initial commit 2025-11-26 15:31:41 +01:00			`model: meta-llama/Llama-3.1-8B-Instruct`
			`host: "0.0.0.0"`
			`port: 8001`
			`uvicorn-log-level: "info"`
fix: remove vllm embedding 2025-11-27 01:12:57 +01:00			`gpu-memory-utilization: 0.95`
fix: remove vllm embedding 2025-11-27 01:24:05 +01:00			`max-model-len: 20480`
fix: remove vllm embedding 2025-11-27 01:12:57 +01:00			`dtype: auto`
			`enforce-eager: false`