Files
runpod-ai-orchestrator/services
Sebastian Krüger f68bc47915
All checks were successful
Build and Push RunPod Docker Image / build-and-push (push) Successful in 14s
feat: increase Llama max-model-len to 20480
Adjusted VRAM allocation for larger context window:
- Llama: 90% VRAM, 20480 context (up from 8192)
- BGE: 8% VRAM (down from 10%)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-30 22:15:08 +01:00
..
2025-11-26 17:15:08 +01:00