Sebastian Krüger f668e06228 feat: add BGE embedding model for concurrent operation with Llama ...

- Create config_bge.yaml for BAAI/bge-large-en-v1.5 on port 8002
- Reduce Llama VRAM to 70% and context to 16K for concurrent use
- Add BGE service to supervisor with vllm group

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

2025-11-30 19:55:13 +01:00

3.6 KiB

Raw Permalink Blame History

View Raw