valknar/runpod
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: add BGE embedding service and reorganize supervisor groups
All checks were successful
Build and Push RunPod Docker Image / build-and-push (push) Successful in 14s
Details

Browse Source 
- Add vLLM embedding server for BAAI/bge-large-en-v1.5 (port 8002)
- Reorganize supervisor into two logical groups:
  - comfyui-services: comfyui, webdav-sync
  - vllm-services: vllm-qwen, vllm-llama, vllm-embedding
- Update arty.yml service management scripts for new group structure
- Add individual service control scripts for all vLLM models

Note: Embedding server currently uses placeholder implementation
For production use, switch to sentence-transformers or native vLLM embedding mode

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
Sebastian Krüger
2025-11-25 06:32:01 +01:00
parent e12a8add61
commit 5af3eeb333
3 changed files with 274 additions and 25 deletions
Download Patch File Download Diff File Expand all files Collapse all files

71
arty.yml
View File

@@ -761,38 +761,65 @@ scripts:
# Service Management (Supervisor-based)
#
# All services
services/start: supervisorctl -c /workspace/supervisord.conf start ai-services:*
services/stop: supervisorctl -c /workspace/supervisord.conf stop ai-services:*
services/restart: supervisorctl -c /workspace/supervisord.conf restart ai-services:*
services/start: supervisorctl -c /workspace/supervisord.conf start all
services/stop: supervisorctl -c /workspace/supervisord.conf stop all
services/restart: supervisorctl -c /workspace/supervisord.conf restart all
services/status: supervisorctl -c /workspace/supervisord.conf status
# ComfyUI service
services/comfyui/start: supervisorctl -c /workspace/supervisord.conf start ai-services:comfyui
services/comfyui/stop: supervisorctl -c /workspace/supervisord.conf stop ai-services:comfyui
services/comfyui/restart: supervisorctl -c /workspace/supervisord.conf restart ai-services:comfyui
services/comfyui/status: supervisorctl -c /workspace/supervisord.conf status ai-services:comfyui
services/comfyui/logs: supervisorctl -c /workspace/supervisord.conf tail -f ai-services:comfyui
# ComfyUI services group
services/comfyui-group/start: supervisorctl -c /workspace/supervisord.conf start comfyui-services:*
services/comfyui-group/stop: supervisorctl -c /workspace/supervisord.conf stop comfyui-services:*
services/comfyui-group/restart: supervisorctl -c /workspace/supervisord.conf restart comfyui-services:*
services/comfyui-group/status: supervisorctl -c /workspace/supervisord.conf status comfyui-services:*
# Orchestrator service
services/orchestrator/start: supervisorctl -c /workspace/supervisord.conf start ai-services:orchestrator
services/orchestrator/stop: supervisorctl -c /workspace/supervisord.conf stop ai-services:orchestrator
services/orchestrator/restart: supervisorctl -c /workspace/supervisord.conf restart ai-services:orchestrator
services/orchestrator/status: supervisorctl -c /workspace/supervisord.conf status ai-services:orchestrator
services/orchestrator/logs: supervisorctl -c /workspace/supervisord.conf tail -f ai-services:orchestrator
# vLLM services group
services/vllm-group/start: supervisorctl -c /workspace/supervisord.conf start vllm-services:*
services/vllm-group/stop: supervisorctl -c /workspace/supervisord.conf stop vllm-services:*
services/vllm-group/restart: supervisorctl -c /workspace/supervisord.conf restart vllm-services:*
services/vllm-group/status: supervisorctl -c /workspace/supervisord.conf status vllm-services:*
# ComfyUI service
services/comfyui/start: supervisorctl -c /workspace/supervisord.conf start comfyui-services:comfyui
services/comfyui/stop: supervisorctl -c /workspace/supervisord.conf stop comfyui-services:comfyui
services/comfyui/restart: supervisorctl -c /workspace/supervisord.conf restart comfyui-services:comfyui
services/comfyui/status: supervisorctl -c /workspace/supervisord.conf status comfyui-services:comfyui
services/comfyui/logs: supervisorctl -c /workspace/supervisord.conf tail -f comfyui-services:comfyui
# WebDAV Sync service
services/webdav-sync/start: supervisorctl -c /workspace/supervisord.conf start ai-services:webdav-sync
services/webdav-sync/stop: supervisorctl -c /workspace/supervisord.conf stop ai-services:webdav-sync
services/webdav-sync/restart: supervisorctl -c /workspace/supervisord.conf restart ai-services:webdav-sync
services/webdav-sync/status: supervisorctl -c /workspace/supervisord.conf status ai-services:webdav-sync
services/webdav-sync/logs: supervisorctl -c /workspace/supervisord.conf tail -f ai-services:webdav-sync
services/webdav-sync/start: supervisorctl -c /workspace/supervisord.conf start comfyui-services:webdav-sync
services/webdav-sync/stop: supervisorctl -c /workspace/supervisord.conf stop comfyui-services:webdav-sync
services/webdav-sync/restart: supervisorctl -c /workspace/supervisord.conf restart comfyui-services:webdav-sync
services/webdav-sync/status: supervisorctl -c /workspace/supervisord.conf status comfyui-services:webdav-sync
services/webdav-sync/logs: supervisorctl -c /workspace/supervisord.conf tail -f comfyui-services:webdav-sync
# vLLM Qwen service
services/vllm-qwen/start: supervisorctl -c /workspace/supervisord.conf start vllm-services:vllm-qwen
services/vllm-qwen/stop: supervisorctl -c /workspace/supervisord.conf stop vllm-services:vllm-qwen
services/vllm-qwen/restart: supervisorctl -c /workspace/supervisord.conf restart vllm-services:vllm-qwen
services/vllm-qwen/status: supervisorctl -c /workspace/supervisord.conf status vllm-services:vllm-qwen
services/vllm-qwen/logs: supervisorctl -c /workspace/supervisord.conf tail -f vllm-services:vllm-qwen
# vLLM Llama service
services/vllm-llama/start: supervisorctl -c /workspace/supervisord.conf start vllm-services:vllm-llama
services/vllm-llama/stop: supervisorctl -c /workspace/supervisord.conf stop vllm-services:vllm-llama
services/vllm-llama/restart: supervisorctl -c /workspace/supervisord.conf restart vllm-services:vllm-llama
services/vllm-llama/status: supervisorctl -c /workspace/supervisord.conf status vllm-services:vllm-llama
services/vllm-llama/logs: supervisorctl -c /workspace/supervisord.conf tail -f vllm-services:vllm-llama
# vLLM Embedding service
services/vllm-embedding/start: supervisorctl -c /workspace/supervisord.conf start vllm-services:vllm-embedding
services/vllm-embedding/stop: supervisorctl -c /workspace/supervisord.conf stop vllm-services:vllm-embedding
services/vllm-embedding/restart: supervisorctl -c /workspace/supervisord.conf restart vllm-services:vllm-embedding
services/vllm-embedding/status: supervisorctl -c /workspace/supervisord.conf status vllm-services:vllm-embedding
services/vllm-embedding/logs: supervisorctl -c /workspace/supervisord.conf tail -f vllm-services:vllm-embedding
#
# Health Checks
#
health/orchestrator: curl http://localhost:9000/health
health/comfyui: curl http://localhost:8188
health/vllm: curl http://localhost:8000/health
health/vllm-qwen: curl http://localhost:8000/health
health/vllm-llama: curl http://localhost:8001/health
health/vllm-embedding: curl http://localhost:8002/health
#
# System Checks