14 lines
223 B
Plaintext
14 lines
223 B
Plaintext
|
# vLLM Text Generation Service Dependencies
|
||
|
|
|
||
|
|
# vLLM engine
|
||
|
|
vllm==0.6.4.post1
|
||
|
|
|
||
|
|
# PyTorch (required by vLLM)
|
||
|
|
torch==2.1.0
|
||
|
|
|
||
|
|
# Transformers (for model loading)
|
||
|
|
transformers==4.36.0
|
||
|
|
|
||
|
|
# Additional dependencies
|
||
|
|
accelerate==0.25.0
|