13 lines
415 B
Plaintext
13 lines
415 B
Plaintext
|
-r requirements.txt
|
||
|
|
|
||
|
|
# Optional but recommended for the documented high-throughput training path.
|
||
|
|
# These packages are Linux/CUDA-oriented and may require matching compiler,
|
||
|
|
# CUDA, and PyTorch builds.
|
||
|
|
liger-kernel>=0.5
|
||
|
|
flash-attn>=2.7; platform_system == "Linux"
|
||
|
|
deepspeed>=0.16; platform_system == "Linux"
|
||
|
|
|
||
|
|
# Optional SFT/QLoRA paths in sft/train_sft.py.
|
||
|
|
peft>=0.14
|
||
|
|
bitsandbytes>=0.45; platform_system == "Linux"
|