fzyzcjy 923f518337 CUDA-graph-compatible releasing and resuming KV cache and model weight memory (#2630)

2025-01-13 11:38:51 -08:00

..

deprecated

Migrate llama_classification to use the /classify interface (#2417)

2024-12-08 23:30:51 -08:00

playground

fix lint (#2733)

2025-01-05 14:45:42 +08:00

ci_install_dependency.sh

CUDA-graph-compatible releasing and resuming KV cache and model weight memory (#2630)

2025-01-13 11:38:51 -08:00

ci_install_rust.sh

CI: Update scripts to fail fast (#2672)

2024-12-30 19:04:01 -08:00

fix_corrupted_json.py

[Profile] Add pytorch profiler (#1604)

2024-10-07 14:37:16 -07:00

killall_sglang.sh

Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784)

2025-01-07 23:29:10 -08:00

version_branch_to_tag.sh

CI: Update scripts to fail fast (#2672)

2024-12-30 19:04:01 -08:00