Lianmin Zheng f65c13b559 Remove normalized_prompt_logprobs from the engine to make code easier to maintain (#2902)

2025-01-15 04:54:14 -08:00

..

deprecated

Remove normalized_prompt_logprobs from the engine to make code easier to maintain (#2902)

2025-01-15 04:54:14 -08:00

playground

fix lint (#2733)

2025-01-05 14:45:42 +08:00

ci_install_dependency.sh

CUDA-graph-compatible releasing and resuming KV cache and model weight memory (#2630)

2025-01-13 11:38:51 -08:00

ci_install_rust.sh

CI: Update scripts to fail fast (#2672)

2024-12-30 19:04:01 -08:00

fix_corrupted_json.py

[Profile] Add pytorch profiler (#1604)

2024-10-07 14:37:16 -07:00

killall_sglang.sh

Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784)

2025-01-07 23:29:10 -08:00

version_branch_to_tag.sh

CI: Update scripts to fail fast (#2672)

2024-12-30 19:04:01 -08:00