tarinkk eb6c2c1663 Hybrid kv cache for LLaMA4 (#6563) ...

Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: tarinkk <rt572@physics.rutger.edu>
Co-authored-by: tarinkk <rt572@rutgers.physics.edu>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>

2025-06-27 18:58:55 -07:00

..

accuracy_evaluation.md

Add examples in sampling parameters (#4039)

2025-03-03 13:04:32 -08:00

advanced_deploy.rst

Docs: add torch compile cache (#4151)

2025-03-06 14:27:09 -08:00

amd.md

[Docs] Improve bullets appearance and grammar (#4174)

2025-03-07 03:16:25 -08:00

benchmark_and_profiling.md

Fix torch profiler bugs for bench_offline_throughput.py (#6557)

2025-06-09 20:33:41 +08:00

contribution_guide.md

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

deepseek.md

Fix some issues with current docs. (#6588)

2025-05-26 01:04:34 +08:00

deepseek.rst

revert deepseek docs (#4109)

2025-03-05 13:23:11 -08:00

deploy_on_k8s.md

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

developer.rst

update toc for doc and dockerfile code style format (#6450)

2025-05-27 13:05:11 +08:00

development_guide_using_docker.md

update toc for doc and dockerfile code style format (#6450)

2025-05-27 13:05:11 +08:00

environment_variables.md

Fix torch profiler bugs for bench_offline_throughput.py (#6557)

2025-06-09 20:33:41 +08:00

faq.md

Fix links in the docs (#1878)

2024-11-01 18:25:55 -07:00

general.rst

[Docs] Add docs for SGLANG_ and SGL_ environment variables (#6206)

2025-05-13 01:45:41 +08:00

hardware.rst

Docs: Fix layout with sub-section (#3710)

2025-02-19 15:44:30 -08:00

learn_more.md

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

llama4.md

Hybrid kv cache for LLaMA4 (#6563)

2025-06-27 18:58:55 -07:00

modelscope.md

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

multi_node.md

Tiny fix doc error (#4795)

2025-03-29 08:22:17 -07:00

nvidia_jetson.md

Add examples in sampling parameters (#4039)

2025-03-03 13:04:32 -08:00

performance_analysis_and_optimization.rst

Auto handle PD disaggregation in bench_serving (#6587)

2025-05-25 22:41:27 -07:00

production_metrics.md

[Docs] update grafana setup guide in production metrics (#5643)

2025-04-27 15:36:33 -07:00

release_process.md

update toc for doc and dockerfile code style format (#6450)

2025-05-27 13:05:11 +08:00

setup_github_runner.md

chore: bump v0.4.8.post1 (#7559)

2025-06-26 02:21:12 -07:00

torch_compile_cache.md

Improve perf tuning docs (#7071)

2025-06-10 16:55:04 -07:00

troubleshooting.md

Improve perf tuning docs (#7071)

2025-06-10 16:55:04 -07:00