Scott Lee b6fb5d7666 Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441)

2025-10-13 11:24:27 -07:00

..

cpp_ngram

fix cpp JIT compilation issue of ngram speculative decoding (#10837)

2025-10-02 21:05:01 +08:00

build_eagle_tree.py

Add treemask mode to build_eagle_tree & release sgl-kernel 0.2.3 (#7756)

2025-07-05 12:17:05 -07:00

eagle_draft_cuda_graph_runner.py

Fix CUDA illegal memory access issues in speculative decoding (#10892)

2025-10-03 22:44:07 +08:00

eagle_draft_extend_cuda_graph_runner.py

Fix CUDA illegal memory access issues in speculative decoding (#10892)

2025-10-03 22:44:07 +08:00

eagle_info_v2.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

eagle_info.py

Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441)

2025-10-13 11:24:27 -07:00

eagle_worker_v2.py

Beta spec-overlap for EAGLE (#11398)

2025-10-12 11:02:22 +08:00

eagle_worker.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

ngram_info.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

ngram_worker.py

Rename ngram_utils -> ngram_info (#11316)

2025-10-08 11:49:46 +08:00

spec_info.py

Organize spec-related data structures (#10735)

2025-10-01 09:45:30 +08:00

spec_utils.py

Beta spec-overlap for EAGLE (#11398)

2025-10-12 11:02:22 +08:00

standalone_worker.py

Standalone speculative decoding (#10090)

2025-09-07 20:55:09 -07:00