Lianmin Zheng ac2387279e Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988) ...

Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

2025-03-03 00:12:04 -08:00

..

__init__.py

[CI] Improve Docs CI Efficiency (#3587)

2025-02-14 19:57:00 -08:00

custom_chat_template.md

Docs: Fix layout with sub-section (#3710)

2025-02-19 15:44:30 -08:00

function_calling.ipynb

Revert "Rename TokenizerManager to StdOrchestrator" (#3828)

2025-02-24 14:47:59 -08:00

hyperparameter_tuning.md

Docs: Fix layout with sub-section (#3710)

2025-02-19 15:44:30 -08:00

native_api.ipynb

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

offline_engine_api.ipynb

Docs: add special warning to engine docs (#3979)

2025-02-28 21:59:20 -08:00

openai_api_completions.ipynb

Docs: Fix layout to docs (#3733)

2025-02-21 11:24:13 -08:00

openai_api_embeddings.ipynb

[Docs]: Fix Multi-User Port Allocation Conflicts (#3601)

2025-02-19 11:15:44 -08:00

openai_api_vision.ipynb

Docs: improve link to docs (#3860)

2025-02-26 10:29:25 -08:00

patch.py

[Docs]: Fix Multi-User Port Allocation Conflicts (#3601)

2025-02-19 11:15:44 -08:00

quantization.md

Docs: Fix layout to docs (#3733)

2025-02-21 11:24:13 -08:00

sampling_params.md

Refactor: Move return_hidden_states to the generate input (#3985)

2025-03-01 17:51:29 -08:00

send_request.ipynb

Docs: Fix layout with sub-section (#3710)

2025-02-19 15:44:30 -08:00

server_arguments.md

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

speculative_decoding.ipynb

[feat] add small vocab table for eagle's draft model[1]. (#3822)

2025-03-02 18:58:45 -08:00

structured_outputs.ipynb

[Feature] Support llguidance for constrained decoding (#3298)

2025-02-26 10:41:49 -08:00