Baizhou Zhang fc91d08a8f [Revision] Add fast decode plan for flashinfer mla (#4012)

2025-03-05 11:20:41 -08:00

..

__init__.py

[CI] Improve Docs CI Efficiency (#3587)

2025-02-14 19:57:00 -08:00

custom_chat_template.md

Docs: Fix layout with sub-section (#3710)

2025-02-19 15:44:30 -08:00

function_calling.ipynb

Misc clean up; Remove the support of jump forward (#4032)

2025-03-03 07:02:14 -08:00

hyperparameter_tuning.md

Docs: Fix layout with sub-section (#3710)

2025-02-19 15:44:30 -08:00

native_api.ipynb

Add examples in sampling parameters (#4039)

2025-03-03 13:04:32 -08:00

offline_engine_api.ipynb

Add examples for returning hidden states when using the server (#4074)

2025-03-04 19:31:50 -08:00

openai_api_completions.ipynb

Docs: Fix layout to docs (#3733)

2025-02-21 11:24:13 -08:00

openai_api_embeddings.ipynb

[Docs]: Fix Multi-User Port Allocation Conflicts (#3601)

2025-02-19 11:15:44 -08:00

openai_api_vision.ipynb

Docs: improve link to docs (#3860)

2025-02-26 10:29:25 -08:00

patch.py

[Docs]: Fix Multi-User Port Allocation Conflicts (#3601)

2025-02-19 11:15:44 -08:00

quantization.md

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

sampling_params.md

Add examples for returning hidden states when using the server (#4074)

2025-03-04 19:31:50 -08:00

send_request.ipynb

Docs: Fix layout with sub-section (#3710)

2025-02-19 15:44:30 -08:00

separate_reasoning.ipynb

Reasoning parser (#4000)

2025-03-03 21:16:36 -08:00

server_arguments.md

[Revision] Add fast decode plan for flashinfer mla (#4012)

2025-03-05 11:20:41 -08:00

speculative_decoding.ipynb

Misc clean up; Remove the support of jump forward (#4032)

2025-03-03 07:02:14 -08:00

structured_outputs.ipynb

[Feature] Support llguidance for constrained decoding (#3298)

2025-02-26 10:41:49 -08:00