Nicolas Castet 82e6c3a65a Add support for NCCL symmetric memory for TP allreduces (#8238)

2025-08-01 23:30:55 +00:00

..

__init__.py

[CI] Improve Docs CI Efficiency (#3587)

2025-02-14 19:57:00 -08:00

attention_backend.md

TRTLLM Gen MLA Decode Kernel Integration (same as #7938) (#8632)

2025-07-31 16:03:40 -07:00

custom_chat_template.md

[Docs] Fix links and grammar issues (#4162)

2025-03-06 23:14:18 -08:00

function_calling.ipynb

update toc for doc and dockerfile code style format (#6450)

2025-05-27 13:05:11 +08:00

hyperparameter_tuning.md

Update hyperparameter_tuning.md (#7454)

2025-06-22 22:42:55 -07:00

lora.ipynb

Support start up LoRA server without initial adapters (#8019)

2025-07-19 15:38:09 -07:00

native_api.ipynb

Update native_api doc to match the change in the get_model_info endpoint (#7660)

2025-07-08 21:05:58 -07:00

offline_engine_api.ipynb

smaller and non gated models for docs (#5378)

2025-04-20 17:38:25 -07:00

openai_api_completions.ipynb

[Feat] Add reasoning parser for Qwen/Qwen3-235B-A22B-Thinking-2507 (#8363)

2025-07-25 14:59:42 -07:00

openai_api_embeddings.ipynb

feat(oai refactor): Replace openai_api with entrypoints/openai (#7351)

2025-06-21 13:21:06 -07:00

openai_api_vision.ipynb

feat(oai refactor): Replace openai_api with entrypoints/openai (#7351)

2025-06-21 13:21:06 -07:00

patch.py

[CI] Remove unused imports with Ruff to pre-commit config, only to benchmarks/docs/examples folder (#3969)

2025-03-27 19:45:02 -07:00

pd_disaggregation.md

fix arg typo for --disaggregation-transfer-backend (#8664)

2025-08-01 10:00:47 -07:00

quantization.md

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

sampling_params.md

Clean up docs for server args and sampling parameters (generated by grok) (#7076)

2025-06-10 19:55:42 -07:00

send_request.ipynb

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

separate_reasoning.ipynb

[Feat] Add reasoning parser for Qwen/Qwen3-235B-A22B-Thinking-2507 (#8363)

2025-07-25 14:59:42 -07:00

server_arguments.md

Add support for NCCL symmetric memory for TP allreduces (#8238)

2025-08-01 23:30:55 +00:00

speculative_decoding.ipynb

Support XiaomiMiMo inference with mtp (#6059)

2025-05-22 14:14:49 -07:00

structured_outputs_for_reasoning_models.ipynb

Improve structured outputs: fix race condition, server crash, metrics and style (#6188)

2025-05-11 08:36:16 -07:00

structured_outputs.ipynb

Fix: docs/backend/structured_outputs.ipynb (#4884)

2025-04-12 02:18:55 -07:00

vlm_query.ipynb

Support precomputed_embeddings for Llama 4 (#8156)

2025-07-27 01:14:49 -07:00