Sync from v0.13

Browse Source

...

This commit is contained in:

xiezhongtao

2026-01-19 10:38:50 +08:00

parent b2ef04d792

commit 5aef6c175a

3714 changed files with 854317 additions and 89342 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

BIN

docs/assets/contributing/dockerfile-stages-dependency.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 174 KiB

BIN

docs/assets/contributing/load-pattern-examples.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 577 KiB

BIN

docs/assets/deployment/anything-llm-chat-with-doc.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 118 KiB

BIN

docs/assets/deployment/anything-llm-chat-without-doc.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 136 KiB

BIN

docs/assets/deployment/anything-llm-provider.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 110 KiB

BIN

docs/assets/deployment/anything-llm-upload-doc.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 111 KiB

BIN

docs/assets/deployment/architecture_helm_deployment.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 968 KiB

BIN

docs/assets/deployment/chatbox-chat.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 107 KiB

BIN

docs/assets/deployment/chatbox-settings.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 95 KiB

BIN

docs/assets/deployment/dify-chat.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 143 KiB

BIN

docs/assets/deployment/dify-create-chatbot.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 265 KiB

BIN

docs/assets/deployment/dify-settings.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 52 KiB

BIN

docs/assets/deployment/dp_external_lb.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 84 KiB

BIN

docs/assets/deployment/dp_internal_lb.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 68 KiB

BIN

docs/assets/deployment/hf-inference-endpoints-catalog.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 627 KiB

BIN

docs/assets/deployment/hf-inference-endpoints-choose-infra.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 350 KiB

BIN

docs/assets/deployment/hf-inference-endpoints-click-deploy-button.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 814 KiB

BIN

docs/assets/deployment/hf-inference-endpoints-configure-container.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 267 KiB

BIN

docs/assets/deployment/hf-inference-endpoints-create-endpoint.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 354 KiB

BIN

docs/assets/deployment/hf-inference-endpoints-locate-deploy-button.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 781 KiB

BIN

docs/assets/deployment/hf-inference-endpoints-new-endpoint.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 51 KiB

BIN

docs/assets/deployment/hf-inference-endpoints-select-hardware.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 359 KiB

BIN

docs/assets/deployment/hf-inference-endpoints-select-model.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 82 KiB

BIN

docs/assets/deployment/open_webui.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 57 KiB

BIN

docs/assets/deployment/streamlit-chat.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 106 KiB

BIN

docs/assets/design/arch_overview/entrypoints.excalidraw.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 120 KiB

BIN

docs/assets/design/arch_overview/llm_engine.excalidraw.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 174 KiB

BIN

docs/assets/design/cuda_graphs/current_design.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 70 KiB

BIN

docs/assets/design/cuda_graphs/executor_runtime.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 60 KiB

BIN

docs/assets/design/cuda_graphs/previous_design.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 44 KiB

BIN

docs/assets/design/cuda_graphs/wrapper_flow.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 87 KiB

BIN

docs/assets/design/debug_vllm_compile/design_diagram.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 314 KiB

BIN

docs/assets/design/debug_vllm_compile/dynamic_shapes.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 359 KiB

BIN

docs/assets/design/debug_vllm_compile/tlparse_inductor.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 257 KiB

BIN

docs/assets/design/fused_moe_modular_kernel/fused_experts_blocks.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 187 KiB

BIN

docs/assets/design/fused_moe_modular_kernel/fused_moe_batched.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 189 KiB

BIN

docs/assets/design/fused_moe_modular_kernel/fused_moe_non_batched.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 227 KiB

BIN

docs/assets/design/fused_moe_modular_kernel/prepare_and_finalize_blocks.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 128 KiB

BIN

docs/assets/design/hierarchy.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 170 KiB

BIN

docs/assets/design/hybrid_kv_cache_manager/basic_grouping_example.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 24 KiB

BIN

docs/assets/design/hybrid_kv_cache_manager/full_attn.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 4.0 KiB

BIN

docs/assets/design/hybrid_kv_cache_manager/memory_layout.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 62 KiB

BIN

docs/assets/design/hybrid_kv_cache_manager/overview.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 39 KiB

BIN

docs/assets/design/hybrid_kv_cache_manager/sw_attn.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 4.5 KiB

BIN

docs/assets/design/metrics/intervals-1.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 185 KiB

BIN

docs/assets/design/metrics/intervals-2.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 162 KiB

BIN

docs/assets/design/metrics/intervals-3.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 161 KiB

BIN

docs/assets/design/paged_attention/k_vecs.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 27 KiB

BIN

docs/assets/design/paged_attention/key.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 109 KiB

BIN

docs/assets/design/paged_attention/logits_vec.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 17 KiB

BIN

docs/assets/design/paged_attention/q_vecs.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 41 KiB

BIN

docs/assets/design/paged_attention/query.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 32 KiB

BIN

docs/assets/design/paged_attention/v_vec.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 42 KiB

BIN

docs/assets/design/paged_attention/value.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 167 KiB

BIN

docs/assets/design/prefix_caching/example-time-1.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 47 KiB

BIN

docs/assets/design/prefix_caching/example-time-3.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 50 KiB

BIN

docs/assets/design/prefix_caching/example-time-4.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 59 KiB

BIN

docs/assets/design/prefix_caching/example-time-5.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 54 KiB

BIN

docs/assets/design/prefix_caching/example-time-6.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 54 KiB

BIN

docs/assets/design/prefix_caching/example-time-7.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 55 KiB

BIN

docs/assets/design/prefix_caching/free.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 18 KiB

BIN

docs/assets/design/prefix_caching/overview.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 32 KiB

BIN

docs/assets/design/tpu/most_model_len.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 12 KiB

BIN

docs/assets/features/disagg_encoder/disagg_encoder_flow.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 84 KiB

BIN

docs/assets/features/disagg_prefill/abstraction.jpg Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 102 KiB

BIN

docs/assets/features/disagg_prefill/high_level_design.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 91 KiB

BIN

docs/assets/features/disagg_prefill/overview.jpg Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 173 KiB

BIN

docs/assets/features/disagg_prefill/workflow.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 88 KiB

BIN

docs/assets/logos/vllm-logo-only-light.ico Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 17 KiB

BIN

docs/assets/logos/vllm-logo-only-light.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 53 KiB

BIN

docs/assets/logos/vllm-logo-text-dark.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 86 KiB

BIN

docs/assets/logos/vllm-logo-text-light.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 88 KiB