starkwj 31868639fd fix multiproc executor determine kv cache memory

2026-04-24 08:31:54 +00:00

..

_310p

[310P]: add torch chunk gated delta rule and 910b parity ut (#7594)

2026-03-25 16:46:43 +08:00

_cann_ops_custom

[Kernel] add custom op GmmSwigluQuantWeightNzTensorList (#3804)

2025-11-28 18:06:39 +08:00

attention

[BugFix][v0.18.0][cherry-pick] Fix embedding prefix caching for APC (#7894)

2026-04-01 16:57:33 +08:00

compilation

[Feat][SP] Suport SP for VL MoE models (#7044)

2026-03-24 17:16:00 +08:00

core

[v0.18.0][Misc] Recompute scheduler upgrade to vLLM 0.18.0 (#7720)

2026-03-27 18:24:53 +08:00

device

[A5][bugfix] Fix fused MoE A5 MXFP8 scale normalization, load-balance routing and gating_topk ops (#7573)

2026-03-25 17:20:28 +08:00

device_allocator

adapt to vllm-ascend v0.18.0rc1

2026-04-21 03:05:32 +00:00

distributed

[v0.18.0][BugFix][P/D]Fix layerwise connector out of memory during large buffer transfer (#7752)

2026-03-31 22:16:53 +08:00

eplb

[EPLB] Reduce the memory used for batch_isend_irecv (#7344)

2026-03-20 12:25:58 +08:00

kv_offload

upgrade to 0.18.0 (#7502)

2026-03-21 16:05:38 +08:00

lora

[Bugfix][LoRA] Fix the bug when runs Qwen3-Reranker-0.6B with LoRA. (#7156)

2026-03-15 17:55:42 +08:00

model_loader

[ModelLoader][Feature] Add rfork support for fast model loading (#7392)

2026-03-25 16:40:30 +08:00

ops

[v0.18.0][BugFix] Fix bug of precision when DSA-CP is enabled on GLM5 (#7843)

2026-03-31 21:51:10 +08:00

patch

fix multiproc executor determine kv cache memory

2026-04-24 08:31:54 +00:00

quantization

[releases/v0.18.0][bugfix][eplb] remove unnecessary weight_scale wrap behaviour (#7732)

2026-03-30 16:16:03 +08:00

sample

[releases/v0.18.0][Triton][Sampler] Add penalty-related Triton kernel for better performance of penalties (#7794)

2026-03-31 19:01:51 +08:00

spec_decode

[v0.18.0][Bugfix][EAGLE] Fix FIA pad bug under max concurrency (#7754)

2026-03-29 12:23:44 +08:00

worker

fix multiproc executor determine kv cache memory

2026-04-24 08:31:54 +00:00

xlite

Main2main upgrade to vllm 0317 afternoon (#7409)

2026-03-18 23:24:27 +08:00

__init__.py

[ModelLoader][Feature] Add rfork support for fast model loading (#7392)

2026-03-25 16:40:30 +08:00

ascend_config.py

[feat] support dispatch_v2/combine_v2 hierarchy communication (#7698)

2026-03-27 09:20:16 +08:00

ascend_forward_context.py

[Bugfix][eager][oom] fix rank0 load imbalance by no padding when multi dp (#7297)

2026-03-23 17:05:02 +08:00

batch_invariant.py

[CI] Add pre-commit check for patch logger (#7446)

2026-03-19 16:53:20 +08:00

cpu_binding.py

[CPU binding] Implement global CPU slicing and improve IRQ binding for Ascend NPUs (#6945)

2026-03-03 17:20:52 +08:00

envs.py

adapt to vllm-ascend v0.18.0rc1

2026-04-21 03:05:32 +00:00

flash_common3_context.py

[Lint]Style: Convert vllm-ascend/compilation to ruff format (#5912)

2026-01-16 20:57:46 +08:00

meta_registration.py

[Ops][Refactor] Remove custom rotary_embedding operator (#6523)

2026-02-07 09:24:05 +08:00

platform.py

adapt to vllm-ascend v0.18.0rc1

2026-04-21 03:05:32 +00:00

profiling_config.py

[Core][Misc] Clean up ProfileExecuteDuration (#6461)

2026-02-01 20:06:01 +08:00

utils.py

[Performance]Optimize DeepSeekOCR2 RelPosAttention and CustomQwen2Decoder (#7737)

2026-03-31 14:49:29 +08:00