EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Commit Graph

  • 48e10de8c9 [Bugfix] fix cpu offload hang with tp=1 (#5963) lidenghui1110 2026-01-17 11:50:13 +08:00
  • 1ffca8673f [Feature]: Support 310P device run qwen2.5/3 dense and qwen2.5vl models (#5776) Shaoxu Cheng 2026-01-17 11:49:18 +08:00
  • 7feb74590b Revert "[bugfix]limit graph replay sync (#5761)" (#5965) Angazenn 2026-01-16 23:29:35 +08:00
  • 52086394ae [Lint]Style: Convert vllm-ascend/compilation to ruff format (#5912) SILONG ZENG 2026-01-16 20:57:46 +08:00
  • 3af91e5ac4 [Bugfix] Fix the input constraints checks for the mlapo and bmm_transpose operators (#5764) rjg-lyh 2026-01-16 17:52:48 +08:00
  • 4f446aec4c [CI] Add DeepSeek-V3.2-W8A8-Pruning e2e test (#5922) zhangxinyuehfad 2026-01-16 15:49:57 +08:00
  • 69b170b8b5 [CI] skip 310 test for full test (#5943) wangxiyuan 2026-01-16 10:36:20 +08:00
  • 73a3f822c7 [Main2Main] Upgrade vllm commit to releases/v0.14.0 (#5911) wjunLu 2026-01-15 23:22:43 +08:00
  • 372f979aa5 [CI] Add DeepSeek R1 W8A8 HMB nightly ci (#5874) zhangxinyuehfad 2026-01-15 20:48:20 +08:00
  • 44d3b4d61a [Misc] Cleanup useless file and code (#5877) wangxiyuan 2026-01-15 20:32:47 +08:00
  • 3cb0af0bcf [Refactor]Refactor of vllm_ascend/distributed module (#5910) lty 2026-01-15 16:26:53 +08:00
  • 72fee47cba [CI](cp) skip bad UT test_models_chunked_prefill_with_empty_kvcache temporarily (#5919) Qiu 2026-01-15 15:50:06 +08:00
  • a25209252f [CI] Add 310p e2e test back (#5797) wangxiyuan 2026-01-15 15:47:13 +08:00
  • e8bbf72867 [Bugfix] Fix XliteModelRunner init failed when aclgraph is enabled (#5899) Magnus 2026-01-15 15:40:28 +08:00
  • 80fbb1b6b1 [CI]Fix nightly clang installation following previous attempt (#5907) meihanc 2026-01-15 14:18:11 +08:00
  • efa0f64f22 [Doc] Add tutorials for Qwen3-VL-30B-A3B-Instruct (#5331) Shanshan Shen 2026-01-15 10:56:19 +08:00
  • da958ee386 [EPLB]Eplb Config Renaming (#5533) LI SHENGYONG 2026-01-15 10:26:44 +08:00
  • ea01aeaab7 [Refactor][EAGLE] 4/N extract common methods from eagle and mtp (#5870) Zetong Li 2026-01-15 10:24:35 +08:00
  • c11a05c4e1 [Main2Main] Upgrade vllm commit to 0113 (#5839) wjunLu 2026-01-15 09:48:53 +08:00
  • e67608041d [main][BugFix]Fix DispatchGmmCombineDecode acc bug when big batch (#5808) wangqiankun13 2026-01-15 09:29:34 +08:00
  • d840f153f4 [Bugfix] Fix acc bug when enbale dispatch_gmm_combine_decode and eplb (#5806) wangqiankun13 2026-01-15 09:21:18 +08:00
  • 7078dff691 [Feature] implenment set_additional_forward_context for model runner v2 (#5720) Ronald 2026-01-15 09:18:28 +08:00
  • 4811ba62e0 [Lint]Style: reformat markdown files via markdownlint (#5884) SILONG ZENG 2026-01-15 09:06:01 +08:00
  • 96edd4673f [Community] Add code owner (#5882) wangxiyuan 2026-01-15 09:01:12 +08:00
  • 295018ec0f [Refactor]Refactor of vllm_ascend/distributed module (#5719) lty 2026-01-15 08:57:40 +08:00
  • f34b3b8ee9 [nightly] Remove node tolerations for hk cluster (#5896) Li Wang 2026-01-15 08:55:06 +08:00
  • a9f730b853 [bugfix]Intermittent CI failure in the triton runtime jit (#5733) meihanc 2026-01-14 22:58:08 +08:00
  • 51415aaa2f [bugfix]support dsv3.2 enable both mtp and full_decode_only (#5849) cookieyyds 2026-01-14 22:57:38 +08:00
  • a88937f5cb [bugfix](cp) replace None with zeros/inf tensor to avoid TypeError (#5837) Qiu 2026-01-14 20:57:48 +08:00
  • d450ba24c7 Revert "[BugFix] Support setting tp=1 for the Eagle draft model to take effect (#5903) zhaomingyu13 2026-01-14 20:56:20 +08:00
  • 01805fbd7d Revert "[BugFix] Support setting tp=1 for the Eagle draft model to take effect (#5519)"(#5902) zhaomingyu13 2026-01-14 20:55:10 +08:00
  • 2a6d95c389 [Cleanup] Remove dead code make_attention_mask function (#5818) LICO67373 2026-01-14 16:52:51 +08:00
  • d31170496b [doc]index display by category (#5852) herizhen 2026-01-14 16:50:49 +08:00
  • f6a37fc549 [CI] Reduce the resource consumption of unit tests (#5891) Li Wang 2026-01-14 16:33:19 +08:00
  • e5c46bf169 [CI] Fix lint CI (#5880) wangxiyuan 2026-01-14 11:23:38 +08:00
  • e20813f441 [Feature] implement eagle spec decoding for model runner v2 (#5840) Ronald 2026-01-14 09:18:05 +08:00
  • 0415e694cd [Quantization] Support compressed tensors moe w8a8 int8 dynamic weight (#5718) LHXuuu 2026-01-14 09:17:26 +08:00
  • ecf2fa482e [EPLB][Bugfix] Get expert map from layers (#5817) LI SHENGYONG 2026-01-14 09:16:51 +08:00
  • 48ec97821a [Bugfix] Fixed an accuracy problem of sp with eagle3 (#5816) drslark 2026-01-14 09:00:37 +08:00
  • e1bed43cff [P/D] bugfix for p node force free requset (#5431) liziyu 2026-01-14 08:51:31 +08:00
  • 78d5ce3e01 [Lint]Style: Convert example to ruff format (#5863) SILONG ZENG 2026-01-13 20:46:50 +08:00
  • f7b904641e [Main2Main] Upgrade vllm commit to 0109 (#5752) zhangxinyuehfad 2026-01-13 19:14:43 +08:00
  • eed9e366a7 [Bugfix][P/D] fix layerwise connector for decoder tp size > num kv heads (#5846) liziyu 2026-01-13 17:30:33 +08:00
  • 5b95c6b03a [Test][e2e][LoRA] Add more e2e tests to cover scenarios of LoRA (#4075) yupeng 2026-01-13 16:32:28 +08:00
  • d350c2ada6 [CustomOp][Perf] Merge Q/K split to simplify AscendApplyRotaryEmb for better performance (#5799) Shanshan Shen 2026-01-13 15:47:23 +08:00
  • 523e83016b [Lint]Style: Convert root, benchmarks, tools and docs to ruff format (#5843) SILONG ZENG 2026-01-13 15:29:34 +08:00
  • 4b679984de enable ep32 for dispatch_ffn_combine (#5787) lhchg 2026-01-13 14:35:52 +08:00
  • 84d4f474c0 [CI] Unblock 4-cards test (#5831) wangxiyuan 2026-01-13 11:15:29 +08:00
  • 1ccb9acd9a [Refactor] Provide a framework to accommodate operators for different hardware devices (#5735) weijinqian0 2026-01-13 09:53:26 +08:00
  • 8d571286dd [Refactor] Modify the binding logic to allocate CPU cores for each NPU card (#5555) Rozwel-dx 2026-01-13 09:21:28 +08:00
  • d886b81971 [BugFix] Support setting tp=1 for the Eagle draft model to take effect (#5519) zhaomingyu13 2026-01-13 09:14:30 +08:00
  • 7af3b880c1 support triton of mrope (#5664) shiyuan680 2026-01-13 09:13:51 +08:00
  • db7cf9b0ca [bugfix] A2 Environment Pooling for Memcache Compatibility (#5601) DreamerLeader 2026-01-13 09:07:38 +08:00
  • fe251a2efe [Doc] Update community contributors and versioning naming to follow vLLM (#5820) Yikun Jiang 2026-01-13 08:47:11 +08:00
  • c8a324ab73 [Refactor] Add comments for Metadata classes in attention module (#5789) LICO67373 2026-01-13 08:46:50 +08:00
  • dde547e900 [Bugfix] bugfix for the order of dummy run pad and sync (#5777) LiuYi-Up 2026-01-13 08:44:10 +08:00
  • 75c92a3640 [CI] Move nightly-a2 test to hk (#5807) Li Wang 2026-01-12 22:58:35 +08:00
  • 2a010a1f0e [CI] Show disk usage for CI shared volume (#5821) Li Wang 2026-01-12 22:56:23 +08:00
  • 86c4bea116 Bump actions/checkout from 4 to 6 (#5795) dependabot[bot] 2026-01-12 20:44:23 +08:00
  • 7ab63661f5 Bump actions/github-script from 7 to 8 (#5796) dependabot[bot] 2026-01-12 20:44:02 +08:00
  • 5f4b13ab3d [bugfix](cp) align max_context_chunk to cp_virtual_block_size (#5767) Qiu 2026-01-12 20:11:46 +08:00
  • 4453c60262 [bugfix]limit graph replay sync (#5761) wangyongjun 2026-01-12 16:46:21 +08:00
  • 7a6fde80b1 [CI]Add Kimi k2 nightly test (#5682) SILONG ZENG 2026-01-12 15:56:07 +08:00
  • 451bbdc292 [Doc] add tls check to pd disaggregation readme (#5638) liziyu 2026-01-12 15:49:18 +08:00
  • 5ccd53e28a [CI] adpat v0.13.0 change (#5793) wangxiyuan 2026-01-12 14:06:56 +08:00
  • 354ee3b330 [Doc] Update doc url link (#5781) wangxiyuan 2026-01-12 11:21:31 +08:00
  • 297f6deb09 [CI] Align multi-node nightly test paramter with corresponding tutorials document (#5756) Nengjun Ma 2026-01-12 09:00:31 +08:00
  • 6880c1b383 [Feature] Support for cross-attention and whisper model (#5592) gh924 2026-01-11 11:38:45 +08:00
  • db12c1e2c8 [Perf] Supports compute-communication overlap in the forward of sfa_v1 in the Sharded-CP feature. (#5701) zzhxxx 2026-01-11 09:47:27 +08:00
  • c5744e2350 [main][bugfix] Fix fullgraph padding bug in mtp eagle refactor (#5692) lilinsiman 2026-01-10 23:07:48 +08:00
  • 78b554dda9 [P/D] layerwise connector supports DeepSeek-V3.2 sparse attention && Distribute transfer tasks to redundant kv_head cards (#5722) zxr2333 2026-01-10 23:04:16 +08:00
  • c316679e65 adapt to minimax_m2 (#5624) Feng-xiaosuo 2026-01-10 23:01:35 +08:00
  • ecd4232698 [Feat] flashcomm2+oshard Generalized (#4723) Levi 2026-01-10 22:57:57 +08:00
  • aa987ffe87 [P/D][bugfix]Fix the PCP port mapping error issue (#5706) wangxiaoteng888 2026-01-10 22:43:52 +08:00
  • ff4c1a47b3 [bugfix] Fixing KV Pool Memory Retention and Performance Degradation Issues (#5751) fems14 2026-01-09 17:46:23 +08:00
  • 3ba064f804 [Doc] Add GLM4.5 GLM4.6 doc (#5740) 1092626063 2026-01-09 16:40:49 +08:00
  • 3b997fdd32 support mxfp8 quantization (qwen dense) (#5723) wangyao-i 2026-01-09 16:26:31 +08:00
  • 09b3f9d91b [CI]Add Disaggregated PD Nightly Test for Qwen3-235B and Qwen3-VL-235B (#5502) SILONG ZENG 2026-01-09 16:25:20 +08:00
  • f63c1341d9 [Feature] GLM4.6 support mtp with fullgraph (#5460) 1092626063 2026-01-09 16:07:42 +08:00
  • 09682e0751 [Bugfix] Fix matmul allreduce precision issue by using original weight (#4939) ice_rain 2026-01-09 16:05:32 +08:00
  • 64d29875f9 [Refactor] Replace the implementations of o_proj, q_b_proj, and kv_b_proj with custom_op for sharded CP (#5698) zzhxxx 2026-01-09 15:58:40 +08:00
  • e11ff8e535 [BufFix]Fix the error when using Ascend custom operators with rank=128 (#5394) ZT-AIA 2026-01-09 15:57:43 +08:00
  • d36ca88cf4 [CI] Avoid lint and ut for PR push (#5762) wangxiyuan 2026-01-09 15:57:06 +08:00
  • dc99cfdc15 [CustomOp] support TensorList for dispatchFFNCombine (#5665) lhchg 2026-01-09 15:56:29 +08:00
  • 3ce5a34468 [BugFix] Xlite: Bypass the padding of the graph mode in non-MTP cases to obtain the correct decode num. (#5711) Wang Xiaoran 2026-01-09 15:55:30 +08:00
  • 2d713fee93 [CI] Accuracy issue of qwen3-next-w8a8 nightly test fix. (#5746) InSec 2026-01-09 15:55:13 +08:00
  • be941cab71 [BugFix] NetLoader: No backend type associated with device type npu (#5700) Rui Kang 2026-01-09 15:54:54 +08:00
  • 64904ab5b6 [CI] lint and ut use self_hosted runner (#5652) Li Wang 2026-01-09 14:26:14 +08:00
  • 36d74aba58 [Doc][fix] Fix the title of the document for the layer_sharding feature (#5759) zzhxxx 2026-01-09 14:15:22 +08:00
  • ee2ed573f1 [BugFix][DS 3.2] Fix ds indexer accuracy problem caused by rope. (#4641) whx 2026-01-09 14:11:44 +08:00
  • 2a571d8bc8 support multi npu partially starkwj 2026-01-08 06:54:33 +00:00
  • 98c788a65a [Doc] add PaddleOCR-VL tutorials guide (#5556) zyz111222 2026-01-09 11:01:25 +08:00
  • a3a74d6984 [CI] Add qwen3 next ci (#5395) LeeWenquan 2026-01-09 10:29:09 +08:00
  • 40eb3e1836 [OP] Enable custom op aclnnMoeInitRoutingCustom (#5332) Chenxi Qian 2026-01-09 09:35:18 +08:00
  • 595d3484c4 [Nightly] Move ops to the correct path (#5642) Li Wang 2026-01-09 09:23:36 +08:00
  • 1ff1c96d13 [CI] Remove workflow_dispatch way for image build (#5742) wangxiyuan 2026-01-09 09:20:30 +08:00
  • 97f6be8108 [feature]dcp&pcp support mlapo (#5672) zhenwenqi2024 2026-01-08 23:49:23 +08:00
  • 6315a31399 [CI] Add triton ascend in nightly CI (#5716) meihanc 2026-01-08 21:17:32 +08:00
  • f4605c2b3c [Fix] Fixes speculative decode indexing and unpad condition for attention metadata (#5626) Yizhou 2026-01-08 19:41:08 +08:00
  • 503822c56c [Doc] Add Qwen3-Omni-30B-A3B-Thinking Tutorials (#3991) meihanc 2026-01-08 16:57:20 +08:00