the magician 2c6cabcc63 optimize moe tiny batch tokenwise path

2026-07-14 21:49:55 +08:00

..

qwen3_5

Qwen3.6-27B iluvatar bi-v100 adaptation

2026-05-21 16:37:24 +08:00

qwen3_5_moe

initial commit for qwen3.6-moe adaptation

2026-06-12 10:10:49 +08:00

reasoning

Add reasoning parser mechanism + qwen3 parser + bugfixes

2026-06-10 18:22:29 +08:00

api_server.py

Add reasoning parser mechanism + qwen3 parser + bugfixes

2026-06-10 18:22:29 +08:00

chat_utils.py

fix serving issues when requesting real data

2026-06-12 17:57:23 +08:00

cli_args.py

Add reasoning parser mechanism + qwen3 parser + bugfixes

2026-06-10 18:22:29 +08:00

mamba_cache.py

Qwen3.6-27B iluvatar bi-v100 adaptation

2026-05-21 16:37:24 +08:00

paged_attn.py

fix issues

2026-06-26 12:55:02 +08:00

patch_model_runner.py

fix issues

2026-06-26 12:55:02 +08:00

patch_ops.sh

baseline working model service and perf tooling

2026-07-14 13:57:40 +08:00

patch_transformers_qwen3_5.py

initial commit for qwen3.6-moe adaptation

2026-06-12 10:10:49 +08:00

patch_vllm_qwen3_5.py

initial commit for qwen3.6-moe adaptation

2026-06-12 10:10:49 +08:00

patch_vllm_tool_parser.py

Add qwen3_coder tool calling parser

2026-06-10 14:38:54 +08:00

patch_xformers_sdpa_batch_kernel.py

Qwen3.6-27B iluvatar bi-v100 adaptation

2026-05-21 16:37:24 +08:00

patch_xformers_sdpa_batch.py

Qwen3.6-27B iluvatar bi-v100 adaptation

2026-05-21 16:37:24 +08:00

patch_xformers_sdpa_seq_kernel.py

Qwen3.6-27B iluvatar bi-v100 adaptation

2026-05-21 16:37:24 +08:00

patch_xformers_sdpa_seq.py

test eager and custom allreduce toggles

2026-07-14 19:18:46 +08:00

protocol.py

fix multiple issues

2026-06-26 17:23:55 +08:00

qwen3_5.py

optimize moe tiny batch tokenwise path

2026-07-14 21:49:55 +08:00

qwen3coder_tool_parser.py

Add qwen3_coder tool calling parser

2026-06-10 14:38:54 +08:00

scheduler.py

fix issues

2026-06-26 12:55:02 +08:00

sequence.py

fix issues

2026-06-26 12:55:02 +08:00

serving_chat.py

fix multiple issues

2026-06-26 17:23:55 +08:00