2aedf7377b
Cloned from GitHub:
- Deep-Spark/vllm (latest): qwen3_5.py with multimodal support,
transformers configs, multimodal registry, model registry
- jd-opensource/xllm (latest): ILU kernel implementations
(attention, fused_moe, group_gemm, activation, norm, rope, matmul)
+ GatedDeltaNet layer for Qwen3.5
These are the REAL upstream implementations that the base Docker image
is compiled from. Our dlopen modules should match these interfaces:
- ilu_ops_api.h: 14 functions in xllm::kernel::ilu namespace
- ixformer.h: 15 functions in ixformer::infer namespace
Key interface signatures for dlopen targets:
batch_prefill() → ixinfer_flash_attn_unpad_with_block_tables
batch_decode() → xllm_paged_attention
moe_active_topk()→ topk_softmax
moe_gen_idx() → moe_compute_token_index_api
group_gemm() → moe_w16a16_group_gemm
silu_and_mul() → silu_and_mul
rms_norm() → rms_norm + residual_rms_norm