4 Commits

Author SHA1 Message Date
project6-dev
7127d18491 refactor(bridge): rewrite ix_full_bridge.cpp for actual base image symbols
Symbol probe revealed ixformer::infer namespace does NOT exist in base image.
That namespace is xllm's own compiled wrapper layer.

Actual available symbols in base image:
  _ixformer_torch.so: silu_and_mul_forward, rms_norm_forward,
    fused_add_rms_norm_forward, ixformer_linear, ixformer_linear_ex
  libixformer.so: ixinfer_flash_attn_unpad_fwd (different signature)

MoE functions (topk_softmax, group_gemm, moe_expand_input, etc.)
are NOT in any base image .so — MoE must use Python path.

Bridge now only wraps: silu_and_mul, rms_norm, fused_add_rms_norm, linear
These accelerate the per-layer ops that run 200x per token.
2026-08-10 06:34:54 +00:00
project6-dev
a54dbda3bb fix(bridge): link against libixformer.so for silu_and_mul symbol
- ix_bridge.py: auto-discover ixformer .so files, pass as extra_ldflags
- ix_moe_bridge.cpp: fix mangled header from bad sed, add #include <optional>
- verify_single_gpu.py: also pass extra_ldflags during JIT compile

The undefined symbol _ZN8ixformer5infer12silu_and_mulERN2at6TensorES3_
lives in libixformer.so — need to explicitly link it.
2026-08-10 06:29:11 +00:00
project6-dev
ff0bf8c1d6 fix: total_mem → total_memory (torch API) 2026-08-10 06:21:40 +00:00
project6-dev
c579c75039 test: single-GPU verification script for ix_full_bridge compile + MoE 7-step dispatch chain 2026-08-10 06:21:04 +00:00