project_6

dylanyunlong/project_6

Fork 0

Commit Graph

Author	SHA1	Message	Date
Claude	b77743451c	debug: rms_norm weight.dim()!=1 — 打印前20次调用的w.shape, x.shape, class	2026-08-18 02:08:37 +00:00
root	b342eb6b98	[fix] baseline4 fix prebuilt ix_full_bridge.so 大概率是从 v2 编译的	2026-08-17 08:26:54 +00:00
dylan	e8f0948fe1	feat: ix_ops integration layer — wire ix_full_bridge.so into vllm hot path Architecture (CCCL dispatch pattern): base_image ixformer::infer → ix_full_bridge.so → ix_ops.py → vllm patches New files: ex_engine/python/ix_ops.py — Python API for all 14 ixformer::infer ops ex_engine/python/patch_vllm_ops.py — monkey-patch vllm GemmaRMSNorm, SiluAndMul ex_engine/deploy_ix_bridge.sh — build-time deployment script Modified: qwen3_6_scripts/patch_ops.sh — integrated ix_bridge deployment + startup hook Call chain: DecoderLayer.forward → GemmaRMSNorm → ix_ops.fused_add_rms_norm → ixformer::infer::residual_rms_norm (fused C++ kernel)	2026-08-15 06:15:17 +00:00

Author

SHA1

Message

Date

Claude

b77743451c

debug: rms_norm weight.dim()!=1 — 打印前20次调用的w.shape, x.shape, class

2026-08-18 02:08:37 +00:00

root

b342eb6b98

[fix] baseline4 fix prebuilt ix_full_bridge.so 大概率是从 v2 编译的

2026-08-17 08:26:54 +00:00

dylan

e8f0948fe1

feat: ix_ops integration layer — wire ix_full_bridge.so into vllm hot path

Architecture (CCCL dispatch pattern):
  base_image ixformer::infer → ix_full_bridge.so → ix_ops.py → vllm patches

New files:
  ex_engine/python/ix_ops.py          — Python API for all 14 ixformer::infer ops
  ex_engine/python/patch_vllm_ops.py  — monkey-patch vllm GemmaRMSNorm, SiluAndMul
  ex_engine/deploy_ix_bridge.sh       — build-time deployment script

Modified:
  qwen3_6_scripts/patch_ops.sh        — integrated ix_bridge deployment + startup hook

Call chain: DecoderLayer.forward → GemmaRMSNorm → ix_ops.fused_add_rms_norm
            → ixformer::infer::residual_rms_norm (fused C++ kernel)

2026-08-15 06:15:17 +00:00

3 Commits