dylanyunlon 8c1955dc92 fix: revert invalid patches, add honest tuning surface assessment ...

REVERTED (invalid):
- paged_attn.py: restored use_v1=True hardcode. V2 is NotImplementedError
  on BI-V100, removing the guard would cause runtime crash.
- fused_moe.py: BLOCK_SIZE_N/K changes reverted. ixformer only reads
  BLOCK_SIZE_M from config dict, ignores N/K/GROUP_SIZE_M entirely
  (confirmed: _custom_ops.py:774 only passes config['BLOCK_SIZE_M']).
- _custom_ops.py: SMEM change reverted pending hardware confirmation.
- triton_flash_attention.py: autotune configs reverted (will re-add properly).
- prefix_prefill.py: comment enhancement reverted (was harmless but noisy).

ADDED:
- TUNING_SURFACE_TRUTH.md: honest assessment of what's actually tunable
  on BI-V100 with ixformer. Documents that bench_bi100.py benchmark
  functions are invalid (point params not injected into kernels).

Actual tuning surface is 5 parameters, not dozens:
  1. BLOCK_SIZE_M (fused_moe, passes to ixformer)
  2. use_v1 threshold (hardcoded True, V2 unimplemented)
  3. BLOCK/NUM_WARPS (prefix_prefill Triton JIT)
  4. SMEM declaration (affects Triton compiler)
  5. autotune config set (triton_flash_attention)

2026-08-03 10:34:28 +00:00

..

__pycache__

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

adapter_commons

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

assets

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

attention

fix: revert invalid patches, add honest tuning surface assessment

2026-08-03 10:34:28 +00:00

compilation

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

core

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

distributed

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

engine

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

entrypoints

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

executor

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

inputs

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

logging

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

lora

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

model_executor

fix: revert invalid patches, add honest tuning surface assessment

2026-08-03 10:34:28 +00:00

multimodal

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

platforms

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

plugins

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

prompt_adapter

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

spec_decode

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

transformers_utils

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

triton_utils

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

usage

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

worker

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

__init__.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

_core_ext.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

_custom_ops.py

fix: revert invalid patches, add honest tuning surface assessment

2026-08-03 10:34:28 +00:00

_ipex_ops.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

beam_search.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

block.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

config.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

connections.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

envs.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

forward_context.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

logger.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

outputs.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

pooling_params.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

py.typed

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

sampling_params.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

scalar_type.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

scripts.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

sequence.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

tracing.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

utils.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

version.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00