dylanyunlong/project_6
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

fix: enable corex topk_softmax kernel — verified correct on real BI-V100

Browse Source 
verify_topk_softmax.py results:
  IDs match: True (0/32 mismatches)
  Max weight diff: 0.00000003
  Speedup: 2.54x vs PyTorch (0.025ms vs 0.064ms)

Previous disable was based on speculation, not measurement.
This commit is contained in:
project6-dev
2026-08-13 03:45:45 +00:00
parent fc7a089334
commit 3045f29814
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
computility-run.yaml
View File

@@ -46,6 +46,6 @@ env:
- name: BI100_GDN_RESTORE_MODE - name: BI100_GDN_RESTORE_MODE
value: hybrid64 value: hybrid64
- name: BI100_MOE_COREX_TOPK_SOFTMAX - name: BI100_MOE_COREX_TOPK_SOFTMAX
value: '0' value: '1'
- name: PYTORCH_CUDA_ALLOC_CONF - name: PYTORCH_CUDA_ALLOC_CONF
value: expandable_segments:True value: expandable_segments:True