Files
project_6/qwen3_6_scripts
muh-bot bf5d19991c [FIX] qwen3_5.py: replace solve_triangular with manual forward substitution
BI-V100 base image does not have libcusolver.so at:
  /opt/sw_home/local/cuda/lib64/libcusolver.so

torch.linalg.solve_triangular requires cuSOLVER which is missing.
Replace with row-by-row forward substitution using only basic
matmul and indexing ops (torch.zeros_like, matmul, indexing).

The linear_attention gated_delta_rule solves (I-A)@X=RHS where A
is strictly lower-triangular. Forward sub: x[0]=rhs[0],
x[i]=rhs[i]+A[i,:i]@x[:i]. Mathematically equivalent.
2026-08-06 03:02:29 +00:00
..