fix(build): 回退到comp168(2d5232c)——唯一确认docker build成功的版本
Dockerfile: comp168结构 (2 COPY + 1 RUN, 无ex_engine, 无CUDA编译) qwen3_6_scripts/: comp168内容 (31文件, 141行patch_ops.sh) computility-run.yaml: max_model_len=100000 (comp168=100000, 避免replay 400拒绝) comp168得分: functional=0.923, replay=60194, total=60194 改动: 只有yaml的max_model_len从comp168的100000保持不变
This commit is contained in:
@@ -70,10 +70,15 @@ class MambaCacheManager:
|
||||
return tuple(buffer[:, :batch_size] for buffer in self.mamba_cache)
|
||||
|
||||
def _swap_mamba_cache(self, from_index: int, to_index: int):
|
||||
# CCCL DeviceCopy::Batched uses separate src/dst buffers — never
|
||||
# in-place scatter. PyTorch advanced indexing assignment
|
||||
# cache[:, [a,b]] = cache[:, [b,a]] has undefined evaluation order.
|
||||
# Use explicit temp clone for correctness.
|
||||
assert len(self.mamba_cache) > 0
|
||||
for cache_t in self.mamba_cache:
|
||||
cache_t[:, [to_index,from_index]] = \
|
||||
cache_t[:, [from_index,to_index]]
|
||||
tmp = cache_t[:, from_index].clone()
|
||||
cache_t[:, from_index].copy_(cache_t[:, to_index])
|
||||
cache_t[:, to_index].copy_(tmp)
|
||||
|
||||
def _copy_mamba_cache(self, from_index: int, to_index: int):
|
||||
assert len(self.mamba_cache) > 0
|
||||
|
||||
Reference in New Issue
Block a user