fix(crash): disable corex_gdn_chunk_recurrent — pybind signature mismatch
The .so's torch_chunk_gated_delta_rule() only accepts positional args: (Tensor, Tensor, Tensor, Tensor, Tensor, int, Optional[Tensor], bool, bool) But Python calls it with keyword args: (q, k, v, g, beta, initial_state=, output_final_state=, use_qk_l2norm_in_kernel=) This causes 'incompatible function arguments' crash during profiling (determine_num_available_blocks), killing the engine before it starts. Fix: _HAS_COREX_GDN_CHUNK = False, forcing Python _torch_chunk_gated_delta_rule. This is whata3c45d3beffectively did (its .so wasn't compiled), explaining whya3c45d3bworks butaa4b4992crashes.
This commit is contained in:
@@ -153,7 +153,11 @@ try:
|
||||
except ImportError:
|
||||
_corex_gdn_chunk_recurrent = None
|
||||
|
||||
_HAS_COREX_GDN_CHUNK = _corex_gdn_chunk_recurrent is not None
|
||||
# DISABLED: corex_gdn_chunk_recurrent.so pybind uses positional args only,
|
||||
# but the call site passes keyword args (initial_state=, output_final_state=).
|
||||
# This causes "incompatible function arguments" crash during profiling.
|
||||
# Force Python fallback until .so signature is fixed.
|
||||
_HAS_COREX_GDN_CHUNK = False
|
||||
|
||||
from vllm.model_executor.models.interfaces import (HasInnerState, SupportsLoRA,
|
||||
SupportsMultiModal)
|
||||
|
||||
Reference in New Issue
Block a user