Jade Zheng 2c685e3b61 [Bugfix] Correct method call for _set_cos_sin_cache (#774) ...

This change ensures proper functionality for longer sequences by
correctly invoking the _set_cos_sin_cache method with self as the first
argument.

For example, with DeepSeek R1, if this change isn't made, the program
will crash when the input sequence exceeds 4096.

Signed-off-by: Jade Zheng <zheng.shoujian@outlook.com>

2025-05-09 12:55:57 +08:00

..

__init__.py

[MISC] Clean up torch_npu (#688)

2025-04-29 18:03:38 +08:00

activation.py

Optimize qwen2_vl and qwen2_5_vl (#701)

2025-04-30 14:22:38 +08:00

attention.py

[Bugfix] Fix output tensor shape in vanilla_chunked_prefill and update import paths for model_loader (#773)

2025-05-08 14:19:26 +08:00

cache.py

port deepseekv2 and mtp to main branch (#429)

2025-04-19 17:38:18 +08:00

common_fused_moe.py

[Model] Support common fused moe ops for moe model, such as Qwen3Moe (#709)

2025-04-28 21:57:01 +08:00

fused_moe.py

[MISC] fix format check error (#654)

2025-04-29 11:14:19 +08:00

layernorm.py

[CI]Add model basic accuracy test(Qwen2.5-0.5B-Instruct) (#460)

2025-04-17 14:59:56 +08:00

rotary_embedding.py

[Bugfix] Correct method call for _set_cos_sin_cache (#774)

2025-05-09 12:55:57 +08:00

vocab_parallel_embedding.py

port deepseekv2 and mtp to main branch (#429)

2025-04-19 17:38:18 +08:00