Yineng Zhang dfce926921 fix high qps crash when enable mtp (#3592) ...

Co-authored-by: ispobock <ispobaoke@hotmail.com>

2025-02-15 23:11:28 +08:00

..

cuda_graph_runner.py

MI30x: More graph captures for larger batch sizes and concurrencies (#3420)

2025-02-12 03:04:38 +08:00

forward_batch_info.py

fix high qps crash when enable mtp (#3592)

2025-02-15 23:11:28 +08:00

model_runner.py

feat: support flashinfer mla attention for deepseek v3 (#3550)

2025-02-14 08:50:14 +08:00