xc-llm-ascend/docs/source/developer_guide/performance_and_debug/index.md

# Performance and Debug

::::{toctree}
:caption: Performance and Debug
:maxdepth: 1
performance_benchmark
optimization_and_tuning
service_profiling_guide
msprobe_guide
::::
[feature] vllm-ascend support msprobe (eager mode dump) (#4241) ### What this PR does / why we need it? vllm-ascend need to dump data during model execution to debug some precision problems, here msprobe provide the corresponding abilities, so msprobe will join vllm-ascend to make debug easier ### Does this PR introduce _any_ user-facing change? ``` 'dump_config': '/path/to/config.json' ``` - vLLM version: v0.11.0 - vLLM main: https://github.com/vllm-project/vllm/commit/2918c1b49c88c29783c86f78d2c4221cb9622379 --------- Signed-off-by: Tjh-UKN <2559659915@qq.com> 2025-11-24 21:58:31 +08:00			`# Performance and Debug`
[Doc] Add patch doc (#1414) 1. Format the developer guide content to make it more clear 2. Add the patch doc for developer guide Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com> 2025-06-25 12:00:45 +08:00
[Misc][Doc] Add service profiling feature with user guide (#3756) ### What this PR does / why we need it? To support the data collection capabilities of the msServiceProfiler on vLLM-ascned framework and enable customization of data collection points via configuration file, a default profiling configuration has been added to vllm-ascend, facilitating debugging and optimization for developers and users. ### Does this PR introduce _any_ user-facing change? None ### How was this patch tested? - vLLM version: v0.11.0 - vLLM main: https://github.com/vllm-project/vllm/commit/83f478bb19489b41e9d208b47b4bb5a95ac171ac Signed-off-by: minghangc <29514143@qq.com> 2025-11-12 09:07:14 +08:00			`::::{toctree}`
[feature] vllm-ascend support msprobe (eager mode dump) (#4241) ### What this PR does / why we need it? vllm-ascend need to dump data during model execution to debug some precision problems, here msprobe provide the corresponding abilities, so msprobe will join vllm-ascend to make debug easier ### Does this PR introduce _any_ user-facing change? ``` 'dump_config': '/path/to/config.json' ``` - vLLM version: v0.11.0 - vLLM main: https://github.com/vllm-project/vllm/commit/2918c1b49c88c29783c86f78d2c4221cb9622379 --------- Signed-off-by: Tjh-UKN <2559659915@qq.com> 2025-11-24 21:58:31 +08:00			`:caption: Performance and Debug`
[Doc] Add patch doc (#1414) 1. Format the developer guide content to make it more clear 2. Add the patch doc for developer guide Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com> 2025-06-25 12:00:45 +08:00			`:maxdepth: 1`
			`performance_benchmark`
[Doc] Add performance tuning doc to main (#1392) ### What this PR does / why we need it? Add performance tuning doc to main. Closes: https://github.com/vllm-project/vllm-ascend/issues/1387 - vLLM version: v0.9.1 - vLLM main: https://github.com/vllm-project/vllm/commit/923147b5e8551887fd64a0fc242c361d5216e1d7 --------- Signed-off-by: shen-shanshan <467638484@qq.com> Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com> 2025-07-29 19:36:34 +08:00			`optimization_and_tuning`
[Misc][Doc] Add service profiling feature with user guide (#3756) ### What this PR does / why we need it? To support the data collection capabilities of the msServiceProfiler on vLLM-ascned framework and enable customization of data collection points via configuration file, a default profiling configuration has been added to vllm-ascend, facilitating debugging and optimization for developers and users. ### Does this PR introduce _any_ user-facing change? None ### How was this patch tested? - vLLM version: v0.11.0 - vLLM main: https://github.com/vllm-project/vllm/commit/83f478bb19489b41e9d208b47b4bb5a95ac171ac Signed-off-by: minghangc <29514143@qq.com> 2025-11-12 09:07:14 +08:00			`service_profiling_guide`
[feature] vllm-ascend support msprobe (eager mode dump) (#4241) ### What this PR does / why we need it? vllm-ascend need to dump data during model execution to debug some precision problems, here msprobe provide the corresponding abilities, so msprobe will join vllm-ascend to make debug easier ### Does this PR introduce _any_ user-facing change? ``` 'dump_config': '/path/to/config.json' ``` - vLLM version: v0.11.0 - vLLM main: https://github.com/vllm-project/vllm/commit/2918c1b49c88c29783c86f78d2c4221cb9622379 --------- Signed-off-by: Tjh-UKN <2559659915@qq.com> 2025-11-24 21:58:31 +08:00			`msprobe_guide`
[Misc][Doc] Add service profiling feature with user guide (#3756) ### What this PR does / why we need it? To support the data collection capabilities of the msServiceProfiler on vLLM-ascned framework and enable customization of data collection points via configuration file, a default profiling configuration has been added to vllm-ascend, facilitating debugging and optimization for developers and users. ### Does this PR introduce _any_ user-facing change? None ### How was this patch tested? - vLLM version: v0.11.0 - vLLM main: https://github.com/vllm-project/vllm/commit/83f478bb19489b41e9d208b47b4bb5a95ac171ac Signed-off-by: minghangc <29514143@qq.com> 2025-11-12 09:07:14 +08:00			`::::`