xc-llm-kunlun/docs/source/developer_guide/evaluation/accuracy_report/GLM-4.5.md

GLM-4.5

• vLLM Version: vLLM: 0.10.1.1 , vLLM-KunLun Version: v0.10.1.1
• Software Environment:OS: Ubuntu 22.04, PyTorch ≥ 2.5.1
• Hardware Environment: KunLun P800
• Parallel mode:TP8

+---------+----------+---------------+---------+-----+--------+---------+
| Model   | Dataset  | Metric        | Subset  | Num | Score  | Cat.0   |
+---------+----------+---------------+---------+-----+--------+---------+
| GLM-4.5 | math_500 | AveragePass@1 | Level 1 |  43 | 0.9302 | default |
| GLM-4.5 | math_500 | AveragePass@1 | Level 2 |  90 | 0.8111 | default |
| GLM-4.5 | math_500 | AveragePass@1 | Level 3 | 105 | 0.7143 | default |
| GLM-4.5 | math_500 | AveragePass@1 | Level 4 | 128 | 0.6172 | default |
| GLM-4.5 | math_500 | AveragePass@1 | Level 5 | 134 | 0.5149 | default |
+---------+----------+---------------+---------+-----+--------+---------+