GLM-4.5

GLM-4.5#

  • vLLM Version: vLLM: 0.10.1.1 , vLLM-KunLun Version: v0.10.1.1

  • Software Environment:OS: Ubuntu 22.04, PyTorch ≥ 2.5.1

  • Hardware Environment: KunLun P800

  • Parallel mode:TP8

+---------+----------+---------------+---------+-----+--------+---------+
| Model   | Dataset  | Metric        | Subset  | Num | Score  | Cat.0   |
+---------+----------+---------------+---------+-----+--------+---------+
| GLM-4.5 | math_500 | AveragePass@1 | Level 1 |  43 | 0.9302 | default |
| GLM-4.5 | math_500 | AveragePass@1 | Level 2 |  90 | 0.8111 | default |
| GLM-4.5 | math_500 | AveragePass@1 | Level 3 | 105 | 0.7143 | default |
| GLM-4.5 | math_500 | AveragePass@1 | Level 4 | 128 | 0.6172 | default |
| GLM-4.5 | math_500 | AveragePass@1 | Level 5 | 134 | 0.5149 | default |
+---------+----------+---------------+---------+-----+--------+---------+