LI SHENGYONG
611e223b7d
[EPLB][Bugfix] EPLB support fp/bf16 (#5531)
### What this PR does / why we need it?
EPLB support dtype of fp/bf16.
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
w8a8_dynamic Baseline:
| dataset | version | metric | mode | vllm-api-general-chat |
|----- | ----- | ----- | ----- | -----|
| aime2024 | 604a78 | accuracy | gen | 86.67 |
w8a8_dynamic eplb:
| dataset | version | metric | mode | vllm-api-general-chat |
|----- | ----- | ----- | ----- | -----|
| aime2024 | 604a78 | accuracy | gen | 86.67 |
The fp16 conversation is normal.
The fp16 test is in progress.
Baseline fp16
| dataset | version | metric | mode | vllm-api-general-chat |
|----- | ----- | ----- | ----- | -----|
| aime2024 | 604a78 | accuracy | gen | 86.67 |
eplb fp16
| dataset | version | metric | mode | vllm-api-general-chat |
|----- | ----- | ----- | ----- | -----|
| aime2024 | 604a78 | accuracy | gen | 83.33 |
- vLLM version: v0.13.0
- vLLM main:
45c1ca1ca1
Signed-off-by: shenchuxiaofugui <1311027364@qq.com>
2026-01-26 14:28:16 +08:00
..
2026-01-23 14:19:49 +08:00
2026-01-26 09:04:54 +08:00
2026-01-06 16:41:39 +08:00
2026-01-13 09:21:28 +08:00
2026-01-15 08:57:40 +08:00
2026-01-26 14:28:16 +08:00
2025-06-16 18:32:28 +08:00
2026-01-15 08:57:40 +08:00
2025-12-30 15:05:47 +08:00
2026-01-24 20:34:29 +08:00
2025-10-21 20:19:46 +08:00
2026-01-23 14:13:47 +08:00
2026-01-07 18:41:45 +08:00
2026-01-26 09:04:54 +08:00
2026-01-23 09:45:08 +08:00
2025-07-21 19:43:30 +08:00
2025-07-28 15:13:37 +08:00
2026-01-06 08:44:29 +08:00
2026-01-20 21:31:38 +08:00
2025-08-14 09:33:39 +08:00
2026-01-23 14:13:47 +08:00
2025-12-19 14:27:24 +08:00