mgoin/nemotron-3-8b-chat-4k-sft-hf
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mgoin/nemotron-3-8b-chat-4k-sft-hf
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-04 20:30:19 +08:00
commit 09f158a740
8 changed files with 149 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
README.md Normal file
View File

@@ -0,0 +1,14 @@
---
tags:
- vllm
---
```
lm_eval --model vllm --model_args pretrained=/home/mgoin/code/nemotron-3-8b-chat-4k-sft-HF --tasks gsm8k --num_fewshot 5 --batch_size auto
vllm (pretrained=/home/mgoin/code/nemotron-3-8b-chat-4k-sft-HF), gen_kwargs: (None), limit: None, num_fewshot: 5, batch_size: auto
|Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
|-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.1031|± |0.0084|
| | |strict-match | 5|exact_match|↑ |0.1016|± |0.0083|
```