mgoin/nemotron-3-8b-chat-4k-sft-hf
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
09f158a740d74ca9c24bfae170bf01f00405a397
nemotron-3-8b-chat-4k-sft-hf/README.md
ModelHub XC 09f158a740 初始化项目，由ModelHub XC社区提供模型 
Model: mgoin/nemotron-3-8b-chat-4k-sft-hf
Source: Original Platform
2026-07-04 20:30:19 +08:00

602 B
Raw Blame History

tags
tags
vllm 
lm_eval --model vllm --model_args pretrained=/home/mgoin/code/nemotron-3-8b-chat-4k-sft-HF --tasks gsm8k --num_fewshot 5 --batch_size auto

vllm (pretrained=/home/mgoin/code/nemotron-3-8b-chat-4k-sft-HF), gen_kwargs: (None), limit: None, num_fewshot: 5, batch_size: auto
|Tasks|Version|     Filter     |n-shot|  Metric   |   |Value |   |Stderr|
|-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|gsm8k|      3|flexible-extract|     5|exact_match|↑  |0.1031|±  |0.0084|
|     |       |strict-match    |     5|exact_match|↑  |0.1016|±  |0.0083|