58 lines
2.7 KiB
Markdown
58 lines
2.7 KiB
Markdown
|
---
|
|||
|
|
license: other
|
|||
|
|
license_name: modelcloud
|
|||
|
|
license_link: LICENSE
|
|||
|
|
language:
|
|||
|
|
- en
|
|||
|
|
base_model:
|
|||
|
|
- marin-community/marin-32b-base
|
|||
|
|
pipeline_tag: text-generation
|
|||
|
|
tags:
|
|||
|
|
- gptqmodel
|
|||
|
|
- modelcloud
|
|||
|
|
- chat
|
|||
|
|
- marin
|
|||
|
|
- instruct
|
|||
|
|
- int4
|
|||
|
|
- awq
|
|||
|
|
- 4bit
|
|||
|
|
- w4a16
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
This 4bit W4A16 model has been quantized by <a href='https://x.com/qubitium'>@Qubitum</a> at ModelCloud using
|
|||
|
|
[GPT-QModel](https://github.com/ModelCloud/GPTQModel).
|
|||
|
|
|
|||
|
|
```
|
|||
|
|
SPDX-License-Identifier: NonCommercial-ModelCloud
|
|||
|
|
Copyright (c) 2024–2025 ModelCloud.ai
|
|||
|
|
Released for non-profit use only.
|
|||
|
|
Commercial use requires permission from [@qubitium](https://x.com/qubitium).
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
```py
|
|||
|
|
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
|||
|
|
|-------------------------------|------:|------|-----:|--------|---|-----:|---|-----:|
|
|||
|
|
|arc_challenge | 1|none | 0|acc |↑ |0.5828|± |0.0144|
|
|||
|
|
| | |none | 0|acc_norm|↑ |0.6007|± |0.0143|
|
|||
|
|
|mmlu (stem) | 2|none | |acc |↑ |0.6673|± |0.0080|
|
|||
|
|
| - abstract_algebra | 1|none | 0|acc |↑ |0.4200|± |0.0496|
|
|||
|
|
| - anatomy | 1|none | 0|acc |↑ |0.7185|± |0.0389|
|
|||
|
|
| - astronomy | 1|none | 0|acc |↑ |0.8553|± |0.0286|
|
|||
|
|
| - college_biology | 1|none | 0|acc |↑ |0.8681|± |0.0283|
|
|||
|
|
| - college_chemistry | 1|none | 0|acc |↑ |0.5300|± |0.0502|
|
|||
|
|
| - college_computer_science | 1|none | 0|acc |↑ |0.6300|± |0.0485|
|
|||
|
|
| - college_mathematics | 1|none | 0|acc |↑ |0.4800|± |0.0502|
|
|||
|
|
| - college_physics | 1|none | 0|acc |↑ |0.5686|± |0.0493|
|
|||
|
|
| - computer_security | 1|none | 0|acc |↑ |0.7800|± |0.0416|
|
|||
|
|
| - conceptual_physics | 1|none | 0|acc |↑ |0.7660|± |0.0277|
|
|||
|
|
| - electrical_engineering | 1|none | 0|acc |↑ |0.7379|± |0.0366|
|
|||
|
|
| - elementary_mathematics | 1|none | 0|acc |↑ |0.6296|± |0.0249|
|
|||
|
|
| - high_school_biology | 1|none | 0|acc |↑ |0.8710|± |0.0191|
|
|||
|
|
| - high_school_chemistry | 1|none | 0|acc |↑ |0.6453|± |0.0337|
|
|||
|
|
| - high_school_computer_science| 1|none | 0|acc |↑ |0.7800|± |0.0416|
|
|||
|
|
| - high_school_mathematics | 1|none | 0|acc |↑ |0.4481|± |0.0303|
|
|||
|
|
| - high_school_physics | 1|none | 0|acc |↑ |0.5166|± |0.0408|
|
|||
|
|
| - high_school_statistics | 1|none | 0|acc |↑ |0.6620|± |0.0323|
|
|||
|
|
| - machine_learning | 1|none | 0|acc |↑ |0.5714|± |0.0470|
|
|||
|
|
```
|