58 lines
2.7 KiB
Markdown
58 lines
2.7 KiB
Markdown
---
|
||
license: other
|
||
license_name: modelcloud
|
||
license_link: LICENSE
|
||
language:
|
||
- en
|
||
base_model:
|
||
- marin-community/marin-32b-base
|
||
pipeline_tag: text-generation
|
||
tags:
|
||
- gptqmodel
|
||
- modelcloud
|
||
- chat
|
||
- marin
|
||
- instruct
|
||
- int4
|
||
- awq
|
||
- 4bit
|
||
- w4a16
|
||
---
|
||
|
||
This 4bit W4A16 model has been quantized by <a href='https://x.com/qubitium'>@Qubitum</a> at ModelCloud using
|
||
[GPT-QModel](https://github.com/ModelCloud/GPTQModel).
|
||
|
||
```
|
||
SPDX-License-Identifier: NonCommercial-ModelCloud
|
||
Copyright (c) 2024–2025 ModelCloud.ai
|
||
Released for non-profit use only.
|
||
Commercial use requires permission from [@qubitium](https://x.com/qubitium).
|
||
```
|
||
|
||
```py
|
||
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
||
|-------------------------------|------:|------|-----:|--------|---|-----:|---|-----:|
|
||
|arc_challenge | 1|none | 0|acc |↑ |0.5828|± |0.0144|
|
||
| | |none | 0|acc_norm|↑ |0.6007|± |0.0143|
|
||
|mmlu (stem) | 2|none | |acc |↑ |0.6673|± |0.0080|
|
||
| - abstract_algebra | 1|none | 0|acc |↑ |0.4200|± |0.0496|
|
||
| - anatomy | 1|none | 0|acc |↑ |0.7185|± |0.0389|
|
||
| - astronomy | 1|none | 0|acc |↑ |0.8553|± |0.0286|
|
||
| - college_biology | 1|none | 0|acc |↑ |0.8681|± |0.0283|
|
||
| - college_chemistry | 1|none | 0|acc |↑ |0.5300|± |0.0502|
|
||
| - college_computer_science | 1|none | 0|acc |↑ |0.6300|± |0.0485|
|
||
| - college_mathematics | 1|none | 0|acc |↑ |0.4800|± |0.0502|
|
||
| - college_physics | 1|none | 0|acc |↑ |0.5686|± |0.0493|
|
||
| - computer_security | 1|none | 0|acc |↑ |0.7800|± |0.0416|
|
||
| - conceptual_physics | 1|none | 0|acc |↑ |0.7660|± |0.0277|
|
||
| - electrical_engineering | 1|none | 0|acc |↑ |0.7379|± |0.0366|
|
||
| - elementary_mathematics | 1|none | 0|acc |↑ |0.6296|± |0.0249|
|
||
| - high_school_biology | 1|none | 0|acc |↑ |0.8710|± |0.0191|
|
||
| - high_school_chemistry | 1|none | 0|acc |↑ |0.6453|± |0.0337|
|
||
| - high_school_computer_science| 1|none | 0|acc |↑ |0.7800|± |0.0416|
|
||
| - high_school_mathematics | 1|none | 0|acc |↑ |0.4481|± |0.0303|
|
||
| - high_school_physics | 1|none | 0|acc |↑ |0.5166|± |0.0408|
|
||
| - high_school_statistics | 1|none | 0|acc |↑ |0.6620|± |0.0323|
|
||
| - machine_learning | 1|none | 0|acc |↑ |0.5714|± |0.0470|
|
||
```
|