---
license: other
license_name: modelcloud
license_link: LICENSE
language:
- en
base_model:
- marin-community/marin-32b-base
pipeline_tag: text-generation
tags:
- gptqmodel
- modelcloud
- chat
- marin
- instruct
- int4
- awq
- 4bit
- w4a16
---

This 4bit W4A16 model has been quantized by <a href='https://x.com/qubitium'>@Qubitum</a> at ModelCloud using
[GPT-QModel](https://github.com/ModelCloud/GPTQModel).

```
SPDX-License-Identifier: NonCommercial-ModelCloud
Copyright (c) 2024–2025 ModelCloud.ai
Released for non-profit use only.
Commercial use requires permission from [@qubitium](https://x.com/qubitium).
```

```py
|             Tasks             |Version|Filter|n-shot| Metric |   |Value |   |Stderr|
|-------------------------------|------:|------|-----:|--------|---|-----:|---|-----:|
|arc_challenge                  |      1|none  |     0|acc     |↑  |0.5828|±  |0.0144|
|                               |       |none  |     0|acc_norm|↑  |0.6007|±  |0.0143|
|mmlu (stem)                    |      2|none  |      |acc     |↑  |0.6673|±  |0.0080|
| - abstract_algebra            |      1|none  |     0|acc     |↑  |0.4200|±  |0.0496|
| - anatomy                     |      1|none  |     0|acc     |↑  |0.7185|±  |0.0389|
| - astronomy                   |      1|none  |     0|acc     |↑  |0.8553|±  |0.0286|
| - college_biology             |      1|none  |     0|acc     |↑  |0.8681|±  |0.0283|
| - college_chemistry           |      1|none  |     0|acc     |↑  |0.5300|±  |0.0502|
| - college_computer_science    |      1|none  |     0|acc     |↑  |0.6300|±  |0.0485|
| - college_mathematics         |      1|none  |     0|acc     |↑  |0.4800|±  |0.0502|
| - college_physics             |      1|none  |     0|acc     |↑  |0.5686|±  |0.0493|
| - computer_security           |      1|none  |     0|acc     |↑  |0.7800|±  |0.0416|
| - conceptual_physics          |      1|none  |     0|acc     |↑  |0.7660|±  |0.0277|
| - electrical_engineering      |      1|none  |     0|acc     |↑  |0.7379|±  |0.0366|
| - elementary_mathematics      |      1|none  |     0|acc     |↑  |0.6296|±  |0.0249|
| - high_school_biology         |      1|none  |     0|acc     |↑  |0.8710|±  |0.0191|
| - high_school_chemistry       |      1|none  |     0|acc     |↑  |0.6453|±  |0.0337|
| - high_school_computer_science|      1|none  |     0|acc     |↑  |0.7800|±  |0.0416|
| - high_school_mathematics     |      1|none  |     0|acc     |↑  |0.4481|±  |0.0303|
| - high_school_physics         |      1|none  |     0|acc     |↑  |0.5166|±  |0.0408|
| - high_school_statistics      |      1|none  |     0|acc     |↑  |0.6620|±  |0.0323|
| - machine_learning            |      1|none  |     0|acc     |↑  |0.5714|±  |0.0470|
```