86c078968c9321359208b197333a1b8aa68fe0dd
Model: ModelCloud.AI/Marin-32B-Base-GPTQMODEL-AWQ-W4A16 Source: Original Platform
license, license_name, license_link, language, base_model, pipeline_tag, tags
| license | license_name | license_link | language | base_model | pipeline_tag | tags | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| other | modelcloud | LICENSE |
|
|
text-generation |
|
This 4bit W4A16 model has been quantized by @Qubitum at ModelCloud using GPT-QModel.
SPDX-License-Identifier: NonCommercial-ModelCloud
Copyright (c) 2024–2025 ModelCloud.ai
Released for non-profit use only.
Commercial use requires permission from [@qubitium](https://x.com/qubitium).
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|-------------------------------|------:|------|-----:|--------|---|-----:|---|-----:|
|arc_challenge | 1|none | 0|acc |↑ |0.5828|± |0.0144|
| | |none | 0|acc_norm|↑ |0.6007|± |0.0143|
|mmlu (stem) | 2|none | |acc |↑ |0.6673|± |0.0080|
| - abstract_algebra | 1|none | 0|acc |↑ |0.4200|± |0.0496|
| - anatomy | 1|none | 0|acc |↑ |0.7185|± |0.0389|
| - astronomy | 1|none | 0|acc |↑ |0.8553|± |0.0286|
| - college_biology | 1|none | 0|acc |↑ |0.8681|± |0.0283|
| - college_chemistry | 1|none | 0|acc |↑ |0.5300|± |0.0502|
| - college_computer_science | 1|none | 0|acc |↑ |0.6300|± |0.0485|
| - college_mathematics | 1|none | 0|acc |↑ |0.4800|± |0.0502|
| - college_physics | 1|none | 0|acc |↑ |0.5686|± |0.0493|
| - computer_security | 1|none | 0|acc |↑ |0.7800|± |0.0416|
| - conceptual_physics | 1|none | 0|acc |↑ |0.7660|± |0.0277|
| - electrical_engineering | 1|none | 0|acc |↑ |0.7379|± |0.0366|
| - elementary_mathematics | 1|none | 0|acc |↑ |0.6296|± |0.0249|
| - high_school_biology | 1|none | 0|acc |↑ |0.8710|± |0.0191|
| - high_school_chemistry | 1|none | 0|acc |↑ |0.6453|± |0.0337|
| - high_school_computer_science| 1|none | 0|acc |↑ |0.7800|± |0.0416|
| - high_school_mathematics | 1|none | 0|acc |↑ |0.4481|± |0.0303|
| - high_school_physics | 1|none | 0|acc |↑ |0.5166|± |0.0408|
| - high_school_statistics | 1|none | 0|acc |↑ |0.6620|± |0.0323|
| - machine_learning | 1|none | 0|acc |↑ |0.5714|± |0.0470|
Description