4b6b4b95b3
Model: shisa-ai/Mistral-Nemo-Japanese-Instruct-2408-GPTQ-W4A16-gs32-noact Source: Original Platform
12 lines
487 B
Markdown
12 lines
487 B
Markdown
---
|
|
license: apache-2.0
|
|
language:
|
|
- ja
|
|
- en
|
|
base_model:
|
|
- cyberagent/Mistral-Nemo-Japanese-Instruct-2408
|
|
tags:
|
|
- gptq
|
|
---
|
|
|
|
W4A16 gs32 no act order (desc_act=false) GPTQ quant of [cyberagent/Mistral-Nemo-Japanese-Instruct-2408](https://huggingface.co/cyberagent/Mistral-Nemo-Japanese-Instruct-2408) w/ [GPTQModel](https://github.com/ModelCloud/GPTQModel) 1.7.2 using [augmxnt/ultra-orca-boros-en-ja-v1](https://huggingface.co/datasets/augmxnt/ultra-orca-boros-en-ja-v1) as calibration set |