初始化项目,由ModelHub XC社区提供模型
Model: LLM-Research/Mistral-Nemo-Instruct-2407-gptq-4bit Source: Original Platform
This commit is contained in:
25
README.md
Normal file
25
README.md
Normal file
@@ -0,0 +1,25 @@
|
||||
---
|
||||
tags:
|
||||
- mistral-nemo
|
||||
- gptq
|
||||
- 4bit
|
||||
- int4
|
||||
- gptqmodel
|
||||
- modelcloud
|
||||
---
|
||||
This model has been quantized using [GPTQModel](https://github.com/ModelCloud/GPTQModel).
|
||||
|
||||
- **bits**: 4
|
||||
- **group_size**: 128
|
||||
- **desc_act**: true
|
||||
- **static_groups**: false
|
||||
- **sym**: true
|
||||
- **lm_head**: false
|
||||
- **damp_percent**: 0.01
|
||||
- **true_sequential**: true
|
||||
- **model_name_or_path**: ""
|
||||
- **model_file_base_name**: "model"
|
||||
- **quant_method**: "gptq"
|
||||
- **checkpoint_format**: "gptq"
|
||||
- **meta**:
|
||||
- **quantizer**: "gptqmodel:0.9.9-dev0"
|
||||
Reference in New Issue
Block a user