初始化项目,由ModelHub XC社区提供模型

Model: TechxGenus-MS/Mistral-7B-v0.2-hf-AWQ
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-14 13:40:12 +08:00
commit f6463f942d
10 changed files with 91283 additions and 0 deletions

12
README.md Normal file
View File

@@ -0,0 +1,12 @@
AWQ quantized version of Mistral-7B-v0.2-hf model.
---
~~Mistral 7b v0.2 with attention_dropout=0.6, for training purposes~~
Conversion process:
1. Download original weights from https://models.mistralcdn.com/mistral-7b-v0-2/mistral-7B-v0.2.tar
2. Convert with https://github.com/huggingface/transformers/blob/main/src/transformers/models/mistral/convert_mistral_weights_to_hf.py
3. You may need to copy the tokenizer.model from Mistral-7B-Instruct-v0.2 repo.