qwp4w3hyb/Mistral-Nemo-Instruct-2407-iMat-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: qwp4w3hyb/Mistral-Nemo-Instruct-2407-iMat-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-18 00:35:12 +08:00
commit e59817464b
21 changed files with 141 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

54
.gitattributes vendored Normal file
View File

@@ -0,0 +1,54 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-bf16.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-IQ2_L.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-IQ3_L.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-Q4_K_L.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-Q5_K_L.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-Q6_K_L.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407-imat-Q8_0_L.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.imatrix filter=lfs diff=lfs merge=lfs -text

30
README.md Normal file
View File

@@ -0,0 +1,30 @@
---
license: apache-2.0
language:
- en
pipeline_tag: text-generation
tags:
- mistral
- instruct
- gguf
- imatrix
base_model: mistralai/Mistral-Nemo-Instruct-2407
---
# Quant Infos
- needs [#8604](https://github.com/ggerganov/llama.cpp/pull/8604) & latest master with tekken tokenizer fixes applied
- quants done with an importance matrix for improved quantization loss
- Quantized ggufs & imatrix from hf bf16, through bf16. `safetensors bf16 -> gguf bf16 -> quant` for optimal quant loss.
- Wide coverage of different gguf quant types from Q\_8\_0 down to IQ1\_S
- experimental custom quant types
- `_L` with `--output-tensor-type f16 --token-embedding-type f16` (same as bartowski's)
- Imatrix generated with [this](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8) multi-purpose dataset by [bartowski](https://huggingface.co/bartowski).
```
./imatrix -m $model_name-bf16.gguf -f calibration_datav3.txt -o $model_name.imatrix
```
# Original Model Card:
TODO

3
mistral-nemo-instruct-2407-bf16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed0d5f408dd612f9bbc778262e512279b4dd187892c4cf735fd2ec41b5f6a9ba
size 24504276672

3
mistral-nemo-instruct-2407-imat-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bbc46fd360c6d9673f63093594af86e3380f198a0753af75e7b27d6802205166
size 2999212032

3
mistral-nemo-instruct-2407-imat-IQ2_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:78c34ecfdd1b7511b3b74d62deaa45d3a88aa3eec2c2812fabcc02a190f969ab
size 6369646592

3
mistral-nemo-instruct-2407-imat-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:13c09f3b1f8352af21ffce2c7e48080f15908d552682bb7c6b46a2c0720d8d2d
size 4435023872

3
mistral-nemo-instruct-2407-imat-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:959b9b06d59cae4f078adade6f4643645df4826f71f008f02bd0b9c0795fa1e9
size 3592312832

3
mistral-nemo-instruct-2407-imat-IQ3_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7850d5825c526d51d276b308a9a5521c31b734315e64b73d17c912095d3662a4
size 7567726592

3
mistral-nemo-instruct-2407-imat-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5ac5e3d00134f4912dcebec1686d90c60d27f2e8661534efafefb6a0c5bcf38
size 5722232832

3
mistral-nemo-instruct-2407-imat-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e6c8164ff0b38d0c9e9b9a055692345b0b00652d2ef713a78b483c69641a7997
size 4945385472

3
mistral-nemo-instruct-2407-imat-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ec951c386bf51693ad855925a8139e6ae30e5b2a8e21354f35ac52f1026f808
size 6742710272

3
mistral-nemo-instruct-2407-imat-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e36362a4862ff247ef2a61e46194faa54609456b110f835cedaf2867bd2e4f4
size 7094638592

3
mistral-nemo-instruct-2407-imat-Q4_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6dbf223562be723a047610511df85103c74f21a4a3d1073549bd18da5b423781
size 9233569792

3
mistral-nemo-instruct-2407-imat-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f78dd3b1f876d3e14350515d837162583d72554ac937bcc2d1716cab9de80ae
size 7477204992

3
mistral-nemo-instruct-2407-imat-Q5_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d35476b6b79a2bbe236fea44719311f7252eaa674e08ce3f6aac639bf00045e
size 10400110592

3
mistral-nemo-instruct-2407-imat-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8e5717dc3f1add9400c9eb0dd0a8ca550751848cfdb9924c255619ed0ecb1514
size 8727631872

3
mistral-nemo-instruct-2407-imat-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b2084bd4070e963b8a12a7f3ab40d6e9f935dc9866ec4e1a2b787daf536a3408
size 10056210432

3
mistral-nemo-instruct-2407-imat-Q6_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6f5349b05c09b44f2d1b36ebd32c705fa6c8bd221e113578aa51b74ae0da0705
size 11639560192

3
mistral-nemo-instruct-2407-imat-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:63215822435cdfe1207f9d527a5efa9e37299cef69af9c28230a480176c05a91
size 13022369792

3
mistral-nemo-instruct-2407-imat-Q8_0_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e3dc1600d59a6285ce09948ee00da4bac72606412a8dd9ffaceafbc9f09cce5f
size 14280660992

3
mistral-nemo-instruct-2407.imatrix Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0897f1e887b60fec766a28142273cb41733fb26bbe624978431ea9841bba5404
size 7054438