SanctumAI/Mistral-Nemo-Instruct-2407-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: SanctumAI/Mistral-Nemo-Instruct-2407-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-19 06:46:17 +08:00
commit 2080cccba8
19 changed files with 167 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

52
.gitattributes vendored Normal file
View File

@@ -0,0 +1,52 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.f16.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
mistral-nemo-instruct-2407.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

64
README.md Normal file
View File

@@ -0,0 +1,64 @@
---
license: apache-2.0
language:
- en
- fr
- de
- es
- it
- pt
- ru
- zh
- ja
---
![image/png](https://cdn-uploads.huggingface.co/production/uploads/64a28db2f1968b7d7f357182/vBTAY_FyfW_G6zt7Ye6zR.png)
*This model was quantized by [SanctumAI](https://sanctum.ai). To leave feedback, join our community in [Discord](https://discord.gg/7ZNE78HJKh).*
# Mistral Nemo Instruct 2407 GGUF
**Model creator:** [mistralai](https://huggingface.co/mistralai)<br>
**Original model**: [Mistral-Nemo-Instruct-2407](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407)<br>
## Model Summary:
The Mistral-Nemo-Instruct-2407 Large Language Model (LLM) is an instruct fine-tuned version of the [Mistral-Nemo-Base-2407](https://huggingface.co/mistralai/Mistral-Nemo-Base-2407). Trained jointly by Mistral AI and NVIDIA, it significantly outperforms existing models smaller or similar in size.
For more details about this model please refer to our release [blog post](https://mistral.ai/news/mistral-nemo/).
## Prompt Template:
If you're using Sanctum app, simply use `Mistral` model preset.
Prompt template:
```
[INST]{prompt} [/INST]
```
## Hardware Requirements Estimate
| Name | Quant method | Size | Memory (RAM, vRAM) required |
| ---- | ---- | ---- | ---- |
| [mistral-nemo-instruct-2407.Q2_K.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q2_K.gguf) | Q2_K | 4.79 GB | ? GB |
| [mistral-nemo-instruct-2407.Q3_K_S.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q3_K_S.gguf) | Q3_K_S | 5.53 GB | ? GB |
| [mistral-nemo-instruct-2407.Q3_K_M.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q3_K_M.gguf) | Q3_K_M | 6.08 GB | ? GB |
| [mistral-nemo-instruct-2407.Q3_K_L.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q3_K_L.gguf) | Q3_K_L | 6.56 GB | ? GB |
| [mistral-nemo-instruct-2407.Q4_0.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q4_0.gguf) | Q4_0 | 7.07 GB | ? GB |
| [mistral-nemo-instruct-2407.Q4_K_S.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q4_K_S.gguf) | Q4_K_S | 7.12 GB | ? GB |
| [mistral-nemo-instruct-2407.Q4_K.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q4_K.gguf) | Q4_K | 7.48 GB | ? GB |
| [mistral-nemo-instruct-2407.Q4_K_M.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q4_K_M.gguf) | Q4_K_M | 7.48 GB | ? GB |
| [mistral-nemo-instruct-2407.Q4_1.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q4_1.gguf) | Q4_1 | 7.80 GB | ? GB |
| [mistral-nemo-instruct-2407.Q5_0.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q5_0.gguf) | Q5_0 | 8.52 GB | ? GB |
| [mistral-nemo-instruct-2407.Q5_K_S.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q5_K_S.gguf) | Q5_K_S | 8.52 GB | ? GB |
| [mistral-nemo-instruct-2407.Q5_K.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q5_K.gguf) | Q5_K | 8.73 GB | ? GB |
| [mistral-nemo-instruct-2407.Q5_K_M.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q5_K_M.gguf) | Q5_K_M | 8.73 GB | ? GB |
| [mistral-nemo-instruct-2407.Q5_1.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q5_1.gguf) | Q5_1 | 9.24 GB | ? GB |
| [mistral-nemo-instruct-2407.Q6_K.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q6_K.gguf) | Q6_K | 10.06 GB | ? GB |
| [mistral-nemo-instruct-2407.Q8_0.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.Q8_0.gguf) | Q8_0 | 13.02 GB | ? GB |
| [mistral-nemo-instruct-2407.f16.gguf](https://huggingface.co/SanctumAI/Mistral-Nemo-Instruct-2407-GGUF/blob/main/mistral-nemo-instruct-2407.f16.gguf) | f16 | 24.50 GB | ? GB |
## Disclaimer
Sanctum is not the creator, originator, or owner of any Model featured in the Models section of the Sanctum application. Each Model is created and provided by third parties. Sanctum does not endorse, support, represent or guarantee the completeness, truthfulness, accuracy, or reliability of any Model listed there. You understand that supported Models can produce content that might be offensive, harmful, inaccurate or otherwise inappropriate, or deceptive. Each Model is the sole responsibility of the person or entity who originated such Model. Sanctum may not monitor or control the Models supported and cannot, and does not, take responsibility for any such Model. Sanctum disclaims all warranties or guarantees about the accuracy, reliability or benefits of the Models. Sanctum further disclaims any warranty that the Model will meet your requirements, be secure, uninterrupted or available at any time or location, or error-free, viruses-free, or that any errors will be corrected, or otherwise. You will be solely responsible for any damage resulting from your use of or access to the Models, your downloading of any Model, or use of any other Model provided by or through Sanctum.

3
mistral-nemo-instruct-2407.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:402ec0287eaadf7ebf070ef7fc9039dddd84c802e068cb32033c80964ebb4cd6
size 4791047872

3
mistral-nemo-instruct-2407.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dde8dff3e474111be9bbd4d7f6e6f490ac4df71e6abccbb050c708808f3e860d
size 6561502912

3
mistral-nemo-instruct-2407.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e492eb2dd13f139f03c4aa89e15716c469ec836177a10e29beeff91660b1407
size 6083090112

3
mistral-nemo-instruct-2407.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e68c018879180343ce4a12c22a1b6d175ccfc929a3aa1945f40cbe7fdea2e3a
size 5534226112

3
mistral-nemo-instruct-2407.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b559938ab7a0392fc9ea9675b82280f2a15669ec3e0e0fc491c9cb0a7681cf94
size 7071700672

3
mistral-nemo-instruct-2407.Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4e1e753936db349cd693314f3213a88ff578450c2bf59b01581c2e4e4c00dae3
size 7795218112

3
mistral-nemo-instruct-2407.Q4_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd3af152229f92a3d61f3f115217c9c72f4b94d8be6778156dab23f894703c28
size 7477204672

3
mistral-nemo-instruct-2407.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd3af152229f92a3d61f3f115217c9c72f4b94d8be6778156dab23f894703c28
size 7477204672

3
mistral-nemo-instruct-2407.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f6a52cc438d03a2fea37daac172fb087ca6b93733bd7c0f105491c0fb9d8d048
size 7120197312

3
mistral-nemo-instruct-2407.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:09902214bc967733d6a33f0cdcb30c2c4fcd2fe04ed493c0620d405bd1f0a81d
size 8518735552

3
mistral-nemo-instruct-2407.Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f154d487fee196469351bcd5ffa93c34d796856ba868d789706b047da5980058
size 9242252992

3
mistral-nemo-instruct-2407.Q5_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf4795c211f8a5740d5b6244448fb18f56645614616287c09756ab26303cdd33
size 8727631552

3
mistral-nemo-instruct-2407.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf4795c211f8a5740d5b6244448fb18f56645614616287c09756ab26303cdd33
size 8727631552

3
mistral-nemo-instruct-2407.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2d2a6cf5553a8dc68e8933d7e439541cc539b02c20d4881c7c2c012e6b07c0ec
size 8518735552

3
mistral-nemo-instruct-2407.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e6fc37d24f2aefae0c8dcf3a25247cf15ac21ac62960fc418e0f597aa02b182
size 10056210112

3
mistral-nemo-instruct-2407.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:824229be17606dd8177fc91c1d330b065bc4f3de2873eab614376b988dcbf48a
size 13022369472

3
mistral-nemo-instruct-2407.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a9581ae7a87e5727aa1b0670f439ffe2a31a4bcb38ca201f9cd76ac975d31ae
size 24504276672