EnlistedGhost/Pixtral-12B-2409-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: EnlistedGhost/Pixtral-12B-2409-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-19 13:03:20 +08:00
commit 1b3c09cf06
24 changed files with 298 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

67
.gitattributes vendored Normal file
View File

@@ -0,0 +1,67 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-BF16.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q4_K_SX.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q5_K_SX.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
mmproj-Pixtral-12B-2409-F16.gguf filter=lfs diff=lfs merge=lfs -text
mmproj-Pixtral-12B-2409-F32.gguf filter=lfs diff=lfs merge=lfs -text
mmproj-Pixtral-12B-2409-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q5_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q6_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q6_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q2_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q2_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-IQ4_L.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-IQ4_M.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-IQ4_S.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q2_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q5_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-Q6_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Pixtral-12B-2409-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text

3
Pixtral-12B-2409-BF16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:465f3404999a9d4f0e090f84428d1b8e0d8274941525e024896badbbaa20ebdb
size 24504275872

3
Pixtral-12B-2409-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b4ba662a00753c36d1258aed301cedac167c78526698506c35a1b6e0af78a5c4
size 5724607648

3
Pixtral-12B-2409-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0609ab51ed81e49d35329ec0724a7ce76945939d7ad11f037805be30c30055d2
size 6994039712

3
Pixtral-12B-2409-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1d7a730d29354219f6b0187ce6407ed7f7a655e27e19a63e424a6be1f2e82587
size 5121348512

3
Pixtral-12B-2409-Q2_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e72873b89d5ac14e33165e5db9894f59133fd163119510869df05208f0cfbed0
size 6975034272

3
Pixtral-12B-2409-Q2_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:06cf649b0efea8d21dfc89bf45e515c9085e7b026ea500b33943f00af553bd4e
size 6445831072

3
Pixtral-12B-2409-Q2_K_XL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6fea010619e5b2d5f2e9c32ca1690fb96a5e76599d66b8bdc03707ad9e68d104
size 7940051872

3
Pixtral-12B-2409-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7746787c503501c774c2934104b07aeb817836c8a4bfeb64d48a3d666e98cf1c
size 6823646112

3
Pixtral-12B-2409-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:99cde22014630bc3be6d9f3aef419be44ed350b621f819215dcffec46451e686
size 6345233312

3
Pixtral-12B-2409-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:06113c2492b0b4084f0bf7c7b881a9d0907e342dbfb119ab192c65627f291220
size 5796369312

3
Pixtral-12B-2409-Q3_K_XL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b186000bc47da8973f63b2e221e31de3cde02e694c8d65a4e716457c1c4ad531
size 7148704672

3
Pixtral-12B-2409-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:80f05f4f031bd9cdcd073051e23d2e55d9b71136cc2832eaa0da4a4ea44ed67b
size 7703795680

3
Pixtral-12B-2409-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa6c21cee879befd345424ebca7955ca60797d0f9829ac36c669bc16e58936f8
size 7293211552

3
Pixtral-12B-2409-Q4_K_XL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:69ba6e17e961b0c6f4a8c722ccedd03d7e8502d180b1458b7f581d916eaef391
size 9358906272

3
Pixtral-12B-2409-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1bb24a90cf4707cca70362dfe3dcd8986cb1c15992e4be640257299668f547a
size 8816759712

3
Pixtral-12B-2409-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:14886fe83e70ff9e27a565323ad7be8de1fa6f16f4d1af3cdd5e05124448c838
size 8607863712

3
Pixtral-12B-2409-Q5_K_XL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bb52680b88e33fedd8fbe4d3f16b63872b459f4d869cce029444a63b4f62691c
size 10427143072

3
Pixtral-12B-2409-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eccedabfceb1f7b668e74ccb58d26a908261d4c437ca9bcab1568614e08f4813
size 10056209312

3
Pixtral-12B-2409-Q6_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:397da275e6f0ebaa8517b34c4e40d436d0d14bb70de1b6705a2cf56928219cb8
size 10381267872

3
Pixtral-12B-2409-Q6_K_XL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:059e8e1840af0d8d44a0c0e65f351d27ea45c6fb675864c36a684bca81c20a32
size 11346285472

3
Pixtral-12B-2409-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f451e979cf89c6f8a0cffb9d4ed6b76b79aba703bd56d4f9d6f878ea6190aae5
size 13022368672

165
README.md Normal file
View File

@@ -0,0 +1,165 @@
---
license: apache-2.0
language:
- en
- ja
- fr
- de
- es
- it
- pt
- ru
- zh
base_model:
- mistralai/Pixtral-12B-2409
pipeline_tag: image-text-to-text
new_version: EnlistedGhost/Pixtral-12B-2409-GGUF
datasets:
- mistralai/MM-MT-Bench
tags:
- Pixtral,
- 12B,
- Vision,
- Conversational,
- Ollama,
- ggml,
- gguf,
- Image-Text-to-Text,
- Multimodal,
- MistralAI
- Llama.cpp
- Quantized
---
# Model - Pixtral-12B-2409 (GGUF + Ollama Patched)
*[The first official MistralAI Pixtral-12B to be GGUF converted and GGUF Quantized!]*
### NEW UPDATES! (As of: November 27th, 2025) (Read below!)
-------------------------------------------------------------------------
**Description:** <br />
EnlistedGhost's GGUF/Quantized Repository of - MistralAI Pixtral-12B-2409...
This release includes GGUF+Ollama-Patched moodel files and three working projector
(mmproj) files for the Vision Projector, offering full capabilities in Ollama or Llama.cpp.<br /><br />
**No modifications, edits, or configurations are required** to use this model with
Ollama, it works natively! **Both Vision and Text work with Ollama. (^.^)** <br />
**Personal Notes:**<br />
The quality of interaction with this model from MistralAI **has been verified
to be of a higher quality than others available.** There are other Pixtral-12B models
that are community versions, however the weights that MistralAI had are different than
from the community vertsion has and are significantly improved over community available releases.
*Thank you for taking the time to read this!<br />*
**Some explaination for this claim -** <br />
The currently available (publicly released on Huggingface) Pixtral-12B GGUF/GGUF-Quantized
releases are from *mistral-community* and not *MistralAI* themselves.
So, I am very excited to offer the Huggingface community an Ollama and
Llama.cpp compatible version of the officially released: MistralAI/Pixtral-12B-2409
Multimodal Vision Model!<br />
**Public Notice: The statements and wording in this release DO NOT:**<br />
infer, suggest, slander or portray in a negative manner the
mistral-community and their releases! I have nothing but a very high respect
for mistral-community and their quality work.
*(Be sure to check them out too!)* <br /> <br />
The wording I use is only to offer a distinction between the fact that these
GGUF/Quantized files are derrived directly from official MistralAI iterations.
*(Sorry for the long disclaimer there - I just have to be very clear that I am not
in any way saying anything negative about the already-quantized and GGUF converted
Pixtral-12B from mistral-community)*<br /><br />
Happy Inferencing! <br />
-- Jon Z (EnlistedGhost)
---------------------------------------------
### Model Updates (As of: November 27th, 2025)
- Updated: All GGUF model file(s) with Extremely-High-Quality GGUF file(s) (You won't be disappointed!)<br />
**Final Quantized and full-BF16 modelfiles have been uploaded!!!**
## How to run this Model using Ollama
You can run this model by using the "ollama run" command.<br />
Simply copy & paste one of the commands from the list below into<br />
your console, terminal or power-shell window.
| Quant Type | File Size | Command |
|:-----------|:----------|:--------|
| Q2_K_S | 4.78 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q2_K_S |
| Q2_K | 5.12 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q2_K |
| Q3_K_S | 5.62 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q3_K_S |
| Q3_K_M | 6.35 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q3_K_M |
| Q4_K_S | 7.29 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q4_K_S |
| Q4_K_M | 7.65 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q4_K_M |
| Q4_K_XL| 7.98 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q4_K_XL |
| Q5_K_S | 8.43 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q5_K_S |
| Q5_K_M | 8.93 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q5_K_M |
| Q5_K_XL| 9.14 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q5_K_XL |
| Q6_K | 10.1 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q6_K |
| Q6_K_M | 10.4 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q6_K_M |
| Q6_K_XL| 11.6 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q6_K_XL |
| Q8_0 | 13.0 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q8_0 |
| F16 | 24.5 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:F16 |
**mmproj (Vision Projector) Files**
| Quant Type | File Size | Download-Link |
|:-----------|:----------|:--------------|
| Q8_0 | 465 MB | [[mmproj Vision Pixtral-12B rojector:Q8_0](https://huggingface.co/EnlistedGhost/Pixtral-12B-2409-GGUF/resolve/main/mmproj-Pixtral-12B-2409-Q8_0.gguf?download=true)]|
| F16 | 870 MB | [[mmproj Vision Pixtral-12B rojector:F16](https://huggingface.co/EnlistedGhost/Pixtral-12B-2409-GGUF/resolve/main/mmproj-Pixtral-12B-2409-F16.gguf?download=true)]|
| F32 | 1.74 GB | [[mmproj Vision Pixtral-12B rojector:F32](https://huggingface.co/EnlistedGhost/Pixtral-12B-2409-GGUF/resolve/main/mmproj-Pixtral-12B-2409-F32.gguf?download=true)]|
-------------------------------------------------------------------------------
### Intended Use
Same as original:
- [[MistralAI](https://huggingface.co/mistralai/Pixtral-12B-2409)]
### Out-of-Scope Use
Same as original:
- [[MistralAI](https://huggingface.co/mistralai/Pixtral-12B-2409)]
## Bias, Risks, and Limitations
Same as original:
- [[MistralAI](https://huggingface.co/mistralai/Pixtral-12B-2409)]
## Training Details
Training sets and data are from:
- [[mistralAI](https://huggingface.co/mistralai/Pixtral-12B-2409)]
<br />(This is a direct off-shoot/decendant of the above mentioned model)
## Evaluation
- This model has NOT been evaluated in any form, scope or type of method.
- **!!! USE AT YOUR OWN RISK !!!**
- **!!! NO WARRANTY IS PROVIDED OF ANY KIND !!!**
## Citation (Original Paper)
[[MistalAI Pixtral-12B Original Paper](https://huggingface.co/papers/2410.07073)]
## Detailed Release Information
- **Originally Developed by:** [[mistralai](https://huggingface.co/mistralai/Pixtral-12B-2409)]
- **MMPROJ (Vision) Quantized by:** [[EnlistedGhost](https://huggingface.co/EnlistedGhost)]
- **Model Quantized for GGUF by:** [[EnlistedGhost](https://huggingface.co/EnlistedGhost)]
- **Modified for Ollama by:** [[EnlistedGhost](https://huggingface.co/EnlistedGhost)]
- **Model type & format:** [Quantized/GGUF]
- **License type:** [Apache-2.0]
## Attributions (Credits)
A big thank-you is extended to the below credited sources!<br />
These contributions are what made this release possible!
*Important Notice: **This is NOT a copy/paste release**, <br />
I have created unique Quantized files that were then altered further <br />
to properly work with Ollama software. <br />
This resulted in the first publicly available <br />
Pixtral-12B-2409 model that natively runs on Ollama.*
- [[MistralAI](https://huggingface.co/mistralai/Pixtral-12B-2409)]
- [[Ollama developers](https://github.com/ollama/ollama/issues/6748#issuecomment-3449009817)]
## Model Card Authors and Contact
[[EnlistedGhost](https://huggingface.co/EnlistedGhost)]

3
mmproj-Pixtral-12B-2409-F32.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:25622e8033dd8d80aa00f1542dbd16898e65a2b99a3449b8070ad8d6eed75c5d
size 1739863968