mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-05 13:55:16 +08:00
commit f4b789d334
27 changed files with 217 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-Picaro-0.7-v2-12b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Magnum-Picaro-0.7-v2-12b.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a396d4f6c3b39469148f72d6440fc1cc9320cc15bc2a6978f928db7b9805f936
size 3221624992

3
Magnum-Picaro-0.7-v2-12b.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e184fd51566ac9b793a607611fcf2b817ea220ec47055d2ceb75ce24f7c1c767
size 2999212192

3
Magnum-Picaro-0.7-v2-12b.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:78891f2b26104c8e2f618102faec9ab1d1e332cfaab81921c7b4e3d9acad83fc
size 4435024032

3
Magnum-Picaro-0.7-v2-12b.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f0053818b540dfe17f0be5a5954fac76990bdb8585e96e976093c03fd7e41748
size 4138473632

3
Magnum-Picaro-0.7-v2-12b.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:811c5de8b7195a5f331a3627d083cf50099d35d0f109a65a4d27fc4e2a96f0cb
size 3915077792

3
Magnum-Picaro-0.7-v2-12b.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ae16f9ab126cd6084055eebaac1a9c790f4adbae6b0d281284016bdf71535f44
size 3592312992

3
Magnum-Picaro-0.7-v2-12b.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:29b9f17661c4b00e9b85cdaea1a7bc4fc5cd980156902bcdfbc9473a6fe191cb
size 5722232992

3
Magnum-Picaro-0.7-v2-12b.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:30762f33f9a682677b0fb20bbc30d16c9ee7de9bf06b8d48085b756b3cbf0478
size 5562079392

3
Magnum-Picaro-0.7-v2-12b.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f165e0dd61ba4c633e1d43d0ffddbb4d3f816cb2c6c3caf9d3dc2b1911cc3c04
size 5306488992

3
Magnum-Picaro-0.7-v2-12b.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:89e5d3a2b25f4174889da46264dc76f99306b19d292f1acf4894e42ea561a642
size 4945385632

3
Magnum-Picaro-0.7-v2-12b.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c326699741d6e0d2e13c03f12c04cb4e20da7b83f941ffd70c057c15ec2cb32
size 6742710432

3
Magnum-Picaro-0.7-v2-12b.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d5d68caa6b88e83a5b006162f9b3c58ac321ed8c14b2d5de78aaa54fb4c9853e
size 4791048352

3
Magnum-Picaro-0.7-v2-12b.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aad49e916eb14822c18b4bcbab41a78c2f551583f34cfaec44e2e31919cfc3c5
size 6561503392

3
Magnum-Picaro-0.7-v2-12b.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3db8457bbbdc7e5bd4b75b0f921473cdc12855a396806d1c1d88ff9a191600b7
size 6083090592

3
Magnum-Picaro-0.7-v2-12b.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:563cbc3c45852e39bc6a03b1f6878760ebfef521635346a6674bdffe777f6fb2
size 5534226592

3
Magnum-Picaro-0.7-v2-12b.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1467891d69b8724cc9e50bdab0e439204129151fa56ecc1903f6390ee7c63675
size 7094638752

3
Magnum-Picaro-0.7-v2-12b.i1-Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5ca0beef36ed661dfe46c04f9daf69a8b3920bab2f1f9f2f09d4e8d0f2308857
size 7071701152

3
Magnum-Picaro-0.7-v2-12b.i1-Q4_0_4_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9449352f22cd9c7500bf9a32216284b726939b8bf23e7585e14e36caf3005117
size 7071701152

3
Magnum-Picaro-0.7-v2-12b.i1-Q4_0_8_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f68d1849e5884b251c5a55f86f38c6d5c2b6bd144b1f77ac8ec6bc61b8ed3914
size 7071701152

3
Magnum-Picaro-0.7-v2-12b.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:22d13fecf1603c394bc549bb059a1b650e81b1b28e67881be1d260576b3f2180
size 7477205152

3
Magnum-Picaro-0.7-v2-12b.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ce52a8ab5528f5026f9826a48dcfa13809c9de78510dc93bb7af96eae9ff1603
size 7120197792

3
Magnum-Picaro-0.7-v2-12b.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8cd7405fcdc234338aca6389d38a97d63bf14e5a908d5a5f67dc4f25ba503df5
size 8727632032

3
Magnum-Picaro-0.7-v2-12b.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a975b0c3a4334894f449882e6406771b42765b67cd43cca01244a8f7ec68d41c
size 8518736032

3
Magnum-Picaro-0.7-v2-12b.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c41fc6da79e207ff4186788ab5d6fd9bdac6cf7d04acd964fa2d7ba7209f8075
size 10056210592

82
README.md Normal file
View File

@@ -0,0 +1,82 @@
---
base_model: Trappu/Magnum-Picaro-0.7-v2-12b
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- merge
- mergekit
- lazymergekit
- anthracite-org/magnum-v2-12b
- Trappu/Nemo-Picaro-12B
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Trappu/Magnum-Picaro-0.7-v2-12b
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-IQ2_S.gguf) | i1-IQ2_S | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-IQ2_M.gguf) | i1-IQ2_M | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-IQ3_S.gguf) | i1-IQ3_S | 5.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.8 | |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-Q4_0_4_4.gguf) | i1-Q4_0_4_4 | 7.2 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-Q4_0_4_8.gguf) | i1-Q4_0_4_8 | 7.2 | fast on arm+i8mm, low quality |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-Q4_0_8_8.gguf) | i1-Q4_0_8_8 | 7.2 | fast on arm+sve, low quality |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-Q4_0.gguf) | i1-Q4_0 | 7.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.6 | |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.8 | |
| [GGUF](https://huggingface.co/mradermacher/Magnum-Picaro-0.7-v2-12b-i1-GGUF/resolve/main/Magnum-Picaro-0.7-v2-12b.i1-Q6_K.gguf) | i1-Q6_K | 10.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:56abab53f2eae910d5c19eea4d5421a529323fe2fe4c1e6f8376c0b4191f0170
size 7054405