mradermacher/marvinizer-experimental-v2-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/marvinizer-experimental-v2-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-18 13:44:17 +08:00
commit 3ca3aa1667
27 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
marvinizer-experimental-v2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: ToastyPigeon/marvinizer-experimental-v2
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/ToastyPigeon/marvinizer-experimental-v2
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#marvinizer-experimental-v2-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/marvinizer-experimental-v2-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ1_S.gguf) | i1-IQ1_S | 1.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ1_M.gguf) | i1-IQ1_M | 2.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.2 | |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ2_S.gguf) | i1-IQ2_S | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ2_M.gguf) | i1-IQ2_M | 2.8 | |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q2_K.gguf) | i1-Q2_K | 3.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ3_S.gguf) | i1-IQ3_S | 3.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ3_M.gguf) | i1-IQ3_M | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.8 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.1 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.1 | |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.3 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q4_0.gguf) | i1-Q4_0 | 4.3 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.3 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q4_1.gguf) | i1-Q4_1 | 4.7 | |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q6_K.gguf) | i1-Q6_K | 6.1 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
marvinizer-experimental-v2.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bbcfd1967485a400f82bb178aa94ba099af9bb624c6d158e497e943ac0f222ec
size 1938878048

3
marvinizer-experimental-v2.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:16caa05f98a377c938d578711b892db59d1565cb330da7d3bcb03a48741d605c
size 1816489568

3
marvinizer-experimental-v2.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a3e68df202e3ed9376b0df20ccae5d3c9a0b096a252911d2dc755df19e4f4f8c
size 2676061728

3
marvinizer-experimental-v2.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ada79b968066a1b5eea0208ccee73eeddfacd0d93f8620e16db24ec7cee55336
size 2512877088

3
marvinizer-experimental-v2.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3926f7d851ae533e3486f77c39c8a865278532e1e87552e46d1cbb3a9e2264c2
size 2322820704

3
marvinizer-experimental-v2.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8fdbf7e14061532ec63a28b24a8f6892a061e1cbd4e17911096a5705d78ad1ce
size 2142858848

3
marvinizer-experimental-v2.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:46c2c0d69a7498b73760d2becefc3015db4466483473d93cb4501cc2c483b260
size 3468318944

3
marvinizer-experimental-v2.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a63eed1c9c377fa2b6049e0520729aca23de0844b23912b43d3ccce5a1c36c3
size 3301759200

3
marvinizer-experimental-v2.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:51bc0d3a94ed3ec033da9b743ac94b2c0f4189f42a0df96391d19c5662158c2c
size 3149977824

3
marvinizer-experimental-v2.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b634b1984426d54e631cf415d9b8c6dea46ff8f24e4b636f0b631b97f45d829d
size 2901702176

3
marvinizer-experimental-v2.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a804a2167d839cc407e6a12b4d6f389b664f730c65714f0b53c1b1c2ba7b3c6c
size 4216404896

3
marvinizer-experimental-v2.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e48e320478108a09342694595b8d745b489c7b3bbc43837f558b1e7e0fea3499
size 4001194144

3
marvinizer-experimental-v2.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cca98bee67ab2237f7f333b4f3e989e58b16e0de49f012040748c00274ec05b7
size 2857914656

3
marvinizer-experimental-v2.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4831bd41a9f6f960bd43dd9edff15ca49bcfb984547b3bebbd1b21e01d11be1
size 2644594976

3
marvinizer-experimental-v2.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a40409b212f913e53aaa997327ab8dab9f6b722d77aec939e6ed5df75bc6781
size 3950565600

3
marvinizer-experimental-v2.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b9b0764f3978e2d14f5072f4a5ed95ef2ce972037c662272708d3b3c31a062be
size 3651459296

3
marvinizer-experimental-v2.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e12a06165d5a58cc957f07c5c7a83ffd499f78f0f6252b4baf2fd63761386dbb
size 3301759200

3
marvinizer-experimental-v2.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:980582196b916f2eda9d0be4320cdf4f00e67949d36186f2a2b82d7367a1eaa1
size 4227677088

3
marvinizer-experimental-v2.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:93293303553e37f74cea3d4a71fb067bfbd348c0d01d76ad8ba8911cfb5cfc3d
size 4646826400

3
marvinizer-experimental-v2.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d9f0f2e8e1cf3070206bf6c1c61c419f4c236dc61c2814dfc576252ee6405160
size 4471602080

3
marvinizer-experimental-v2.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b04efec0307748523b574083dce30e480b99eab0528f03bbf18f956a85975096
size 4247337888

3
marvinizer-experimental-v2.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:08824e3046f6ee050ae5f3c83b33e998122fd127a5cea42e054e75cf7fba2967
size 5208713120

3
marvinizer-experimental-v2.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa0da770936ac05c404778b47d5913d1283e293c36a606e1c573a971c31f9239
size 5077247904

3
marvinizer-experimental-v2.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee4747e1f37a5881dd705d6c0bd754eaa1c903a29949e76f568d1ad56bfa1275
size 5991893600

3
marvinizer-experimental-v2.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:714aa92b0b99a0f401d308d9315c6694793d80eee46a18643fef0a215a80482f
size 4589216