commit 3ca3aa1667a76ce12a09cbf315f35945b716957c Author: ModelHub XC Date: Thu Jun 18 13:44:17 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/marvinizer-experimental-v2-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..39324c8 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +marvinizer-experimental-v2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..79fe776 --- /dev/null +++ b/README.md @@ -0,0 +1,84 @@ +--- +base_model: ToastyPigeon/marvinizer-experimental-v2 +language: +- en +library_name: transformers +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/ToastyPigeon/marvinizer-experimental-v2 + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#marvinizer-experimental-v2-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/marvinizer-experimental-v2-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ1_S.gguf) | i1-IQ1_S | 1.9 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ1_M.gguf) | i1-IQ1_M | 2.0 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.2 | | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ2_S.gguf) | i1-IQ2_S | 2.6 | | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.7 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ2_M.gguf) | i1-IQ2_M | 2.8 | | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q2_K.gguf) | i1-Q2_K | 3.0 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.0 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.2 | | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ3_S.gguf) | i1-IQ3_S | 3.4 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.4 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ3_M.gguf) | i1-IQ3_M | 3.6 | | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.8 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.1 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.1 | | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.3 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q4_0.gguf) | i1-Q4_0 | 4.3 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.3 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.6 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q4_1.gguf) | i1-Q4_1 | 4.7 | | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.2 | | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.3 | | +| [GGUF](https://huggingface.co/mradermacher/marvinizer-experimental-v2-i1-GGUF/resolve/main/marvinizer-experimental-v2.i1-Q6_K.gguf) | i1-Q6_K | 6.1 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/marvinizer-experimental-v2.i1-IQ1_M.gguf b/marvinizer-experimental-v2.i1-IQ1_M.gguf new file mode 100644 index 0000000..e33615b --- /dev/null +++ b/marvinizer-experimental-v2.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bbcfd1967485a400f82bb178aa94ba099af9bb624c6d158e497e943ac0f222ec +size 1938878048 diff --git a/marvinizer-experimental-v2.i1-IQ1_S.gguf b/marvinizer-experimental-v2.i1-IQ1_S.gguf new file mode 100644 index 0000000..75eafe8 --- /dev/null +++ b/marvinizer-experimental-v2.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:16caa05f98a377c938d578711b892db59d1565cb330da7d3bcb03a48741d605c +size 1816489568 diff --git a/marvinizer-experimental-v2.i1-IQ2_M.gguf b/marvinizer-experimental-v2.i1-IQ2_M.gguf new file mode 100644 index 0000000..0e7e481 --- /dev/null +++ b/marvinizer-experimental-v2.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a3e68df202e3ed9376b0df20ccae5d3c9a0b096a252911d2dc755df19e4f4f8c +size 2676061728 diff --git a/marvinizer-experimental-v2.i1-IQ2_S.gguf b/marvinizer-experimental-v2.i1-IQ2_S.gguf new file mode 100644 index 0000000..f9aa812 --- /dev/null +++ b/marvinizer-experimental-v2.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ada79b968066a1b5eea0208ccee73eeddfacd0d93f8620e16db24ec7cee55336 +size 2512877088 diff --git a/marvinizer-experimental-v2.i1-IQ2_XS.gguf b/marvinizer-experimental-v2.i1-IQ2_XS.gguf new file mode 100644 index 0000000..88cf648 --- /dev/null +++ b/marvinizer-experimental-v2.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3926f7d851ae533e3486f77c39c8a865278532e1e87552e46d1cbb3a9e2264c2 +size 2322820704 diff --git a/marvinizer-experimental-v2.i1-IQ2_XXS.gguf b/marvinizer-experimental-v2.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..3cce6f7 --- /dev/null +++ b/marvinizer-experimental-v2.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8fdbf7e14061532ec63a28b24a8f6892a061e1cbd4e17911096a5705d78ad1ce +size 2142858848 diff --git a/marvinizer-experimental-v2.i1-IQ3_M.gguf b/marvinizer-experimental-v2.i1-IQ3_M.gguf new file mode 100644 index 0000000..a126681 --- /dev/null +++ b/marvinizer-experimental-v2.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:46c2c0d69a7498b73760d2becefc3015db4466483473d93cb4501cc2c483b260 +size 3468318944 diff --git a/marvinizer-experimental-v2.i1-IQ3_S.gguf b/marvinizer-experimental-v2.i1-IQ3_S.gguf new file mode 100644 index 0000000..f241e81 --- /dev/null +++ b/marvinizer-experimental-v2.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2a63eed1c9c377fa2b6049e0520729aca23de0844b23912b43d3ccce5a1c36c3 +size 3301759200 diff --git a/marvinizer-experimental-v2.i1-IQ3_XS.gguf b/marvinizer-experimental-v2.i1-IQ3_XS.gguf new file mode 100644 index 0000000..7d199d1 --- /dev/null +++ b/marvinizer-experimental-v2.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:51bc0d3a94ed3ec033da9b743ac94b2c0f4189f42a0df96391d19c5662158c2c +size 3149977824 diff --git a/marvinizer-experimental-v2.i1-IQ3_XXS.gguf b/marvinizer-experimental-v2.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..dad1cef --- /dev/null +++ b/marvinizer-experimental-v2.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b634b1984426d54e631cf415d9b8c6dea46ff8f24e4b636f0b631b97f45d829d +size 2901702176 diff --git a/marvinizer-experimental-v2.i1-IQ4_NL.gguf b/marvinizer-experimental-v2.i1-IQ4_NL.gguf new file mode 100644 index 0000000..546f9ab --- /dev/null +++ b/marvinizer-experimental-v2.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a804a2167d839cc407e6a12b4d6f389b664f730c65714f0b53c1b1c2ba7b3c6c +size 4216404896 diff --git a/marvinizer-experimental-v2.i1-IQ4_XS.gguf b/marvinizer-experimental-v2.i1-IQ4_XS.gguf new file mode 100644 index 0000000..54cd13b --- /dev/null +++ b/marvinizer-experimental-v2.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e48e320478108a09342694595b8d745b489c7b3bbc43837f558b1e7e0fea3499 +size 4001194144 diff --git a/marvinizer-experimental-v2.i1-Q2_K.gguf b/marvinizer-experimental-v2.i1-Q2_K.gguf new file mode 100644 index 0000000..c614f8f --- /dev/null +++ b/marvinizer-experimental-v2.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cca98bee67ab2237f7f333b4f3e989e58b16e0de49f012040748c00274ec05b7 +size 2857914656 diff --git a/marvinizer-experimental-v2.i1-Q2_K_S.gguf b/marvinizer-experimental-v2.i1-Q2_K_S.gguf new file mode 100644 index 0000000..5a7bd1b --- /dev/null +++ b/marvinizer-experimental-v2.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f4831bd41a9f6f960bd43dd9edff15ca49bcfb984547b3bebbd1b21e01d11be1 +size 2644594976 diff --git a/marvinizer-experimental-v2.i1-Q3_K_L.gguf b/marvinizer-experimental-v2.i1-Q3_K_L.gguf new file mode 100644 index 0000000..50f64ae --- /dev/null +++ b/marvinizer-experimental-v2.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7a40409b212f913e53aaa997327ab8dab9f6b722d77aec939e6ed5df75bc6781 +size 3950565600 diff --git a/marvinizer-experimental-v2.i1-Q3_K_M.gguf b/marvinizer-experimental-v2.i1-Q3_K_M.gguf new file mode 100644 index 0000000..5eb7d68 --- /dev/null +++ b/marvinizer-experimental-v2.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b9b0764f3978e2d14f5072f4a5ed95ef2ce972037c662272708d3b3c31a062be +size 3651459296 diff --git a/marvinizer-experimental-v2.i1-Q3_K_S.gguf b/marvinizer-experimental-v2.i1-Q3_K_S.gguf new file mode 100644 index 0000000..42e8a5f --- /dev/null +++ b/marvinizer-experimental-v2.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e12a06165d5a58cc957f07c5c7a83ffd499f78f0f6252b4baf2fd63761386dbb +size 3301759200 diff --git a/marvinizer-experimental-v2.i1-Q4_0.gguf b/marvinizer-experimental-v2.i1-Q4_0.gguf new file mode 100644 index 0000000..489edf4 --- /dev/null +++ b/marvinizer-experimental-v2.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:980582196b916f2eda9d0be4320cdf4f00e67949d36186f2a2b82d7367a1eaa1 +size 4227677088 diff --git a/marvinizer-experimental-v2.i1-Q4_1.gguf b/marvinizer-experimental-v2.i1-Q4_1.gguf new file mode 100644 index 0000000..0107de0 --- /dev/null +++ b/marvinizer-experimental-v2.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:93293303553e37f74cea3d4a71fb067bfbd348c0d01d76ad8ba8911cfb5cfc3d +size 4646826400 diff --git a/marvinizer-experimental-v2.i1-Q4_K_M.gguf b/marvinizer-experimental-v2.i1-Q4_K_M.gguf new file mode 100644 index 0000000..5a38ae9 --- /dev/null +++ b/marvinizer-experimental-v2.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d9f0f2e8e1cf3070206bf6c1c61c419f4c236dc61c2814dfc576252ee6405160 +size 4471602080 diff --git a/marvinizer-experimental-v2.i1-Q4_K_S.gguf b/marvinizer-experimental-v2.i1-Q4_K_S.gguf new file mode 100644 index 0000000..9113a14 --- /dev/null +++ b/marvinizer-experimental-v2.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b04efec0307748523b574083dce30e480b99eab0528f03bbf18f956a85975096 +size 4247337888 diff --git a/marvinizer-experimental-v2.i1-Q5_K_M.gguf b/marvinizer-experimental-v2.i1-Q5_K_M.gguf new file mode 100644 index 0000000..d67bf1c --- /dev/null +++ b/marvinizer-experimental-v2.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:08824e3046f6ee050ae5f3c83b33e998122fd127a5cea42e054e75cf7fba2967 +size 5208713120 diff --git a/marvinizer-experimental-v2.i1-Q5_K_S.gguf b/marvinizer-experimental-v2.i1-Q5_K_S.gguf new file mode 100644 index 0000000..12ad107 --- /dev/null +++ b/marvinizer-experimental-v2.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aa0da770936ac05c404778b47d5913d1283e293c36a606e1c573a971c31f9239 +size 5077247904 diff --git a/marvinizer-experimental-v2.i1-Q6_K.gguf b/marvinizer-experimental-v2.i1-Q6_K.gguf new file mode 100644 index 0000000..8284467 --- /dev/null +++ b/marvinizer-experimental-v2.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ee4747e1f37a5881dd705d6c0bd754eaa1c903a29949e76f568d1ad56bfa1275 +size 5991893600 diff --git a/marvinizer-experimental-v2.imatrix.gguf b/marvinizer-experimental-v2.imatrix.gguf new file mode 100644 index 0000000..aadaded --- /dev/null +++ b/marvinizer-experimental-v2.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:714aa92b0b99a0f401d308d9315c6694793d80eee46a18643fef0a215a80482f +size 4589216