commit 9f97e0d3ca304ca08e558b2411dfb222b81fcd26 Author: ModelHub XC Date: Fri May 8 22:10:01 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Alice-32B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..33bad4e --- /dev/null +++ b/.gitattributes @@ -0,0 +1,59 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Alice-32B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Alice-32B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Alice-32B.i1-IQ1_M.gguf b/Alice-32B.i1-IQ1_M.gguf new file mode 100644 index 0000000..43e0998 --- /dev/null +++ b/Alice-32B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:46a68d478afb4d44d5da30415278f37e3f33e08975d2505b732bf8fa2637bb10 +size 7959870208 diff --git a/Alice-32B.i1-IQ1_S.gguf b/Alice-32B.i1-IQ1_S.gguf new file mode 100644 index 0000000..62c7494 --- /dev/null +++ b/Alice-32B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0e970ea81e0a30ab996fba9bb18af2c4f6d45199106473455fbdc7c0f5269447 +size 7323843328 diff --git a/Alice-32B.i1-IQ2_M.gguf b/Alice-32B.i1-IQ2_M.gguf new file mode 100644 index 0000000..8c46b12 --- /dev/null +++ b/Alice-32B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:729712c4213546affd5a60a65fa64f2ab16a9675bc4b70078d40bb3f3e68d738 +size 11362862848 diff --git a/Alice-32B.i1-IQ2_S.gguf b/Alice-32B.i1-IQ2_S.gguf new file mode 100644 index 0000000..b8d314c --- /dev/null +++ b/Alice-32B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4707b0acc5b92baf113a1d6646931edde1af85ee4bd9e144e18a49703eb12965 +size 10514827008 diff --git a/Alice-32B.i1-IQ2_XS.gguf b/Alice-32B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..7510318 --- /dev/null +++ b/Alice-32B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1a80f9b562da6beda73f59e26bf9b2e07f9df525a9d0a3c272a29dea55f34b37 +size 9951836928 diff --git a/Alice-32B.i1-IQ2_XXS.gguf b/Alice-32B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..c5c5faf --- /dev/null +++ b/Alice-32B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cff49bc4ef6008e73557a19646572ee6699d87066ecf34f8e826671d13d26f25 +size 9019915008 diff --git a/Alice-32B.i1-IQ3_M.gguf b/Alice-32B.i1-IQ3_M.gguf new file mode 100644 index 0000000..645cb2a --- /dev/null +++ b/Alice-32B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bcf65d038db0e6d10a1738b8a6973b32bfd8b18baafdfbde1993be39eb235177 +size 14930084608 diff --git a/Alice-32B.i1-IQ3_S.gguf b/Alice-32B.i1-IQ3_S.gguf new file mode 100644 index 0000000..4a167e6 --- /dev/null +++ b/Alice-32B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1dc4dd9738cde8efca1343bc13e504006b9c80366c31c13ffbe5b71fd45ea941 +size 14434304768 diff --git a/Alice-32B.i1-IQ3_XS.gguf b/Alice-32B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..68ab265 --- /dev/null +++ b/Alice-32B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:772d2c186b5ff523e5b8a25c7bd82c226a17bb8be00cc817c78ebb46faf72a8e +size 13702923008 diff --git a/Alice-32B.i1-IQ3_XXS.gguf b/Alice-32B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..641a9b9 --- /dev/null +++ b/Alice-32B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2bc1db7ac4c498074ead70db43a0bae4aea9a11680eab3678f350a7b8f3d64d1 +size 12821038848 diff --git a/Alice-32B.i1-IQ4_XS.gguf b/Alice-32B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..01771d4 --- /dev/null +++ b/Alice-32B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:98a4bb7a900eaf5de9166f2641dd86a14f6dbb053f858e96339d2134ebebe7e0 +size 17690496768 diff --git a/Alice-32B.i1-Q2_K.gguf b/Alice-32B.i1-Q2_K.gguf new file mode 100644 index 0000000..b4c7d84 --- /dev/null +++ b/Alice-32B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7273c3b7e9e3d6263a42509e2b8d8c36c0c7514ccd9403dd1688e52c14d24eec +size 12344653568 diff --git a/Alice-32B.i1-Q2_K_S.gguf b/Alice-32B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..a4f0635 --- /dev/null +++ b/Alice-32B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a8811c39d69e0c2dcfa41eb5fd00e2deff6bb7d2d142d4f9e8236e0447de2fd2 +size 11465815808 diff --git a/Alice-32B.i1-Q3_K_L.gguf b/Alice-32B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..a0ccef4 --- /dev/null +++ b/Alice-32B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:235f49d6fe2221b071d91973c9453ee05777da086a4b1447477db621b2d775c7 +size 17330995968 diff --git a/Alice-32B.i1-Q3_K_M.gguf b/Alice-32B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..79b6ed5 --- /dev/null +++ b/Alice-32B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d758a505bc79e85e5e84fc26dbee543f5e55094e3912580c31dc7a35a77f846a +size 15971779328 diff --git a/Alice-32B.i1-Q3_K_S.gguf b/Alice-32B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..707aa96 --- /dev/null +++ b/Alice-32B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1ae8e47caede9fe03ecf75aae2fd5681c52225f0248fe835b650f5ce70afba9f +size 14389740288 diff --git a/Alice-32B.i1-Q4_0.gguf b/Alice-32B.i1-Q4_0.gguf new file mode 100644 index 0000000..10162cb --- /dev/null +++ b/Alice-32B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4938d5db370e519291a8d012e08536c18abe478c80885d910e7ee13b3488928c +size 18703089408 diff --git a/Alice-32B.i1-Q4_1.gguf b/Alice-32B.i1-Q4_1.gguf new file mode 100644 index 0000000..f202c55 --- /dev/null +++ b/Alice-32B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3a0f5a7d0f24ca533c089249422bc9d1e91cafcc62e0763913d41421feb9479f +size 20636524288 diff --git a/Alice-32B.i1-Q4_K_M.gguf b/Alice-32B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..04485a9 --- /dev/null +++ b/Alice-32B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e653f957ffd6bef27683e6e05baf6f46a7e687ea9fd07b40a90656ddfe3d56fc +size 19762151168 diff --git a/Alice-32B.i1-Q4_K_S.gguf b/Alice-32B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..e4572d9 --- /dev/null +++ b/Alice-32B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f844951f4cc7b30a5145ee61bac7041ad97de0e56086aa3329cdacba1aefa96e +size 18771246848 diff --git a/Alice-32B.i1-Q5_K_M.gguf b/Alice-32B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..b4dd3a6 --- /dev/null +++ b/Alice-32B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4c49fa544a11796444b34ff0c815ccbb6f3ff5530995ea7f691f5fde8a2cec35 +size 23214833408 diff --git a/Alice-32B.i1-Q5_K_S.gguf b/Alice-32B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..fd60b77 --- /dev/null +++ b/Alice-32B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c26d99d2fcad1497e63efcc3a04ba6af151e66b7166a9ea5d3dac13fc4cd5874 +size 22635495168 diff --git a/Alice-32B.i1-Q6_K.gguf b/Alice-32B.i1-Q6_K.gguf new file mode 100644 index 0000000..6cb5d1c --- /dev/null +++ b/Alice-32B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d305a237909dcf4a8fb42d02bfbac6d092e690a8a68dbd117f59979426573af9 +size 26883308288 diff --git a/Alice-32B.imatrix.gguf b/Alice-32B.imatrix.gguf new file mode 100644 index 0000000..c430409 --- /dev/null +++ b/Alice-32B.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d7313af91c373d86df2000d264db36c69727ea955936f5faef7dc23c884bc8ff +size 15273216 diff --git a/README.md b/README.md new file mode 100644 index 0000000..dcafdc8 --- /dev/null +++ b/README.md @@ -0,0 +1,89 @@ +--- +base_model: aeon37/Alice-32B +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- heretic +- uncensored +- decensored +- abliterated +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/aeon37/Alice-32B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Alice-32B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Alice-32B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-IQ1_S.gguf) | i1-IQ1_S | 7.4 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-IQ1_M.gguf) | i1-IQ1_M | 8.1 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 9.1 | | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 10.1 | | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-IQ2_S.gguf) | i1-IQ2_S | 10.6 | | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-IQ2_M.gguf) | i1-IQ2_M | 11.5 | | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 11.6 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-Q2_K.gguf) | i1-Q2_K | 12.4 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 12.9 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 13.8 | | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 14.5 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-IQ3_S.gguf) | i1-IQ3_S | 14.5 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-IQ3_M.gguf) | i1-IQ3_M | 15.0 | | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 16.1 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 17.4 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 17.8 | | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-Q4_0.gguf) | i1-Q4_0 | 18.8 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 18.9 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 19.9 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-Q4_1.gguf) | i1-Q4_1 | 20.7 | | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 22.7 | | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 23.3 | | +| [GGUF](https://huggingface.co/mradermacher/Alice-32B-i1-GGUF/resolve/main/Alice-32B.i1-Q6_K.gguf) | i1-Q6_K | 27.0 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +