commit 969441367aca27ca1f804f1260abd7536e259efd Author: ModelHub XC Date: Wed Apr 22 12:57:33 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..2688067 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_M.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_M.gguf new file mode 100644 index 0000000..c8dba0c --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:03612670d2cc471d4d4ab6067297cb1999b8acd2feb7c04dc9692b00e3529a1f +size 643485728 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_S.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_S.gguf new file mode 100644 index 0000000..48def43 --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:176652b3408a091023e4aed8e4e0a2bfc13a643aeaece952dd0959cf64cfe4d1 +size 639193376 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_M.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_M.gguf new file mode 100644 index 0000000..5405e0d --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5f0ef4de5741cbee42abd011401810d185678b138553521f57a3baaa5e2e08ec +size 669783584 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_S.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_S.gguf new file mode 100644 index 0000000..2a9afb2 --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:799750ff57aaa2c911965b8f446f738b63d435ee555fa0e004365b8fc06926e0 +size 664060448 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XS.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XS.gguf new file mode 100644 index 0000000..2410bc6 --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9f185228001c56294e0cf068be2d31dfe8c82ed3e92a251d55c45aac82db661f +size 657321248 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XXS.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..0c98a00 --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0920fd3c69bbb0b8d31fae1f021b84507f29308130fb0ac8e0e68ad7d6fd5ba0 +size 650639648 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_M.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_M.gguf new file mode 100644 index 0000000..e95b2a8 --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:752cd10af156a27cf22334ff8e81cb443f5c687ba1ee4490328840773a526abe +size 697060640 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_S.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_S.gguf new file mode 100644 index 0000000..b42ad64 --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:efda32b20d325131708f2aad078f2f610e867d56986d74c4bc28600856553194 +size 689814560 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XS.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XS.gguf new file mode 100644 index 0000000..ec9467d --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3b2be99a7f5663caf094bf2fe2b90553770ca0d339aae8577cf833d9538fe86e +size 689814560 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XXS.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..74f33d2 --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eaaf72289778680fa5809ebaaf58d6f8e2562c3ebf1e5f45c07fcedee0da4c86 +size 680110112 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_NL.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_NL.gguf new file mode 100644 index 0000000..bf206dd --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3169c154f0a3312bdfed6d938ea236417255f235bf1dff4cb92e77b03d5b42be +size 721863200 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_XS.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_XS.gguf new file mode 100644 index 0000000..354739b --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aa4b2d3440de4da8c7f8f61d67a2177596acbe95b1eea5fa18ca5d1d787fa842 +size 714435104 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K.gguf new file mode 100644 index 0000000..1cef57b --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:05ec7eddb7ae02cf56d8b8646913ffd4cd2a03a1bdaf5b16398e874127a02454 +size 689814560 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K_S.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K_S.gguf new file mode 100644 index 0000000..e9f24e7 --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e119a76b705198be9285e7972be9850cf4f0fd181abd2116e5c37cec6cb1a3ba +size 671271968 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_L.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_L.gguf new file mode 100644 index 0000000..83f25de --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0eae50ac3cebafc3dc045e7e674bf6cbc0e632270a4b7f464a3040aab6946f8f +size 751575584 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_M.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_M.gguf new file mode 100644 index 0000000..c604d07 --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2c82b415bbe86fe2de49fd0cf7f895fdc4e124fa0052154ef1205722a685ed5a +size 722416160 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_S.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_S.gguf new file mode 100644 index 0000000..42d3ab4 --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1d655d4a06a1ca554592f473c4a4d28bdee969b82e1db2ec6dc398b7bc3ee260 +size 688856096 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_0.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_0.gguf new file mode 100644 index 0000000..5f5b986 --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4222931e7b111b6db9f26548b0d2e92479daf5bab19ccd6fc44bdb4a268b4677 +size 721918496 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_1.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_1.gguf new file mode 100644 index 0000000..beafd62 --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a21820e2a19e658c2e599fc8c61fdb895cb0842bd7a76762a0a1d570ee986b1b +size 764035616 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_M.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_M.gguf new file mode 100644 index 0000000..249898a --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:362e3968a19d6b8be42f02fd341aa0c5994439f1a1a105e5d16583d7203e0d29 +size 806058272 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_S.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_S.gguf new file mode 100644 index 0000000..072d91b --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:96413441b1241964f35ae4f85381d15a1f187f0796afe3e5e3f19991a1a85cf8 +size 780993056 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_M.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_M.gguf new file mode 100644 index 0000000..6d9108b --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0cd81ab66323df7be0c9b21dde8956aa77bcb96d9cd977de40d5957fa783bf43 +size 851345696 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_S.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_S.gguf new file mode 100644 index 0000000..a172ed3 --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eff6e0ba973d0cb89884135dcfdecf28d1d7217edd1e981a7f52bfdc0850a772 +size 836399648 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q6_K.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q6_K.gguf new file mode 100644 index 0000000..1053127 --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0b09379ebf96460873ad5f47cc79c640d3afe3bc5f7d05509cb41d3e343195b1 +size 1011738656 diff --git a/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.imatrix.gguf b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.imatrix.gguf new file mode 100644 index 0000000..092eb9b --- /dev/null +++ b/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b922ce6a1fc3935b07bef88bee5b9a4a516bdc61e01414455258cd1c9d036098 +size 1452416 diff --git a/README.md b/README.md new file mode 100644 index 0000000..3e0dd39 --- /dev/null +++ b/README.md @@ -0,0 +1,84 @@ +--- +base_model: Novaciano/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST +language: +- en +library_name: transformers +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/Novaciano/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_S.gguf) | i1-IQ1_S | 0.7 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_M.gguf) | i1-IQ1_M | 0.7 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.8 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_S.gguf) | i1-IQ3_S | 0.8 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_M.gguf) | i1-IQ3_M | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.8 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.9 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.9 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.9 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +