mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-22 12:57:33 +08:00
commit 969441367a
27 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:03612670d2cc471d4d4ab6067297cb1999b8acd2feb7c04dc9692b00e3529a1f
size 643485728

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:176652b3408a091023e4aed8e4e0a2bfc13a643aeaece952dd0959cf64cfe4d1
size 639193376

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f0ef4de5741cbee42abd011401810d185678b138553521f57a3baaa5e2e08ec
size 669783584

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:799750ff57aaa2c911965b8f446f738b63d435ee555fa0e004365b8fc06926e0
size 664060448

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9f185228001c56294e0cf068be2d31dfe8c82ed3e92a251d55c45aac82db661f
size 657321248

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0920fd3c69bbb0b8d31fae1f021b84507f29308130fb0ac8e0e68ad7d6fd5ba0
size 650639648

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:752cd10af156a27cf22334ff8e81cb443f5c687ba1ee4490328840773a526abe
size 697060640

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:efda32b20d325131708f2aad078f2f610e867d56986d74c4bc28600856553194
size 689814560

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b2be99a7f5663caf094bf2fe2b90553770ca0d339aae8577cf833d9538fe86e
size 689814560

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eaaf72289778680fa5809ebaaf58d6f8e2562c3ebf1e5f45c07fcedee0da4c86
size 680110112

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3169c154f0a3312bdfed6d938ea236417255f235bf1dff4cb92e77b03d5b42be
size 721863200

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa4b2d3440de4da8c7f8f61d67a2177596acbe95b1eea5fa18ca5d1d787fa842
size 714435104

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:05ec7eddb7ae02cf56d8b8646913ffd4cd2a03a1bdaf5b16398e874127a02454
size 689814560

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e119a76b705198be9285e7972be9850cf4f0fd181abd2116e5c37cec6cb1a3ba
size 671271968

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0eae50ac3cebafc3dc045e7e674bf6cbc0e632270a4b7f464a3040aab6946f8f
size 751575584

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c82b415bbe86fe2de49fd0cf7f895fdc4e124fa0052154ef1205722a685ed5a
size 722416160

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1d655d4a06a1ca554592f473c4a4d28bdee969b82e1db2ec6dc398b7bc3ee260
size 688856096

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4222931e7b111b6db9f26548b0d2e92479daf5bab19ccd6fc44bdb4a268b4677
size 721918496

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a21820e2a19e658c2e599fc8c61fdb895cb0842bd7a76762a0a1d570ee986b1b
size 764035616

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:362e3968a19d6b8be42f02fd341aa0c5994439f1a1a105e5d16583d7203e0d29
size 806058272

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:96413441b1241964f35ae4f85381d15a1f187f0796afe3e5e3f19991a1a85cf8
size 780993056

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0cd81ab66323df7be0c9b21dde8956aa77bcb96d9cd977de40d5957fa783bf43
size 851345696

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eff6e0ba973d0cb89884135dcfdecf28d1d7217edd1e981a7f52bfdc0850a772
size 836399648

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0b09379ebf96460873ad5f47cc79c640d3afe3bc5f7d05509cb41d3e343195b1
size 1011738656

3
GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b922ce6a1fc3935b07bef88bee5b9a4a516bdc61e01414455258cd1c9d036098
size 1452416

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: Novaciano/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Novaciano/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_S.gguf) | i1-IQ1_S | 0.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ1_M.gguf) | i1-IQ1_M | 0.7 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_S.gguf) | i1-IQ3_S | 0.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ3_M.gguf) | i1-IQ3_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.8 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST-i1-GGUF/resolve/main/GLM-4.7-TrashFlash-Think.Sorete-1B-TEST.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->