mradermacher/MAI_Critical_Thinking-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/MAI_Critical_Thinking-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-21 21:41:41 +08:00
commit 061e9669ab
25 changed files with 207 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

58
.gitattributes vendored Normal file
View File

@@ -0,0 +1,58 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MAI_Critical_Thinking.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
MAI_Critical_Thinking.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e0db11f3f0c1ee8d6893a440aba442c3ca4e06433293cf8599e29b96445cc8c
size 924196384

3
MAI_Critical_Thinking.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f8af429ba48fb3a013fe6d08ea1c0ab1d20bd30c9ea2ab8efa14f9d50f104f27
size 868163104

3
MAI_Critical_Thinking.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17718cebbf22c66a7c266a5ed9f983892ac80147fb58c649923ed1da4cb92bab
size 1229037088

3
MAI_Critical_Thinking.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f0f11daee7a7743a50c1c67c9009f29efe2920166c9f8c77144aafe76edd9e7
size 1154326048

3
MAI_Critical_Thinking.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:af9081bdb8257a774ad21a8ab563cdbf96885094a0cb2c36b8df14dd655944e8
size 1100553760

3
MAI_Critical_Thinking.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c099b9c43a9098de5390b5bf2b4f90c92c09e1a3204d3b9abf86e1032f5760a9
size 1017585184

3
MAI_Critical_Thinking.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:90565d55d632bb18e8d391212c4cd412953425e8dd1980ce471d13b2d94b7138
size 1599673888

3
MAI_Critical_Thinking.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:98392bea3c709f3163199e795dcca2cd5e7c8634efca5c5419653d7d85b43cae
size 1542854176

3
MAI_Critical_Thinking.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9f75ac47e550e5720e55e82f5b929f755e54cb248bb9d3e6109e910a97d2487c
size 1476793888

3
MAI_Critical_Thinking.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3d7806f59f7338fc6fcbac662afc1e81f49738725a764ed0a19ef729a8003c48
size 1348771360

3
MAI_Critical_Thinking.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4e49976e82040ed159cf10c160e1d4d8390a411cbc6c217a8d77879658d83a7c
size 1829115424

3
MAI_Critical_Thinking.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c5926e1c83491d941511d9a487b98134b33b3193ae02b207e96471df25bb5c24
size 1363940896

3
MAI_Critical_Thinking.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:77a08e44670e92a26554dac140f4d69e867ef3af690d500500fb98f48f838b86
size 1274287648

3
MAI_Critical_Thinking.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ccb1bc8b9ade8f5d850ebe8d4ae97006b2cbc18d61ceedb76f240ed737479c6f
size 1815352864

3
MAI_Critical_Thinking.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26ff8c277cdc21aa068d8822ee1272b487f6a0be0b416d8d674b0a1a13772cb9
size 1687164448

3
MAI_Critical_Thinking.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0109947da64e003278237ac1451ee2044a5839bbcd3eba4aaacd6f0bbb9f985e
size 1542854176

3
MAI_Critical_Thinking.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67d70af842209ae5cbba06f84460b1e45536769c624cfdb7f96de22612b4d4bb
size 1921914400

3
MAI_Critical_Thinking.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b5aba5411a2258af1ef562634c5dfd5bcab21dc0cd078bf1732d6e0d99f1535
size 2019382816

3
MAI_Critical_Thinking.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c4d4310cc1e49994fc0964c30638252787566128affdc96003d517e8c514fb2
size 1928205856

3
MAI_Critical_Thinking.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:211870a1fd1cb0ac12ce26fd8f5f25e8b09fa95e9d54be25fbf4b86461b06375
size 2322159136

3
MAI_Critical_Thinking.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df1e0f87399eade89da96a4cc5fb19d543af90ea52ed86ccb27469abe2734ab4
size 2269517344

3
MAI_Critical_Thinking.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a464e9dcc3448510158df9d9c088eede9c4f641cf8b7e84515c949925c2321fe
size 2643858976

80
README.md Normal file
View File

@@ -0,0 +1,80 @@
---
base_model: critical-hf/MAI_phd_ltd
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/critical-hf/MAI_phd_ltd
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/MAI_Critical_Thinking-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-IQ1_S.gguf) | i1-IQ1_S | 1.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-IQ2_S.gguf) | i1-IQ2_S | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-IQ2_M.gguf) | i1-IQ2_M | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-Q2_K.gguf) | i1-Q2_K | 1.5 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-IQ3_S.gguf) | i1-IQ3_S | 1.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-IQ3_M.gguf) | i1-IQ3_M | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.8 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.9 | |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-Q4_0.gguf) | i1-Q4_0 | 2.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/MAI_Critical_Thinking-i1-GGUF/resolve/main/MAI_Critical_Thinking.i1-Q6_K.gguf) | i1-Q6_K | 2.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb8ee5951df4d8a7c78cda56aea797f6f60b980f8080889ea67bf6e70075c841
size 2988377