commit fb5c2f013f02cea32d29a41a8ad7a941177b9a63 Author: ModelHub XC Date: Thu Aug 27 00:46:18 2026 +0800 初始化项目,由ModelHub XC社区提供模型 Model: mradermacher/Tema_Q-X-Thinking-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..26d4dd8 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,46 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Tema_Q-X-Thinking.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Tema_Q-X-Thinking.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Tema_Q-X-Thinking.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Tema_Q-X-Thinking.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Tema_Q-X-Thinking.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +Tema_Q-X-Thinking.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Tema_Q-X-Thinking.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Tema_Q-X-Thinking.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Tema_Q-X-Thinking.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Tema_Q-X-Thinking.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Tema_Q-X-Thinking.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..0751738 --- /dev/null +++ b/README.md @@ -0,0 +1,81 @@ +--- +base_model: temaq-org/Tema_Q-X-Thinking +language: +- ja +- en +library_name: transformers +license: gemma +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- deepseek +- qwen +- transformer +- instruction-tuned +- multilingual +- uncensored +- non-censored +- unfiltered +--- +## About + + + + + + + + + +static quants of https://huggingface.co/temaq-org/Tema_Q-X-Thinking + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Tema_Q-X-Thinking-GGUF).*** + +weighted/imatrix quants are available at https://huggingface.co/mradermacher/Tema_Q-X-Thinking-i1-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-Thinking-GGUF/resolve/main/Tema_Q-X-Thinking.Q2_K.gguf) | Q2_K | 5.9 | | +| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-Thinking-GGUF/resolve/main/Tema_Q-X-Thinking.Q3_K_S.gguf) | Q3_K_S | 6.8 | | +| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-Thinking-GGUF/resolve/main/Tema_Q-X-Thinking.Q3_K_M.gguf) | Q3_K_M | 7.4 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-Thinking-GGUF/resolve/main/Tema_Q-X-Thinking.Q3_K_L.gguf) | Q3_K_L | 8.0 | | +| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-Thinking-GGUF/resolve/main/Tema_Q-X-Thinking.IQ4_XS.gguf) | IQ4_XS | 8.3 | | +| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-Thinking-GGUF/resolve/main/Tema_Q-X-Thinking.Q4_K_S.gguf) | Q4_K_S | 8.7 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-Thinking-GGUF/resolve/main/Tema_Q-X-Thinking.Q4_K_M.gguf) | Q4_K_M | 9.1 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-Thinking-GGUF/resolve/main/Tema_Q-X-Thinking.Q5_K_S.gguf) | Q5_K_S | 10.4 | | +| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-Thinking-GGUF/resolve/main/Tema_Q-X-Thinking.Q5_K_M.gguf) | Q5_K_M | 10.6 | | +| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-Thinking-GGUF/resolve/main/Tema_Q-X-Thinking.Q6_K.gguf) | Q6_K | 12.2 | very good quality | +| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-Thinking-GGUF/resolve/main/Tema_Q-X-Thinking.Q8_0.gguf) | Q8_0 | 15.8 | fast, best quality | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. + + diff --git a/Tema_Q-X-Thinking.IQ4_XS.gguf b/Tema_Q-X-Thinking.IQ4_XS.gguf new file mode 100644 index 0000000..1ccceaf --- /dev/null +++ b/Tema_Q-X-Thinking.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c445ce7712b6e46a9bc5725036df18bb0a84798067b49627e0bf3fb5101c3ace +size 8186196128 diff --git a/Tema_Q-X-Thinking.Q2_K.gguf b/Tema_Q-X-Thinking.Q2_K.gguf new file mode 100644 index 0000000..fe60dca --- /dev/null +++ b/Tema_Q-X-Thinking.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6f07b56ddee0f37105d007f70f48b04dcdc967d9bdc93f04a8bc8f1f3502b9b2 +size 5770498208 diff --git a/Tema_Q-X-Thinking.Q3_K_L.gguf b/Tema_Q-X-Thinking.Q3_K_L.gguf new file mode 100644 index 0000000..2a96eb3 --- /dev/null +++ b/Tema_Q-X-Thinking.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:71252b02cff0a0ba83bc4737ed96e653ca7c71aa7af69d2d99026bfe7e2863e3 +size 7924768928 diff --git a/Tema_Q-X-Thinking.Q3_K_M.gguf b/Tema_Q-X-Thinking.Q3_K_M.gguf new file mode 100644 index 0000000..d8abe6c --- /dev/null +++ b/Tema_Q-X-Thinking.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:09c2101b6baa31b5dbc4746d2dbff19c2fe86163ae1ef63346da3e694a116cbb +size 7339204768 diff --git a/Tema_Q-X-Thinking.Q3_K_S.gguf b/Tema_Q-X-Thinking.Q3_K_S.gguf new file mode 100644 index 0000000..a5e2f2b --- /dev/null +++ b/Tema_Q-X-Thinking.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f2bb83c914db91932d3d622f1256d2099097b12a72a7ee4c468e95ce43253c92 +size 6659596448 diff --git a/Tema_Q-X-Thinking.Q4_K_M.gguf b/Tema_Q-X-Thinking.Q4_K_M.gguf new file mode 100644 index 0000000..bacdde2 --- /dev/null +++ b/Tema_Q-X-Thinking.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:79c543dccf77110f0943c850b90fda529b3011381cbfa5d4e5f06fd307a46c69 +size 8988111008 diff --git a/Tema_Q-X-Thinking.Q4_K_S.gguf b/Tema_Q-X-Thinking.Q4_K_S.gguf new file mode 100644 index 0000000..64c9104 --- /dev/null +++ b/Tema_Q-X-Thinking.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fd1848feb85400ee96cb065a7f0f1f84f15854b251195c7362c57562bdf02a08 +size 8573431968 diff --git a/Tema_Q-X-Thinking.Q5_K_M.gguf b/Tema_Q-X-Thinking.Q5_K_M.gguf new file mode 100644 index 0000000..64aa5bf --- /dev/null +++ b/Tema_Q-X-Thinking.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7e4363047b8a2438a8fe877f70badcc68a97c29b878e9d451cafddc7dafb5e65 +size 10508873888 diff --git a/Tema_Q-X-Thinking.Q5_K_S.gguf b/Tema_Q-X-Thinking.Q5_K_S.gguf new file mode 100644 index 0000000..1788728 --- /dev/null +++ b/Tema_Q-X-Thinking.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fd1452451d931faae892dd4d9161a110d4c33f09be9b8ec56414a04b0c7455c4 +size 10266554528 diff --git a/Tema_Q-X-Thinking.Q6_K.gguf b/Tema_Q-X-Thinking.Q6_K.gguf new file mode 100644 index 0000000..a55e1f4 --- /dev/null +++ b/Tema_Q-X-Thinking.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:550e041bcd47a440ba12567259dbcf93e8349e2569fefa389e77d348818d7890 +size 12124684448 diff --git a/Tema_Q-X-Thinking.Q8_0.gguf b/Tema_Q-X-Thinking.Q8_0.gguf new file mode 100644 index 0000000..935e965 --- /dev/null +++ b/Tema_Q-X-Thinking.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ed74a07b262ff47a51fa98bdcf0dae24b11bebeafd57080cd410e043f1b8d1d3 +size 15701598368