mradermacher/Tema_Q-X-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Tema_Q-X-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-08 00:43:09 +08:00
commit 7920575ae3
27 changed files with 230 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Tema_Q-X.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

95
README.md Normal file
View File

@@ -0,0 +1,95 @@
---
base_model: temaq-org/Tema_Q-X
language:
- ja
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- gemma2
- gemma
- transformer
- instruction-tuned
- multilingual
- uncensored
- non-censored
- unfiltered
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/temaq-org/Tema_Q-X
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Tema_Q-X-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Tema_Q-X-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-IQ1_S.gguf) | i1-IQ1_S | 2.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-IQ1_M.gguf) | i1-IQ1_M | 2.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-IQ2_S.gguf) | i1-IQ2_S | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-IQ2_M.gguf) | i1-IQ2_M | 3.5 | |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-Q2_K.gguf) | i1-Q2_K | 3.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-IQ3_XS.gguf) | i1-IQ3_XS | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-IQ3_S.gguf) | i1-IQ3_S | 4.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-Q3_K_S.gguf) | i1-Q3_K_S | 4.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-IQ3_M.gguf) | i1-IQ3_M | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-Q3_K_L.gguf) | i1-Q3_K_L | 5.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-IQ4_XS.gguf) | i1-IQ4_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-IQ4_NL.gguf) | i1-IQ4_NL | 5.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-Q4_0.gguf) | i1-Q4_0 | 5.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-Q4_K_S.gguf) | i1-Q4_K_S | 5.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-Q4_1.gguf) | i1-Q4_1 | 6.1 | |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-Q5_K_S.gguf) | i1-Q5_K_S | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/Tema_Q-X-i1-GGUF/resolve/main/Tema_Q-X.i1-Q6_K.gguf) | i1-Q6_K | 7.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
Tema_Q-X.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b18f9c83827b15a93d734e3b5f2b137d9ee056374acff114d80e7a37366b2a75
size 2545952736

3
Tema_Q-X.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4271dda321cddd8d888c7001bdd11d9760c6a2fb6ddd746408b1ddf6c0b99bd
size 2378565600

3
Tema_Q-X.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:167d9e40f4e144517c03486d9f62d6ea376165c86c00de3cd5e7c82e46d6d11c
size 3434670048

3
Tema_Q-X.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:97128d0973b54874025948ce9fc6360553714542f241b9ec193f97db9ed0c560
size 3211487200

3
Tema_Q-X.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a0b7b4fb38b069d92d4f4137cc5ccefdb5735b74f8d30f36d75efd691486334a
size 3067381728

3
Tema_Q-X.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc6191f49df6d0cc1564830ac36d05b11de2938ffd157c70ba8ed09dc0f0d687
size 2824931296

3
Tema_Q-X.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d9d0627b5f7d5b867ce3a6e993e0713c3fc527f488b031936626222474eb7f28
size 4494616544

3
Tema_Q-X.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d1866382cdf150063708f720b1be9c03491c9ad0137cd7b86a92e5c6e9fee4da
size 4337666016

3
Tema_Q-X.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:05aa2fcefe73330f6f7e163890570f77bb9377eea87a70ff792ad68b6e57e946
size 4144990176

3
Tema_Q-X.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:12326ebe5e5bd9ddc0e93074d01d03f1e1db566d35c8d6e948f2d6761df4cc98
size 3796740064

3
Tema_Q-X.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59b2cb0567b1e43d2eb162ebe65c3ee84eeb4d4a9e7ed04d4073ec64a3a4f4cc
size 5443143648

3
Tema_Q-X.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4cb54fd1feb452952693d65bce96e07a26376b503bdc3f0a5121ddee4d454823
size 5183031264

3
Tema_Q-X.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be1391e93f33e0e10ea126db679fd67a8f651dd02214f8a6211450bf637e3720
size 3805399008

3
Tema_Q-X.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5e6404efcf5b87411aa97617a30b25427b9be42a1c1334b90a60d88cb18599af
size 3552511968

3
Tema_Q-X.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df389ac8a870e199c9adf1c76df87f1946bf587a5ce75c6ccdd6ab24743313dd
size 5132453856

3
Tema_Q-X.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:590d645417ca5bcaef9a771d50f8ad2e108998e83410a472f2ca28b1e276aafc
size 4761782240

3
Tema_Q-X.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:43a1b1526b11a17ef75776bf180782ca8f785bdfadeb4d73d283173aafcc7730
size 4337666016

3
Tema_Q-X.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7fac40c5ff1a5cd82d860f58e9c33ff73d58570ca334c834e51f2cc2505c70a9
size 5459199968

3
Tema_Q-X.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:58e84c30f6650cafe52d98cb78313817d893db92128bdb2ea5b8ffe28d61a20b
size 5963368416

3
Tema_Q-X.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:280f1bfce74bfd3f5838a186eaeb6a8ed8a0959fa4e906b4561d743cd09e3b79
size 5761058784

3
Tema_Q-X.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8c36f71c753e425bfa7a2d1b8118bccbd3542699c7699264196334fe5243001d
size 5478926304

3
Tema_Q-X.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9da7ec35d35c996c1b781cb78e51bf69a424c4b1b5808e2c96c54c1e6f61836c
size 6647367648

3
Tema_Q-X.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1842c2e016649f3531756b7b9b38a7e4c27b76f23ec997ee0fa9a60d094d2254
size 6483593184

3
Tema_Q-X.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c8aaf801eaa5acac5c10f7c6ccc78dfa635eb5551873d7053cd7aa5cabf2b4c
size 7589070816

3
Tema_Q-X.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:65162cd162c8e56bb153c331f9f3a7c23cff22bc64f172155f75cebf39d76c4c
size 6152352