mradermacher/Tyrant.002-1B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Tyrant.002-1B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-09 14:00:24 +08:00
commit c0acd5a9ff
27 changed files with 227 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Tyrant.002-1B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

92
README.md Normal file
View File

@@ -0,0 +1,92 @@
---
base_model: UmbrellaInc/Tyrant.002-1B
language:
- es
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- 1B
- abliterated
- uncensored
- merge
- not-for-all-audiences
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/UmbrellaInc/Tyrant.002-1B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Tyrant.002-1B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Tyrant.002-1B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.7 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.8 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Tyrant.002-1B-i1-GGUF/resolve/main/Tyrant.002-1B.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
Tyrant.002-1B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e03b84fbb9bd6adfe8175f8887ae7a23c926df9e477bef30242c581f429388ac
size 643485184

3
Tyrant.002-1B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d996aa1fb81d842d0e6c5a9630c99005933e12ca9caf70d9307391ce63f6d08
size 639192832

3
Tyrant.002-1B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc3fd1916c4b50f4795ea22d8ba4fef973768b997c1202d576c9cf7231a6e0b6
size 669783040

3
Tyrant.002-1B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a231cb31df4fc7c34262675a99e0e5c10e1aa40d9dfc4f2c5c5436c7e602365
size 664059904

3
Tyrant.002-1B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4e512934061e4dccf6b25440db89ca08307069b612965fadc6afc197896e2ad5
size 657320704

3
Tyrant.002-1B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:41de5887d15846efd98fa9deddcf95c5a4515bc0ec0b900e80b9c33002a7be86
size 650639104

3
Tyrant.002-1B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5d45958a3d07e2c4ab41540c4a3ef7902324fadebcbe78a325803e99ad5a4d5f
size 697060096

3
Tyrant.002-1B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dfe7010ced66da423438f0df90d2fc76bb03a1ede9c76dfeb138845db2b1de3a
size 689814016

3
Tyrant.002-1B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a895cc6feff69b811a21267e7cd310dbfbc85d88c1b7df5feaddfdac98b1e4b
size 689814016

3
Tyrant.002-1B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dcb9a578e917de2ba5e41300f93f2e0759dd9f85a96beb19c87063b787a92660
size 680109568

3
Tyrant.002-1B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e4e12cd0aea880729839b5be3fd8f62eecde6cd2ef336dda2a0e82643cf50ef
size 721862656

3
Tyrant.002-1B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7cc5199afc3e2ef8b436c82fe80ffec72e8831f14cbd61ee7029f1f42ea98468
size 714434560

3
Tyrant.002-1B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ff5c732eedbda8fb96ac59bee7b71e7348abb4b598eda053f97566b1b459735
size 689814016

3
Tyrant.002-1B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:201f476bd2a5e1599f177e3c655abf4e19a04cf2fc6b7291be20a6baae4b83d5
size 671271424

3
Tyrant.002-1B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dbdfdd571462a01028188bd6ebe39c8c24a69233a03d75e91ed18593851b3f11
size 751575040

3
Tyrant.002-1B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:330cd51fe256c16f4bd74356d231c549821a219a33edddcc87e90111a2db9d4b
size 722415616

3
Tyrant.002-1B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1b2bc0e4b1059d8d9711316d041ba9cc0c43baccc716119dce13d8565cdc1ec7
size 688855552

3
Tyrant.002-1B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba15a8cfe6e2d211244a9922f5400a967a34df96b7aa2ef46f6a956614387583
size 721917952

3
Tyrant.002-1B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e24275ce5e74745d307cea2f0a047e53bcbbb8d8e1d8df879bbc56d74636d82f
size 764035072

3
Tyrant.002-1B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c065e96e6dfa02ddf8391608cfefe5a5a6e1773c25d40b4463da0cee5cf956b3
size 806057728

3
Tyrant.002-1B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:058d007e18f0935687fda5b5b377aa58fca5fb9c6318d082300f93c82ae9e8a6
size 780992512

3
Tyrant.002-1B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c30b935f17e9245c5d1eb9979d7c552959cb4b7e72773ac4d227deb609b17ee3
size 851345152

3
Tyrant.002-1B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:97120410160d959e2a2c586443924f080f41951fce01fe14fc9d4c1218490726
size 836399104

3
Tyrant.002-1B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:235e5a49dc975cf3090e2ffb8d6958f7501c1a6c96f7e42912e9ce079045b8ed
size 1011738112

3
Tyrant.002-1B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba908b9de039ec5a713f8255e3331a16f94f55f73ad61c31a8b9fa5fbdbb3df8
size 1452416