mradermacher/Daichi-Instructed-12B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Daichi-Instructed-12B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-20 12:09:49 +08:00
commit 495cc16457
27 changed files with 218 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Daichi-Instructed-12B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Daichi-Instructed-12B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:358f372f07633cc08dcf5d9442fcd2347bdd97af32691483acf3b0bef0f84ca6
size 3164559264

3
Daichi-Instructed-12B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a9d74aecde3ca4b1c16b044032e943c2125212e91ec6c5b043e78fac87b13732
size 2947245984

3
Daichi-Instructed-12B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:08d542503a70c33d77ca3b90a6d2dd770bb6adb940bb30266769755b2b87fec7
size 4310292384

3
Daichi-Instructed-12B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:840a67c96527807af851473b9a36522d4053966b3e46d0f9d802d0ec46ca6472
size 4020541344

3
Daichi-Instructed-12B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ad01228f735a5eb0c757790276478c19c8b3c1fa26e5772884cc559fdad8f8dd
size 3840092064

3
Daichi-Instructed-12B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:475b109fe28c1d19803a12a7b8dee8146bcefabda2aefe957da6c604a29f8d62
size 3526748064

3
Daichi-Instructed-12B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a46ed7924b57f60aab793714bff10109a8d3e1aaa3f10b323ab9b82efa863715
size 5655521696

3
Daichi-Instructed-12B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3fe73a400e779d9384d78094c4c17c7f535b7063db831e5ffa44ee3e57a8b847
size 5458114976

3
Daichi-Instructed-12B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8c5ac107ee63171b01013ca4fd467e336e967faa6bf25abb954c9ba0a515f03c
size 5205965216

3
Daichi-Instructed-12B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:737443d33ffeec1f43c88eca531204872b6e4265c128b4377bc06cb61442fd72
size 4784732064

3
Daichi-Instructed-12B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e7089ae7dc2e946490d5e65c3661afdb5a3abd2f993e15be21556ae68a01015a
size 6886963616

3
Daichi-Instructed-12B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a2bc739197ecb1671781ec353a5ff4f06fb9754f0d647f6bd145dea8f046e34
size 6550763936

3
Daichi-Instructed-12B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb6d46c81aeb32e241653bfd7584eec0c6e1290805a1e36f6b9b750fed3ca2f9
size 4768020896

3
Daichi-Instructed-12B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6e16d0d88250e6fc47e59fa0cca48d1d2c3fe3c4ea40fc96855edadec33c33a2
size 4448410016

3
Daichi-Instructed-12B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:18cdbe111d07ec1f429c80d1455aab6e134e95dcba5036eccad29969a8c366de
size 6479985056

3
Daichi-Instructed-12B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:986c281c5d84a1222ae0c2d36d9bafff859364563adc3cb68649322a0bc3ec88
size 6008617376

3
Daichi-Instructed-12B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a03a321955554e7072210d59845157a115843cfa3e8bbee027359811ebdb5f2
size 5458114976

3
Daichi-Instructed-12B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:51ae1265cac8d7654e9354e2c50ba7e06269be0588e6fb5655608884adc94eb3
size 6909082016

3
Daichi-Instructed-12B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:520f209b1aa2a9a6917c461b72f3c470e411ee674ddd83b176879ba9379bcde3
size 7559362976

3
Daichi-Instructed-12B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9480dd13a9c7444f8dc2ae2332953aadd7cfe10d5e76a218feac796eb4aa8d21
size 7300577696

3
Daichi-Instructed-12B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd2f4bacadea169d095e8757218af69aeed653ad5b617b434f1932c881f70e47
size 6935132576

3
Daichi-Instructed-12B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5ac400babf892e20609976d75a9e93a48be1fa94b65d7c8b6dcba5a82f8fe9b2
size 8444836256

3
Daichi-Instructed-12B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef6e6466ce25adbcd19393ced9f51f4716e022aae39720db73dbb4f4ac4dbcac
size 8231762336

3
Daichi-Instructed-12B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa737fa79450613b839091883f83034fcc8d21d26872aa6738576b1ebd445029
size 9660610976

83
README.md Normal file
View File

@@ -0,0 +1,83 @@
---
base_model: grimjim/Daichi-Instructed-12B
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- mergekit
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/grimjim/Daichi-Instructed-12B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Daichi-Instructed-12B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Daichi-Instructed-12B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-IQ2_S.gguf) | i1-IQ2_S | 4.1 | |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-IQ2_M.gguf) | i1-IQ2_M | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 4.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-IQ3_S.gguf) | i1-IQ3_S | 5.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-Q4_0.gguf) | i1-Q4_0 | 7.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-Q4_1.gguf) | i1-Q4_1 | 7.7 | |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.3 | |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.5 | |
| [GGUF](https://huggingface.co/mradermacher/Daichi-Instructed-12B-i1-GGUF/resolve/main/Daichi-Instructed-12B.i1-Q6_K.gguf) | i1-Q6_K | 9.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:af5749022614cd87ad99689132b20d9c9dcfd2b6a4c8c717598ad9a76ea619f5
size 7433101