mradermacher/miscii-14b-1225-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/miscii-14b-1225-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-18 20:51:23 +08:00
commit e234c01d0a
27 changed files with 233 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
miscii-14b-1225.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

98
README.md Normal file
View File

@@ -0,0 +1,98 @@
---
base_model: sthenno-com/miscii-14b-1225
language:
- zho
- eng
- fra
- spa
- por
- deu
- ita
- rus
- jpn
- kor
- vie
- tha
- ara
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- mergekit
- merge
- custom-research
- miscii
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/sthenno-com/miscii-14b-1225
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#miscii-14b-1225-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/miscii-14b-1225-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-IQ1_S.gguf) | i1-IQ1_S | 3.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-IQ1_M.gguf) | i1-IQ1_M | 4.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-IQ2_M.gguf) | i1-IQ2_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-Q2_K.gguf) | i1-Q2_K | 5.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.5 | |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-IQ3_S.gguf) | i1-IQ3_S | 6.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-Q4_0.gguf) | i1-Q4_0 | 8.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.6 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-Q4_1.gguf) | i1-Q4_1 | 9.5 | |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.4 | |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/miscii-14b-1225-i1-GGUF/resolve/main/miscii-14b-1225.i1-Q6_K.gguf) | i1-Q6_K | 12.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef75a7188e4f4fb39ce60f3c4dc5325242ed90feefd759b172efed0e316e39de
size 8563597

3
miscii-14b-1225.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4217a95dcf5ab4bc140f10d9a8b0f6d33f8702f3e6a1a11bead356599172b2a
size 3870223360

3
miscii-14b-1225.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e94b515486a22bf127fd161f729d98a7f1d184dd13aefbc004af3653725d6fb2
size 3605908480

3
miscii-14b-1225.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bcbb3d45aba08ee2865911e8076ef4ce59dc9654f1ffd4695ed442ffdd03de62
size 5353853312

3
miscii-14b-1225.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3be43dbe86d8b7897b1324d77fdc3f632aed5b0e7e450329ca640b501027c357
size 5001433472

3
miscii-14b-1225.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ba96b547e1bff3dfa11ce06b9835293eb7f929ad4ace4246c9753dd457eb50c
size 4702489600

3
miscii-14b-1225.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d8076c390ad6ca5af967f06c3ed6974a259185a4e73249e4ebd14576df584f7f
size 4310748160

3
miscii-14b-1225.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ebe93ca49fca1529d4ce008df25c85a856f68dfdf411cbf9722f1929651a240a
size 6913973696

3
miscii-14b-1225.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:545b9dda9f180960fcf54c768146becd314afd24ee8f97e0436967984668c63c
size 6690454976

3
miscii-14b-1225.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9f7afb816b98249780b51242bf78f4f05308f686cfc038085b47a7a1441b4645
size 6380797376

3
miscii-14b-1225.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:29d07a4b25b035ede3be589e544eec83abd28f7ce8d8d7de9d6749d89e675688
size 5944414592

3
miscii-14b-1225.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da5cfdf35d8af89a8ac4d73db54f84e1f0c0109ec8dc6baf8a1a643da213fc00
size 8546347488

3
miscii-14b-1225.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed93c6282c2c67998cfdebf3a98b19baefe30f1e0659f030a36b5d3276d061fd
size 8117068608

3
miscii-14b-1225.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59fa1cfbd78ca83e3cdacb0acbe91d7ea030b043e53ff58f52f9c5465ee02748
size 5768140864

3
miscii-14b-1225.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7eead4ca8670a8da7070b881953d723dc3cb6c07faed2d3b0b647a155f98c506
size 5394831424

3
miscii-14b-1225.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5bdca19489f2ae4aa342b130fc6e578ad237e04c5dd107fc11765fa8dd1e1cf1
size 7922204096

3
miscii-14b-1225.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c4b8cb745122ee7664b59e977520f92c695d50750e26ab546f609dda5cbd9c3
size 7336639936

3
miscii-14b-1225.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d7e9c2b27101a907d48186f36389b5479df96bc9d93a25b02aebca3d9de60170
size 6657031616

3
miscii-14b-1225.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:64970e2488a6226cc3e99448801fddf5d92f0dcddd9b1d424a290918a45c3d6e
size 8541432288

3
miscii-14b-1225.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:23f5df918cfbba4ff995b6c39d1a347b356769ed26b2914a85e084bb2eff8cf5
size 9389176608

3
miscii-14b-1225.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:55b23dc7e2e2bf953eaf439845c003be2b5181961d927f7d6f7ccd158f5d7915
size 8985274848

3
miscii-14b-1225.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7429072e75e2159518138b494ab6b5b24ecff1b25a73f569bbe44d087f24ab4
size 8570595808

3
miscii-14b-1225.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a45e1d4f9800c5b89adc05b4935d0bc2e9a50c99d7f2e5129936e1e41fdc1754
size 10505782368

3
miscii-14b-1225.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7b0342e68f956505eb3a50d186c42e02dc333056845f2e165d8f921ed11b69e
size 10263463008

3
miscii-14b-1225.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b595cd2ecb0ff717796e750026984bcac2af8f4f7588a9502510ea6e43bd9d9
size 12121321632