mradermacher/Kyro-n1-14B-Chat-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Kyro-n1-14B-Chat-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-15 09:33:13 +08:00
commit 7d78b3c89c
27 changed files with 250 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Kyro-n1-14B-Chat.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Kyro-n1-14B-Chat.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:587a3d28c912df64fa98267d3329682c98817ab192d9354d1b59617f56e9fe71
size 3872308448

3
Kyro-n1-14B-Chat.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:214f10ca9f56972adb9333d4b87e8609e94409f09596189add0aa20c332e3eb7
size 3607993568

3
Kyro-n1-14B-Chat.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f10de2aa7c0d2d881364915ea3a3204104e7b6b9f2dc9bf34d4f30a38d33d29c
size 5356145888

3
Kyro-n1-14B-Chat.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fd0eb149ad93b0f1e58086ce9e09e604f5c62ab8f5f8f4766c1175aa36c0805d
size 5003726048

3
Kyro-n1-14B-Chat.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aff316b69de37aae4a1f167193d601a7198d35ecdc5a949a311f24c86bbd8ed7
size 4704574688

3
Kyro-n1-14B-Chat.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:83e64dcd347cfa2b66f8c1f194f929622d108d28f30f2aab41227e891132aa0c
size 4312833248

3
Kyro-n1-14B-Chat.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6696630720012417d68054069ccfbf5aeb867213768970434f6a65f8e485b612
size 6916537568

3
Kyro-n1-14B-Chat.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:abec3f10dd49f84a0a5327908756cc0ca0cab94492bb362eac7e394bf54e0689
size 6693018848

3
Kyro-n1-14B-Chat.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:40b8290c81f95e5f14fabab7ca0c6969bd88437d804ce448ff3c9ab0022b8abc
size 6383361248

3
Kyro-n1-14B-Chat.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c62479b21e2c6ee056f9f885de8a0f0561fef8f08a67e921f8c27906bf784c0d
size 5946707168

3
Kyro-n1-14B-Chat.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c271d0c26995317841e6470e1f9f5f87ac4e7066b5851625b9a2fd433b427c1b
size 8549182688

3
Kyro-n1-14B-Chat.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4bf73d122496243efd556396d2320f520101ca35317930a0a23e3817a1e1520
size 8119839968

3
Kyro-n1-14B-Chat.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9cad2254537183164ac6abcc14570ad34a89a7038005cbf6fe21dee5e3d00987
size 5770497248

3
Kyro-n1-14B-Chat.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7f3a656b992e3992024eb9402e1bfc102ea2fe29d0d269fc3b066d18f96607a2
size 5397187808

3
Kyro-n1-14B-Chat.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c526c6f34cb3790515686a2d26f990928b523ae7a612ad562eaa9524c1346bc
size 7924767968

3
Kyro-n1-14B-Chat.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e8747e9ebfbaa66c4e22e3b41f73075a100851590f981e9f6f8f34b1a64b6f14
size 7339203808

3
Kyro-n1-14B-Chat.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb7c22d93ea35db4255e194b27900bfd7f95a5e093043794f906ebc9b650fb68
size 6659595488

3
Kyro-n1-14B-Chat.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a1ec5dc656c7d145143687b4fb25f9742e5f1c6f8ac207e71826929b41092bf
size 8544267488

3
Kyro-n1-14B-Chat.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:24985e0621cc04cbe342ecbf9e8238e8af7de6e94c00586208d3d8a7e62eea9b
size 9392139488

3
Kyro-n1-14B-Chat.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:774d3c5c73c3d6b1c1779ae9bda80fb2d6f564caa9312b109b37a776a55d2696
size 8988110048

3
Kyro-n1-14B-Chat.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4409a0bab52477351478c21b129a44d532ef6e486e993e1356600095f1c32ee4
size 8573431008

3
Kyro-n1-14B-Chat.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c12f321155e362cfd36a0f8837586a1481ec59f784b4acc843bee311c615922
size 10508872928

3
Kyro-n1-14B-Chat.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:15b4033c322f7f8f518cb9401619ad806759a8e8b81a2d03de592fe06a75b087
size 10266553568

3
Kyro-n1-14B-Chat.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3eec0a9231062f5789421c9951ccea1d430de26389eff90fb4dd44dcbd085a93
size 12124683488

115
README.md Normal file
View File

@@ -0,0 +1,115 @@
---
base_model: open-neo/Kyro-n1-14B
language:
- en
- zh
- fr
- es
- pt
- de
- it
- ru
- ja
- ko
- vi
- th
- ar
- fa
- he
- tr
- cs
- pl
- hi
- bn
- ur
- id
- ms
- lo
- my
- ceb
- km
- tl
- nl
library_name: transformers
license: mit
quantized_by: mradermacher
tags:
- trl
- Reasoning
- open-llm
- synthetic-data
- Deepseek-R1
- Qwen2.5
- fine-tune
- unsloth
- Conversational
- Agentic
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/open-neo/Kyro-n1-14B
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-IQ1_S.gguf) | i1-IQ1_S | 3.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-IQ1_M.gguf) | i1-IQ1_M | 4.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-IQ2_M.gguf) | i1-IQ2_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-Q2_K.gguf) | i1-Q2_K | 5.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.5 | |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-IQ3_S.gguf) | i1-IQ3_S | 6.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-Q4_0.gguf) | i1-Q4_0 | 8.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.6 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-Q4_1.gguf) | i1-Q4_1 | 9.5 | |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.4 | |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/Kyro-n1-14B-Chat-i1-GGUF/resolve/main/Kyro-n1-14B-Chat.i1-Q6_K.gguf) | i1-Q6_K | 12.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bbaaac5abe16a664617e4546d7cac8de3a40fe99d9322897c62f0ff0e192b29d
size 8563597