RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-30 06:14:16 +08:00
commit 391d4a6fa3
24 changed files with 200 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
TinyKAI-3B-v0.1.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

77
README.md Normal file
View File

@@ -0,0 +1,77 @@
Quantization made by Richard Erkhov.
[Github](https://github.com/RichardErkhov)
[Discord](https://discord.gg/pvy7H8DZMG)
[Request more models](https://github.com/RichardErkhov/quant_request)
TinyKAI-3B-v0.1 - GGUF
- Model creator: https://huggingface.co/Keynote-Technology/
- Original model: https://huggingface.co/Keynote-Technology/TinyKAI-3B-v0.1/
| Name | Quant method | Size |
| ---- | ---- | ---- |
| [TinyKAI-3B-v0.1.Q2_K.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q2_K.gguf) | Q2_K | 1.84GB |
| [TinyKAI-3B-v0.1.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.IQ3_XS.gguf) | IQ3_XS | 1.84GB |
| [TinyKAI-3B-v0.1.IQ3_S.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.IQ3_S.gguf) | IQ3_S | 1.84GB |
| [TinyKAI-3B-v0.1.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q3_K_S.gguf) | Q3_K_S | 1.84GB |
| [TinyKAI-3B-v0.1.IQ3_M.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.IQ3_M.gguf) | IQ3_M | 1.92GB |
| [TinyKAI-3B-v0.1.Q3_K.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q3_K.gguf) | Q3_K | 1.99GB |
| [TinyKAI-3B-v0.1.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q3_K_M.gguf) | Q3_K_M | 1.99GB |
| [TinyKAI-3B-v0.1.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q3_K_L.gguf) | Q3_K_L | 2.06GB |
| [TinyKAI-3B-v0.1.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.IQ4_XS.gguf) | IQ4_XS | 1.86GB |
| [TinyKAI-3B-v0.1.Q4_0.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q4_0.gguf) | Q4_0 | 1.84GB |
| [TinyKAI-3B-v0.1.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.IQ4_NL.gguf) | IQ4_NL | 1.86GB |
| [TinyKAI-3B-v0.1.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q4_K_S.gguf) | Q4_K_S | 2.24GB |
| [TinyKAI-3B-v0.1.Q4_K.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q4_K.gguf) | Q4_K | 2.4GB |
| [TinyKAI-3B-v0.1.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q4_K_M.gguf) | Q4_K_M | 2.4GB |
| [TinyKAI-3B-v0.1.Q4_1.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q4_1.gguf) | Q4_1 | 2.04GB |
| [TinyKAI-3B-v0.1.Q5_0.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q5_0.gguf) | Q5_0 | 2.23GB |
| [TinyKAI-3B-v0.1.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q5_K_S.gguf) | Q5_K_S | 2.42GB |
| [TinyKAI-3B-v0.1.Q5_K.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q5_K.gguf) | Q5_K | 2.57GB |
| [TinyKAI-3B-v0.1.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q5_K_M.gguf) | Q5_K_M | 2.57GB |
| [TinyKAI-3B-v0.1.Q5_1.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q5_1.gguf) | Q5_1 | 2.42GB |
| [TinyKAI-3B-v0.1.Q6_K.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q6_K.gguf) | Q6_K | 3.39GB |
| [TinyKAI-3B-v0.1.Q8_0.gguf](https://huggingface.co/RichardErkhov/Keynote-Technology_-_TinyKAI-3B-v0.1-gguf/blob/main/TinyKAI-3B-v0.1.Q8_0.gguf) | Q8_0 | 3.39GB |
Original model description:
---
license: apache-2.0
datasets:
- Keynote-Technology/PLANE-2K
- togethercomputer/RedPajama-Data-V2
tags:
- code
- chatbot
- safetensors
---
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6500c7c912c1442d994c36e5/rav-pUPtWF-u-_A4k9RaZ.png)
TinyKAI 3B is a fine-tuned LLM (Large Language Model) based off of [OpenLlama 3B v2](https://huggingface.co/openlm-research/open_llama_3b_v2).
The TinyKAI models are a series of lightweight LLMs under 5 Billion parameters, usually used for research.
## Direct Use
TinyKAI 3B is optimal for research on large language models, specifically the influence of web data on the properties of large language models (fairness, safety, limitations, capabilities, etc.).
## Training
This model was trained on a mixture of the [Falcon refined-web dataset](https://huggingface.co/datasets/tiiuae/falcon-refinedweb), the [StarCoder dataset](https://huggingface.co/datasets/bigcode/starcoderdata) and the wikipedia, arxiv, book and stackexchange part of the [RedPajama dataset](https://huggingface.co/datasets/togethercomputer/RedPajama-Data-1T).
## Banned Use
Production use without adequate assessment of risks and mitigation; any use cases which may be considered irresponsible or harmful or insulting to anyone or any certain group.
TinyKAI-3B is governed by the [apache 2.0 liscense](https://choosealicense.com/licenses/apache-2.0/), and therefore means that whatever the license deems unacceptable shall not be allowed. We specificaly ban the use of [ANY AND ALL KAI MODELS](https://huggingface.co/collections/Keynote-Technology/kai-large-language-models) for hate speech towards a paricular thing, person, our particular group due to [legal](https://www.ftc.gov/news-events/news/press-releases/2022/06/ftc-report-warns-about-using-artificial-intelligence-combat-online-problems) and ethical issues.
## Limitations
TinyKAI 3B is trained on English data only, and will not generate appropriately reasonable content in other languages. Being trained on a representative of the web, it will carry the stereotypes and biases commonly encountered online.
## Recommendations
We recommend users of TinyKAI 3B to consider finetuning it for personal use, and for precautions to be taken for any commercial use.
## WARNING!
This model runs on an older version of transformers, v4.10.0, and therefore may be unstable.

3
TinyKAI-3B-v0.1.IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c370aaed93ae451bded17d064b14d98fb3b4db76e0cf398f63b712898c5b9c25
size 2056852608

3
TinyKAI-3B-v0.1.IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21a76f2d6a6f3e81980a00b6a39f6af757708ff9927ac5ab8f10e555d1818dea
size 1979924608

3
TinyKAI-3B-v0.1.IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:901a8508abca795d362ff90cd8c648735f42cee9c1d6a6563d0e79800bee6419
size 1979924608

3
TinyKAI-3B-v0.1.IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:22f3c17cc4234042c4460c224aed552ba6ab7a3211c7dc2cc5d2c97b716b2a48
size 1995476608

3
TinyKAI-3B-v0.1.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:27a2e99c3bfcd2f61ef1f6b54b357ba60acc5a0bdf07ba19c78c4382058f4868
size 1995476608

3
TinyKAI-3B-v0.1.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bfe4debdad228a9a8624d70636aa66bd875f579cc33de52e03a01ffd42cf5c66
size 1979924608

3
TinyKAI-3B-v0.1.Q3_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb9b92e88075d29cd95335536408b983ffa2ca84d943b7d11fc20c60d2b27813
size 2139348608

3
TinyKAI-3B-v0.1.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b80ed1934653817f8d850db2b8a2cd9df78655eea88a610ad828bdf26a865a9
size 2214548608

3
TinyKAI-3B-v0.1.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb9b92e88075d29cd95335536408b983ffa2ca84d943b7d11fc20c60d2b27813
size 2139348608

3
TinyKAI-3B-v0.1.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:83668555a2e66c506326d359183760dc32ff8a906f5267477777e98f3bd4e257
size 1979924608

3
TinyKAI-3B-v0.1.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:173f95cc15a542f1e1c6c33219c6d56bb23160d144263c8159f1040a7cce8fe5
size 1979924608

3
TinyKAI-3B-v0.1.Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5b1a41cf64d72fef95706698b4d862c2bade47c032c65bf53b4ce7b1f4b4f46
size 2187668608

3
TinyKAI-3B-v0.1.Q4_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:35fb3c31167d78ff73723803f629e3709f4dfc881ce47ce99dc90d98063aa8be
size 2580116608

3
TinyKAI-3B-v0.1.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:35fb3c31167d78ff73723803f629e3709f4dfc881ce47ce99dc90d98063aa8be
size 2580116608

3
TinyKAI-3B-v0.1.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:16f0b54a850e253874179c77e41ad0394f2b3ab97a1ca962f0e69a4414b31858
size 2403156608

3
TinyKAI-3B-v0.1.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:915fc90961715d3aa8fa684c5fc0c3c0a6b846c7d40b9f2ebb97c11ef3d1cb72
size 2395412608

3
TinyKAI-3B-v0.1.Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d43e18e67cfec796c0c457a6b7e359b20fe1c937fd948858899ed3e6f5a5c4e8
size 2603156608

3
TinyKAI-3B-v0.1.Q5_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:473d909bf4ad450f495aab4e00f1a02acdad509ba4fdf7f7e03a57680644c4f1
size 2757076608

3
TinyKAI-3B-v0.1.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:473d909bf4ad450f495aab4e00f1a02acdad509ba4fdf7f7e03a57680644c4f1
size 2757076608

3
TinyKAI-3B-v0.1.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:06c60e12237629849ae36e1e8bbfbf882ba68ab6c08866462e19cfd6debde737
size 2603156608

3
TinyKAI-3B-v0.1.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8420d84b7fce62486f1ec2132a90d0cb5063b1fe10a1c592ad332473d7e436fd
size 3641876608

3
TinyKAI-3B-v0.1.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e6afb3782fcba19b1729c883309e60e6818cf0031c64e662b950249c126a0799
size 3641876608