commit 16e48eddfbe1afa0beab88de8b17f7c63ae07a60 Author: ModelHub XC Date: Thu Jun 18 15:14:17 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/kgrammar-2-1b-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..c220a4a --- /dev/null +++ b/.gitattributes @@ -0,0 +1,47 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +kgrammar-2-1b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +kgrammar-2-1b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +kgrammar-2-1b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +kgrammar-2-1b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +kgrammar-2-1b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +kgrammar-2-1b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +kgrammar-2-1b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +kgrammar-2-1b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +kgrammar-2-1b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +kgrammar-2-1b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +kgrammar-2-1b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +kgrammar-2-1b.f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..c24aa21 --- /dev/null +++ b/README.md @@ -0,0 +1,64 @@ +--- +base_model: davidkim205/kgrammar-2-1b +language: +- ko +library_name: transformers +quantized_by: mradermacher +tags: [] +--- +## About + + + + + + +static quants of https://huggingface.co/davidkim205/kgrammar-2-1b + + +weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion. +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/kgrammar-2-1b-GGUF/resolve/main/kgrammar-2-1b.Q2_K.gguf) | Q2_K | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/kgrammar-2-1b-GGUF/resolve/main/kgrammar-2-1b.Q3_K_S.gguf) | Q3_K_S | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/kgrammar-2-1b-GGUF/resolve/main/kgrammar-2-1b.Q3_K_M.gguf) | Q3_K_M | 0.8 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/kgrammar-2-1b-GGUF/resolve/main/kgrammar-2-1b.Q3_K_L.gguf) | Q3_K_L | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/kgrammar-2-1b-GGUF/resolve/main/kgrammar-2-1b.IQ4_XS.gguf) | IQ4_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/kgrammar-2-1b-GGUF/resolve/main/kgrammar-2-1b.Q4_K_S.gguf) | Q4_K_S | 0.9 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/kgrammar-2-1b-GGUF/resolve/main/kgrammar-2-1b.Q4_K_M.gguf) | Q4_K_M | 0.9 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/kgrammar-2-1b-GGUF/resolve/main/kgrammar-2-1b.Q5_K_S.gguf) | Q5_K_S | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/kgrammar-2-1b-GGUF/resolve/main/kgrammar-2-1b.Q5_K_M.gguf) | Q5_K_M | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/kgrammar-2-1b-GGUF/resolve/main/kgrammar-2-1b.Q6_K.gguf) | Q6_K | 1.1 | very good quality | +| [GGUF](https://huggingface.co/mradermacher/kgrammar-2-1b-GGUF/resolve/main/kgrammar-2-1b.Q8_0.gguf) | Q8_0 | 1.4 | fast, best quality | +| [GGUF](https://huggingface.co/mradermacher/kgrammar-2-1b-GGUF/resolve/main/kgrammar-2-1b.f16.gguf) | f16 | 2.6 | 16 bpw, overkill | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. + + diff --git a/kgrammar-2-1b.IQ4_XS.gguf b/kgrammar-2-1b.IQ4_XS.gguf new file mode 100644 index 0000000..677d565 --- /dev/null +++ b/kgrammar-2-1b.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:75b77571cfb68a9cd2c7ae3467e00e9360480314836f953d8b1cac97e37d4e5c +size 748384256 diff --git a/kgrammar-2-1b.Q2_K.gguf b/kgrammar-2-1b.Q2_K.gguf new file mode 100644 index 0000000..df2f18f --- /dev/null +++ b/kgrammar-2-1b.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9f2faa27c870f90c5e616c164ffd561e0d2a9895bf639c2785bbbc9ca7d67fea +size 580874240 diff --git a/kgrammar-2-1b.Q3_K_L.gguf b/kgrammar-2-1b.Q3_K_L.gguf new file mode 100644 index 0000000..212bb79 --- /dev/null +++ b/kgrammar-2-1b.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:04ade6492a10045d68bcdb894c320da8af84caea5bd7849c8b6867828ad61211 +size 732524544 diff --git a/kgrammar-2-1b.Q3_K_M.gguf b/kgrammar-2-1b.Q3_K_M.gguf new file mode 100644 index 0000000..ccdc982 --- /dev/null +++ b/kgrammar-2-1b.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:33de8f49db1e131a28d8fb4d7586c6ccda27ebee32cb4690be343807f22e2af8 +size 690843648 diff --git a/kgrammar-2-1b.Q3_K_S.gguf b/kgrammar-2-1b.Q3_K_S.gguf new file mode 100644 index 0000000..148c71f --- /dev/null +++ b/kgrammar-2-1b.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b1c9006edd6063e84422a44b06e829af8bc857ebcff8e3b0dc8e271b819f608a +size 641691648 diff --git a/kgrammar-2-1b.Q4_K_M.gguf b/kgrammar-2-1b.Q4_K_M.gguf new file mode 100644 index 0000000..e48139a --- /dev/null +++ b/kgrammar-2-1b.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4af5721c15e9cf1721f841346f80996cbca1c986a03283a79be027b1ab11e38a +size 807694336 diff --git a/kgrammar-2-1b.Q4_K_S.gguf b/kgrammar-2-1b.Q4_K_S.gguf new file mode 100644 index 0000000..9fcde75 --- /dev/null +++ b/kgrammar-2-1b.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9d1a0c5aa41d57cb9043947ca611ef07a8a44f90375b19543294d137fa007edb +size 775647232 diff --git a/kgrammar-2-1b.Q5_K_M.gguf b/kgrammar-2-1b.Q5_K_M.gguf new file mode 100644 index 0000000..e128d53 --- /dev/null +++ b/kgrammar-2-1b.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ce565d48dfd700d41dab9dc9b31aae9f7688ba190e2a09277ea019824bf976b4 +size 911503360 diff --git a/kgrammar-2-1b.Q5_K_S.gguf b/kgrammar-2-1b.Q5_K_S.gguf new file mode 100644 index 0000000..fa3b1b0 --- /dev/null +++ b/kgrammar-2-1b.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1470bfc60e4719b48f32bb943d3c7fa356cc58bea298e24ac47d1eccbeae4000 +size 892563456 diff --git a/kgrammar-2-1b.Q6_K.gguf b/kgrammar-2-1b.Q6_K.gguf new file mode 100644 index 0000000..ab18ab2 --- /dev/null +++ b/kgrammar-2-1b.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7f0ef3bbe5a268235afc8df7295b412a991a696c73695539cec84eab8d1b217e +size 1021800448 diff --git a/kgrammar-2-1b.Q8_0.gguf b/kgrammar-2-1b.Q8_0.gguf new file mode 100644 index 0000000..3ca2f3b --- /dev/null +++ b/kgrammar-2-1b.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2302e2faacfa949557a2a5893bba74dcfad441239569efee1a8ea21725144d16 +size 1321082880 diff --git a/kgrammar-2-1b.f16.gguf b/kgrammar-2-1b.f16.gguf new file mode 100644 index 0000000..c609350 --- /dev/null +++ b/kgrammar-2-1b.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5d829693c59f573422515ca3873c561cde799ee45e811ae50659f5d7329cb1d1 +size 2479595520