mradermacher/Ling-mini-base-2.0-20T-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Ling-mini-base-2.0-20T-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-18 05:42:17 +08:00
commit 8166e98684
20 changed files with 185 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

53
.gitattributes vendored Normal file
View File

@@ -0,0 +1,53 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Ling-mini-base-2.0-20T.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Ling-mini-base-2.0-20T.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:793dea5b7adc5df603cc3a29049f1c0d5a1660cdbf82b3cf2846d053ffead7f5
size 7577052000

3
Ling-mini-base-2.0-20T.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c9c4d77f06902ff58fca88f23060f458e7fb0e6354768e37eac9d14242b96d8e
size 7510623072

3
Ling-mini-base-2.0-20T.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:137d695e6f4a834a880adce0e8a5cebf51932e429128b907c811a22a5979b85b
size 7106397024

3
Ling-mini-base-2.0-20T.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:766f8d88d8885c596cca8c2486dcac819bb38cb367366d3ae4fba6e9f9506f61
size 6701884256

3
Ling-mini-base-2.0-20T.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ea0f621b60a516b28051e5dc84b1a5b4059b65b60bcce51f803eedb9738ae12
size 9735365472

3
Ling-mini-base-2.0-20T.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:44ab285fbaebe9e30850fa9dfdfb9d7d4c14ed74398ab8226f7b1a03ff2abb84
size 9211896672

3
Ling-mini-base-2.0-20T.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e1db2b5cbe923472b8206b6cb4b85e2bf203a90fc5907b50d7d7f58075940e3
size 6366749536

3
Ling-mini-base-2.0-20T.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b857d9f957b77b56f0baf023b29357c433d15a3284b4f1956a2b155de1cefe0f
size 8943108960

3
Ling-mini-base-2.0-20T.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5bb01d45df16afc7fe0828e05478c4a0df6ac2db508b4c76eddae5f1a134bcc4
size 8258388832

3
Ling-mini-base-2.0-20T.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e3b356c926c8e6b94d59cee7620ed71e52620e52dddd10b1d1c39e9c1cb90db
size 7510623072

3
Ling-mini-base-2.0-20T.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a40c80d9b73350fa645ff69812fc359753c755981298b481faa946772e59f2ed
size 9752863584

3
Ling-mini-base-2.0-20T.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f64683cf8a90052f44b2d44c6870c627e0b15be1870f9bfdc9bc2c8ccac91a80
size 10782303072

3
Ling-mini-base-2.0-20T.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:31c38c643f7cdcfc52d7a04b4a38e8358c89f54486fa55c1381a743323017e8e
size 10379871072

3
Ling-mini-base-2.0-20T.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aaf21644bd5e6365403d5fd8d58f5ddc41323573ca6217ccd998db3a943dc440
size 9770361696

3
Ling-mini-base-2.0-20T.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:918002338703f2bc469b950aba4f5a381d9b5ac1b968c8d7470d2ae3d7a766bf
size 12170298208

3
Ling-mini-base-2.0-20T.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21d632f1705e70b26db074d68e0fdf0ee25651811ceaed4e91d6bacd6b4bbec5
size 11829240672

3
Ling-mini-base-2.0-20T.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ca39e417baa237099ca7a5648f37eb64d74b7b9ccf88790c22914ffa557e92e2
size 14053983072

3
Ling-mini-base-2.0-20T.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b7952b94f1d003b1f8e543fc053f5c655796feee136e0897ee2627386c0c0829
size 90609792

78
README.md Normal file
View File

@@ -0,0 +1,78 @@
---
base_model: inclusionAI/Ling-mini-base-2.0-20T
language:
- en
library_name: transformers
license: mit
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/inclusionAI/Ling-mini-base-2.0-20T
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Ling-mini-base-2.0-20T-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.imatrix.gguf) | imatrix | 0.2 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-Q2_K.gguf) | i1-Q2_K | 6.5 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-IQ3_XS.gguf) | i1-IQ3_XS | 7.2 | |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-IQ3_S.gguf) | i1-IQ3_S | 7.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-Q3_K_S.gguf) | i1-Q3_K_S | 7.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-IQ3_M.gguf) | i1-IQ3_M | 7.7 | |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-Q3_K_M.gguf) | i1-Q3_K_M | 8.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-Q3_K_L.gguf) | i1-Q3_K_L | 9.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-IQ4_XS.gguf) | i1-IQ4_XS | 9.3 | |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-IQ4_NL.gguf) | i1-IQ4_NL | 9.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-Q4_0.gguf) | i1-Q4_0 | 9.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-Q4_K_S.gguf) | i1-Q4_K_S | 9.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-Q4_K_M.gguf) | i1-Q4_K_M | 10.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-Q4_1.gguf) | i1-Q4_1 | 10.9 | |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-Q5_K_S.gguf) | i1-Q5_K_S | 11.9 | |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-Q5_K_M.gguf) | i1-Q5_K_M | 12.3 | |
| [GGUF](https://huggingface.co/mradermacher/Ling-mini-base-2.0-20T-i1-GGUF/resolve/main/Ling-mini-base-2.0-20T.i1-Q6_K.gguf) | i1-Q6_K | 14.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->