commit eb99155680991a76cdc3ed69288efb85c302f2b9 Author: ModelHub XC Date: Thu Aug 27 04:10:16 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/TON-3B-CLEVR-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..07ce773 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,49 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +TON-3B-CLEVR.mmproj-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +TON-3B-CLEVR.mmproj-f16.gguf filter=lfs diff=lfs merge=lfs -text +TON-3B-CLEVR.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +TON-3B-CLEVR.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +TON-3B-CLEVR.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +TON-3B-CLEVR.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +TON-3B-CLEVR.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +TON-3B-CLEVR.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +TON-3B-CLEVR.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +TON-3B-CLEVR.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +TON-3B-CLEVR.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +TON-3B-CLEVR.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +TON-3B-CLEVR.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +TON-3B-CLEVR.f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..5fae0d3 --- /dev/null +++ b/README.md @@ -0,0 +1,73 @@ +--- +base_model: kolerk/TON-3B-CLEVR +datasets: +- leonardPKU/clevr_cogen_a_train +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +--- +## About + + + + + + +static quants of https://huggingface.co/kolerk/TON-3B-CLEVR + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#TON-3B-CLEVR-GGUF).*** + +weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion. +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/TON-3B-CLEVR-GGUF/resolve/main/TON-3B-CLEVR.mmproj-Q8_0.gguf) | mmproj-Q8_0 | 0.9 | multi-modal supplement | +| [GGUF](https://huggingface.co/mradermacher/TON-3B-CLEVR-GGUF/resolve/main/TON-3B-CLEVR.mmproj-f16.gguf) | mmproj-f16 | 1.4 | multi-modal supplement | +| [GGUF](https://huggingface.co/mradermacher/TON-3B-CLEVR-GGUF/resolve/main/TON-3B-CLEVR.Q2_K.gguf) | Q2_K | 1.5 | | +| [GGUF](https://huggingface.co/mradermacher/TON-3B-CLEVR-GGUF/resolve/main/TON-3B-CLEVR.Q3_K_S.gguf) | Q3_K_S | 1.7 | | +| [GGUF](https://huggingface.co/mradermacher/TON-3B-CLEVR-GGUF/resolve/main/TON-3B-CLEVR.Q3_K_M.gguf) | Q3_K_M | 1.8 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/TON-3B-CLEVR-GGUF/resolve/main/TON-3B-CLEVR.Q3_K_L.gguf) | Q3_K_L | 1.9 | | +| [GGUF](https://huggingface.co/mradermacher/TON-3B-CLEVR-GGUF/resolve/main/TON-3B-CLEVR.IQ4_XS.gguf) | IQ4_XS | 2.0 | | +| [GGUF](https://huggingface.co/mradermacher/TON-3B-CLEVR-GGUF/resolve/main/TON-3B-CLEVR.Q4_K_S.gguf) | Q4_K_S | 2.1 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/TON-3B-CLEVR-GGUF/resolve/main/TON-3B-CLEVR.Q4_K_M.gguf) | Q4_K_M | 2.2 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/TON-3B-CLEVR-GGUF/resolve/main/TON-3B-CLEVR.Q5_K_S.gguf) | Q5_K_S | 2.5 | | +| [GGUF](https://huggingface.co/mradermacher/TON-3B-CLEVR-GGUF/resolve/main/TON-3B-CLEVR.Q5_K_M.gguf) | Q5_K_M | 2.5 | | +| [GGUF](https://huggingface.co/mradermacher/TON-3B-CLEVR-GGUF/resolve/main/TON-3B-CLEVR.Q6_K.gguf) | Q6_K | 2.9 | very good quality | +| [GGUF](https://huggingface.co/mradermacher/TON-3B-CLEVR-GGUF/resolve/main/TON-3B-CLEVR.Q8_0.gguf) | Q8_0 | 3.7 | fast, best quality | +| [GGUF](https://huggingface.co/mradermacher/TON-3B-CLEVR-GGUF/resolve/main/TON-3B-CLEVR.f16.gguf) | f16 | 6.9 | 16 bpw, overkill | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. + + diff --git a/TON-3B-CLEVR.IQ4_XS.gguf b/TON-3B-CLEVR.IQ4_XS.gguf new file mode 100644 index 0000000..9c83e28 --- /dev/null +++ b/TON-3B-CLEVR.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5bde3dce46d498d9d553dbe889183d9d0e48a1090443916051eb582fe7a42fd5 +size 1918491456 diff --git a/TON-3B-CLEVR.Q2_K.gguf b/TON-3B-CLEVR.Q2_K.gguf new file mode 100644 index 0000000..95fcce3 --- /dev/null +++ b/TON-3B-CLEVR.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fb6b1b5ff7fca6988e124714b51b5777eac9ae6dc9f55d6564d0d50d084b9a25 +size 1376856896 diff --git a/TON-3B-CLEVR.Q3_K_L.gguf b/TON-3B-CLEVR.Q3_K_L.gguf new file mode 100644 index 0000000..88d63c1 --- /dev/null +++ b/TON-3B-CLEVR.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3f8f5ddd3413bb72be75181e506f3a458e5f6d183945eab84f64eadf9ca2e766 +size 1841095488 diff --git a/TON-3B-CLEVR.Q3_K_M.gguf b/TON-3B-CLEVR.Q3_K_M.gguf new file mode 100644 index 0000000..a7ab693 --- /dev/null +++ b/TON-3B-CLEVR.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2c191b2cca5d00aab4585e5c386c6f993616aeea6a82254d33e046d15b750f74 +size 1724179264 diff --git a/TON-3B-CLEVR.Q3_K_S.gguf b/TON-3B-CLEVR.Q3_K_S.gguf new file mode 100644 index 0000000..c1f0a53 --- /dev/null +++ b/TON-3B-CLEVR.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c16ae4b864a2fce138c032e47b5e9ab8384332d1d0e2de0b37de5190b7d7af8e +size 1588060992 diff --git a/TON-3B-CLEVR.Q4_K_M.gguf b/TON-3B-CLEVR.Q4_K_M.gguf new file mode 100644 index 0000000..d0710fa --- /dev/null +++ b/TON-3B-CLEVR.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2dbc33056cdad7cf1e1ff27101983846e9d0ef0a83736c77b1610bc0c993e5c9 +size 2104933184 diff --git a/TON-3B-CLEVR.Q4_K_S.gguf b/TON-3B-CLEVR.Q4_K_S.gguf new file mode 100644 index 0000000..64257a4 --- /dev/null +++ b/TON-3B-CLEVR.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a47172eade067f78178b62be51be2a4a54cdddcd8ee6e906da4cc01067ae386c +size 2009414464 diff --git a/TON-3B-CLEVR.Q5_K_M.gguf b/TON-3B-CLEVR.Q5_K_M.gguf new file mode 100644 index 0000000..f920ddd --- /dev/null +++ b/TON-3B-CLEVR.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:11e065b2303214bbda491b21d5f7fea680e743c3fdc426f1ab87220b94908539 +size 2438740800 diff --git a/TON-3B-CLEVR.Q5_K_S.gguf b/TON-3B-CLEVR.Q5_K_S.gguf new file mode 100644 index 0000000..36f4d99 --- /dev/null +++ b/TON-3B-CLEVR.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:53336dd410f83537b45ec8f95e63dea492127f53e797ad4eebfe356d942cb620 +size 2383592256 diff --git a/TON-3B-CLEVR.Q6_K.gguf b/TON-3B-CLEVR.Q6_K.gguf new file mode 100644 index 0000000..7bd43be --- /dev/null +++ b/TON-3B-CLEVR.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3a0c6c65a44f89626139b0bdababed70b4cc4f8c4926701db6acd28d90fbf965 +size 2793411392 diff --git a/TON-3B-CLEVR.Q8_0.gguf b/TON-3B-CLEVR.Q8_0.gguf new file mode 100644 index 0000000..a3c9af0 --- /dev/null +++ b/TON-3B-CLEVR.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:518bd08f5931a17157470ac33ffa772c96e7d76c0f3459c1ad21865b2307cdd6 +size 3616088896 diff --git a/TON-3B-CLEVR.f16.gguf b/TON-3B-CLEVR.f16.gguf new file mode 100644 index 0000000..a4dfbff --- /dev/null +++ b/TON-3B-CLEVR.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bf09ecf4ecfbb6bb875a2b40a604914eef27b338105e7b6cdd22bc31d8396c7d +size 6800646976 diff --git a/TON-3B-CLEVR.mmproj-Q8_0.gguf b/TON-3B-CLEVR.mmproj-Q8_0.gguf new file mode 100644 index 0000000..33741ae --- /dev/null +++ b/TON-3B-CLEVR.mmproj-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:87b5fd197d6d7ce118e979ba182f127dbf9a85a7f9cccf59aa46564aa55e469b +size 844757696 diff --git a/TON-3B-CLEVR.mmproj-f16.gguf b/TON-3B-CLEVR.mmproj-f16.gguf new file mode 100644 index 0000000..6d98bc0 --- /dev/null +++ b/TON-3B-CLEVR.mmproj-f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:06465f7f9e3843aaac74faafa4457309d909d94a5cc892066ae023d6499d155a +size 1338428096