commit 520c68ead89e36b5374cf255d8a980319b4dd44a Author: ModelHub XC Date: Sat May 16 03:10:29 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/gemini-3-pro-qwen3-0.6b-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..b78a881 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,47 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +gemini-3-pro-qwen3-0.6b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +gemini-3-pro-qwen3-0.6b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +gemini-3-pro-qwen3-0.6b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +gemini-3-pro-qwen3-0.6b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +gemini-3-pro-qwen3-0.6b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +gemini-3-pro-qwen3-0.6b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +gemini-3-pro-qwen3-0.6b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +gemini-3-pro-qwen3-0.6b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +gemini-3-pro-qwen3-0.6b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +gemini-3-pro-qwen3-0.6b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +gemini-3-pro-qwen3-0.6b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +gemini-3-pro-qwen3-0.6b.f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..7ed5f59 --- /dev/null +++ b/README.md @@ -0,0 +1,74 @@ +--- +base_model: qikp/gemini-3-pro-qwen3-0.6b +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- generated_from_trainer +--- +## About + + + + + + + + + +static quants of https://huggingface.co/qikp/gemini-3-pro-qwen3-0.6b + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gemini-3-pro-qwen3-0.6b-GGUF).*** + +weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion. +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/gemini-3-pro-qwen3-0.6b-GGUF/resolve/main/gemini-3-pro-qwen3-0.6b.Q2_K.gguf) | Q2_K | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/gemini-3-pro-qwen3-0.6b-GGUF/resolve/main/gemini-3-pro-qwen3-0.6b.Q3_K_S.gguf) | Q3_K_S | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/gemini-3-pro-qwen3-0.6b-GGUF/resolve/main/gemini-3-pro-qwen3-0.6b.Q3_K_M.gguf) | Q3_K_M | 0.5 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/gemini-3-pro-qwen3-0.6b-GGUF/resolve/main/gemini-3-pro-qwen3-0.6b.Q3_K_L.gguf) | Q3_K_L | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/gemini-3-pro-qwen3-0.6b-GGUF/resolve/main/gemini-3-pro-qwen3-0.6b.IQ4_XS.gguf) | IQ4_XS | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/gemini-3-pro-qwen3-0.6b-GGUF/resolve/main/gemini-3-pro-qwen3-0.6b.Q4_K_S.gguf) | Q4_K_S | 0.6 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/gemini-3-pro-qwen3-0.6b-GGUF/resolve/main/gemini-3-pro-qwen3-0.6b.Q4_K_M.gguf) | Q4_K_M | 0.6 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/gemini-3-pro-qwen3-0.6b-GGUF/resolve/main/gemini-3-pro-qwen3-0.6b.Q5_K_S.gguf) | Q5_K_S | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/gemini-3-pro-qwen3-0.6b-GGUF/resolve/main/gemini-3-pro-qwen3-0.6b.Q5_K_M.gguf) | Q5_K_M | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/gemini-3-pro-qwen3-0.6b-GGUF/resolve/main/gemini-3-pro-qwen3-0.6b.Q6_K.gguf) | Q6_K | 0.7 | very good quality | +| [GGUF](https://huggingface.co/mradermacher/gemini-3-pro-qwen3-0.6b-GGUF/resolve/main/gemini-3-pro-qwen3-0.6b.Q8_0.gguf) | Q8_0 | 0.9 | fast, best quality | +| [GGUF](https://huggingface.co/mradermacher/gemini-3-pro-qwen3-0.6b-GGUF/resolve/main/gemini-3-pro-qwen3-0.6b.f16.gguf) | f16 | 1.6 | 16 bpw, overkill | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. + + diff --git a/gemini-3-pro-qwen3-0.6b.IQ4_XS.gguf b/gemini-3-pro-qwen3-0.6b.IQ4_XS.gguf new file mode 100644 index 0000000..4d46716 --- /dev/null +++ b/gemini-3-pro-qwen3-0.6b.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3419c01e3cd6bb976fa4d00f5643c798d2833b858b25246732d6543e0a6266df +size 451931744 diff --git a/gemini-3-pro-qwen3-0.6b.Q2_K.gguf b/gemini-3-pro-qwen3-0.6b.Q2_K.gguf new file mode 100644 index 0000000..a0a6c93 --- /dev/null +++ b/gemini-3-pro-qwen3-0.6b.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b6a64880f4d2e70c0e86061a32308dd988de6d508c643d022123411b846be77a +size 347289184 diff --git a/gemini-3-pro-qwen3-0.6b.Q3_K_L.gguf b/gemini-3-pro-qwen3-0.6b.Q3_K_L.gguf new file mode 100644 index 0000000..a45a442 --- /dev/null +++ b/gemini-3-pro-qwen3-0.6b.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7e1b6d8e26c8122ed567fb83f561df2949f9dcfa7056e4a802302937224f4c7d +size 435343968 diff --git a/gemini-3-pro-qwen3-0.6b.Q3_K_M.gguf b/gemini-3-pro-qwen3-0.6b.Q3_K_M.gguf new file mode 100644 index 0000000..7494937 --- /dev/null +++ b/gemini-3-pro-qwen3-0.6b.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7e2858403556dc45bd72da92594bf4506578d259f9f715d3da70fc804323c2c5 +size 413979232 diff --git a/gemini-3-pro-qwen3-0.6b.Q3_K_S.gguf b/gemini-3-pro-qwen3-0.6b.Q3_K_S.gguf new file mode 100644 index 0000000..579c761 --- /dev/null +++ b/gemini-3-pro-qwen3-0.6b.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:312a551dba33dad9fe2d03da84e16baa0c26ac2ae0d15b565afbfb096e6e55f0 +size 389927520 diff --git a/gemini-3-pro-qwen3-0.6b.Q4_K_M.gguf b/gemini-3-pro-qwen3-0.6b.Q4_K_M.gguf new file mode 100644 index 0000000..78f2685 --- /dev/null +++ b/gemini-3-pro-qwen3-0.6b.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:17ccc83a04741e76e908bf87732bb343d1b2fc355fd8bf5cc7c0e798cf817fe4 +size 484220512 diff --git a/gemini-3-pro-qwen3-0.6b.Q4_K_S.gguf b/gemini-3-pro-qwen3-0.6b.Q4_K_S.gguf new file mode 100644 index 0000000..d5d02e8 --- /dev/null +++ b/gemini-3-pro-qwen3-0.6b.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:14ed32011933e488e2474bbe4e9e142b66144087f3333061ac9e33c163878f9e +size 470785632 diff --git a/gemini-3-pro-qwen3-0.6b.Q5_K_M.gguf b/gemini-3-pro-qwen3-0.6b.Q5_K_M.gguf new file mode 100644 index 0000000..eca212c --- /dev/null +++ b/gemini-3-pro-qwen3-0.6b.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c06380bb80c1e828cb71eb5b89e59b14e2fa2bbe2523ba8a14f194e8e99c2035 +size 551378528 diff --git a/gemini-3-pro-qwen3-0.6b.Q5_K_S.gguf b/gemini-3-pro-qwen3-0.6b.Q5_K_S.gguf new file mode 100644 index 0000000..da8fb7f --- /dev/null +++ b/gemini-3-pro-qwen3-0.6b.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6ad8315f3ec7486a2d82dc08eafa4e7a7755ef769c48460b0ceb4de8cf601751 +size 543579744 diff --git a/gemini-3-pro-qwen3-0.6b.Q6_K.gguf b/gemini-3-pro-qwen3-0.6b.Q6_K.gguf new file mode 100644 index 0000000..a8591ad --- /dev/null +++ b/gemini-3-pro-qwen3-0.6b.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:46e3fd4456154749827a1210e3ac7c5f1a6e23b150f1bb4eddcd6a73102d211f +size 622733920 diff --git a/gemini-3-pro-qwen3-0.6b.Q8_0.gguf b/gemini-3-pro-qwen3-0.6b.Q8_0.gguf new file mode 100644 index 0000000..0dd650c --- /dev/null +++ b/gemini-3-pro-qwen3-0.6b.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:71d4bfec170f0a211e1d8d43c80a94ab8d4b9db841b671264c7d078992a99207 +size 804754016 diff --git a/gemini-3-pro-qwen3-0.6b.f16.gguf b/gemini-3-pro-qwen3-0.6b.f16.gguf new file mode 100644 index 0000000..d4f27e4 --- /dev/null +++ b/gemini-3-pro-qwen3-0.6b.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:72c2e19ee9c7d9c11a4b838a7822aa454647bb8a58a7e5418338fdec586e7a7b +size 1509347936