commit 9d33c71956c20a66e7d10a03dc0abb877547bb66 Author: ModelHub XC Date: Fri Jun 19 16:46:22 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..23eddcc --- /dev/null +++ b/.gitattributes @@ -0,0 +1,47 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.IQ4_XS.gguf b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.IQ4_XS.gguf new file mode 100644 index 0000000..ab3bd17 --- /dev/null +++ b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7ce94618780a0a1b07518bf0d5ebcac77fb5ec8f61537fa33f2826d63a0505bb +size 2286312768 diff --git a/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q2_K.gguf b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q2_K.gguf new file mode 100644 index 0000000..25af96e --- /dev/null +++ b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fcbd37ca34320c1c2798e576e7d821aaa2320e376f427fc1f7f5028426f79e87 +size 1669496128 diff --git a/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q3_K_L.gguf b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q3_K_L.gguf new file mode 100644 index 0000000..f941fd5 --- /dev/null +++ b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:68d56c767e01f6f10d669769ddda34136274547364e05a1bddce97d7733bee31 +size 2239782208 diff --git a/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q3_K_M.gguf b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q3_K_M.gguf new file mode 100644 index 0000000..90d3cf4 --- /dev/null +++ b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:99139d7afbb46b40cb92ad5a7854b339eafa5aec9b0ca12fd0841fc3d50f3839 +size 2075614528 diff --git a/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q3_K_S.gguf b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q3_K_S.gguf new file mode 100644 index 0000000..7c96465 --- /dev/null +++ b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eb98dd09a76bb68be1ae0fa1179e4eadd8a98abfe9b5d1fc1aa5e65415526ab8 +size 1886993728 diff --git a/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q4_K_M.gguf b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q4_K_M.gguf new file mode 100644 index 0000000..6093596 --- /dev/null +++ b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dd9a5094d838f3ffda3c11de5b134227e83c27b1307199978b93dfd52047ece3 +size 2497277248 diff --git a/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q4_K_S.gguf b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q4_K_S.gguf new file mode 100644 index 0000000..cc4514c --- /dev/null +++ b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:77bdc36448a2137643d81e2f54e58792fbb85851dc93901ef031ef42b6d185ea +size 2383306048 diff --git a/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q5_K_M.gguf b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q5_K_M.gguf new file mode 100644 index 0000000..2448dfc --- /dev/null +++ b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ca1ae7f49b30b675fc53e6840423c9c6986330039578803a221e114bf977283f +size 2889510208 diff --git a/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q5_K_S.gguf b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q5_K_S.gguf new file mode 100644 index 0000000..7d1f937 --- /dev/null +++ b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:829b56e18b683da394304bfce5fc1f438fbac761af866948d3f103419e5eee8e +size 2823707968 diff --git a/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q6_K.gguf b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q6_K.gguf new file mode 100644 index 0000000..81608c7 --- /dev/null +++ b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:df29a7f5697f0d633e38b58460b18165e2cba2b5c7d5f7c19cd92b395bc2b899 +size 3306257728 diff --git a/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q8_0.gguf b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q8_0.gguf new file mode 100644 index 0000000..6c95dc8 --- /dev/null +++ b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:73981557e07b43e1003e74cbca3b5312ad6637468c43c209de856a76925b7440 +size 4280401728 diff --git a/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.f16.gguf b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.f16.gguf new file mode 100644 index 0000000..f7b8e57 --- /dev/null +++ b/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9244e59842e97d817d56da257190b5752fb1183f645109a0f9e8fcd04b2fc5d2 +size 8051281728 diff --git a/README.md b/README.md new file mode 100644 index 0000000..1f309f6 --- /dev/null +++ b/README.md @@ -0,0 +1,75 @@ +--- +base_model: akseljoonas/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered +datasets: smolagents/codeagent-traces-unfiltered +language: +- en +library_name: transformers +model_name: Agentic-Qwen3-4B-e12-lr4-b2-unfiltered +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- generated_from_trainer +- open-r1 +- trl +- sft +--- +## About + + + + + + +static quants of https://huggingface.co/akseljoonas/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Agentic-Qwen3-4B-e12-lr4-b2-unfiltered-GGUF).*** + +weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion. +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered-GGUF/resolve/main/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q2_K.gguf) | Q2_K | 1.8 | | +| [GGUF](https://huggingface.co/mradermacher/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered-GGUF/resolve/main/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q3_K_S.gguf) | Q3_K_S | 2.0 | | +| [GGUF](https://huggingface.co/mradermacher/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered-GGUF/resolve/main/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q3_K_M.gguf) | Q3_K_M | 2.2 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered-GGUF/resolve/main/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q3_K_L.gguf) | Q3_K_L | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered-GGUF/resolve/main/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.IQ4_XS.gguf) | IQ4_XS | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered-GGUF/resolve/main/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q4_K_S.gguf) | Q4_K_S | 2.5 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered-GGUF/resolve/main/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q4_K_M.gguf) | Q4_K_M | 2.6 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered-GGUF/resolve/main/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q5_K_S.gguf) | Q5_K_S | 2.9 | | +| [GGUF](https://huggingface.co/mradermacher/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered-GGUF/resolve/main/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q5_K_M.gguf) | Q5_K_M | 3.0 | | +| [GGUF](https://huggingface.co/mradermacher/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered-GGUF/resolve/main/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q6_K.gguf) | Q6_K | 3.4 | very good quality | +| [GGUF](https://huggingface.co/mradermacher/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered-GGUF/resolve/main/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.Q8_0.gguf) | Q8_0 | 4.4 | fast, best quality | +| [GGUF](https://huggingface.co/mradermacher/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered-GGUF/resolve/main/Agentic-Qwen3-4B-e12-lr4-b2-unfiltered.f16.gguf) | f16 | 8.2 | 16 bpw, overkill | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. + +