commit 63f32c696f04e1b62f40a54cdb4662a30aecdf4c Author: ModelHub XC Date: Sun Sep 27 05:03:17 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..e8882be --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ1_M.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ1_M.gguf new file mode 100644 index 0000000..24befe2 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:43918b8480424d480adb690cdde0083d57022de17693cb9cf547df1e8cff58ad +size 1577263712 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ1_S.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ1_S.gguf new file mode 100644 index 0000000..447bdb9 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2567206b3333a2632faf3b364a33e5fb5f37f061f1ba059c7342be9d60b80e9f +size 1467562592 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_M.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_M.gguf new file mode 100644 index 0000000..7a75e08 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9827dfbca51186ecc7c4d598f19456859feddfaa3c2adaf4f4c6e38410583aa9 +size 2166934112 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_S.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_S.gguf new file mode 100644 index 0000000..a281390 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:642b0dab1a2174df92077fe47412156bc190fa3dc7d443731c6652c5e8a80a7f +size 2020665952 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_XS.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_XS.gguf new file mode 100644 index 0000000..802ac28 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e4ecaafefea6241387f3909a5fb688a03acda6f43bd619f126b1228e211db7bb +size 1924389472 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_XXS.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..f1094a2 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:263c6f30b35ccaaf87d16f4a3457a47bfe4df8151e9030d906403671f98e59c9 +size 1760098912 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_M.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_M.gguf new file mode 100644 index 0000000..5daba65 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6bc41cdabfcf4ea7d06ecc9ce33d3e0b985b5cde7c0f5f0ba58ebca9379ae945 +size 2826971232 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_S.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_S.gguf new file mode 100644 index 0000000..aa6ea3f --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ada0fba113fdde1d49aca433a08326ff405252610ac113660e579d074801d5f9 +size 2730530912 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_XS.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_XS.gguf new file mode 100644 index 0000000..da2e1a0 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:36e50c9598273c6327f2c68c321b07972935d744af37a03bf877137a62b96478 +size 2598680672 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_XXS.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..34afbdb --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a124f7132f6cd01830f70a528f2ea7f452ed6cc4c4578b5ac580a0970cabb3a9 +size 2407410272 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ4_NL.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ4_NL.gguf new file mode 100644 index 0000000..c9fb4c8 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:10e5fb0064af2ef044d4330139423a4fe4f1ea1d51967b6612fa20dde1ddecad +size 3466633312 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ4_XS.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ4_XS.gguf new file mode 100644 index 0000000..fa32a20 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:765a260c27a911824611b31a1e208fb61bdd257b1c24f333a68e16e41ef53f61 +size 3297673312 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q2_K.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q2_K.gguf new file mode 100644 index 0000000..65170a9 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:44d299133bf9d23dff56be486ba38f3e23cd083ac4923019ebabde60dfc0f182 +size 2379094112 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q2_K_S.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q2_K_S.gguf new file mode 100644 index 0000000..c27eb40 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f498acd452e72bd68d206c97860869dedf9eb48ccfe863f251f41c9963d46ab0 +size 2216431712 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q3_K_L.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q3_K_L.gguf new file mode 100644 index 0000000..71b7f04 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:be7e59f5c695483a3727559f3b983a37dfcaba0967d94d15f2d340adc41ee0b8 +size 3250364512 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q3_K_M.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q3_K_M.gguf new file mode 100644 index 0000000..a71ad84 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f7523255917ff3d747d8026db36e4a40ba51c64ef29896460976c4a1d4bfeb24 +size 2999033952 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q3_K_S.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q3_K_S.gguf new file mode 100644 index 0000000..5fd4c7c --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:678902370bdc31836f01aaf7a36453e61af375fcd1a249608baf951e2e423d40 +size 2711382112 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_0.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_0.gguf new file mode 100644 index 0000000..38401a7 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9b9eb5a02c917b2995a1137d2e03d5aa0ff5db0ee43cc66ca0eddfb158b1305c +size 3457949792 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_1.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_1.gguf new file mode 100644 index 0000000..f010b84 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0641f2e6bb801d66a2ee9143ef119e4684d4abf52316f90129ceba6170705a00 +size 3795542112 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_K_M.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_K_M.gguf new file mode 100644 index 0000000..a01e0ea --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b213ddf893f519e6c4028b94bb1e134004c43c0a50dc0466e23d8c53a79bad85 +size 3640211552 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_K_S.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_K_S.gguf new file mode 100644 index 0000000..fa258b4 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d5f2478622719d1dfb21d1316be7013f774738564d0f47dda932d6f3b39e5636 +size 3468599392 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q5_K_M.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q5_K_M.gguf new file mode 100644 index 0000000..e5e0390 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f724ffa6af00508a6630fd10c4463f1fd14e123964182362f997c661aea10bec +size 4241176672 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q5_K_S.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q5_K_S.gguf new file mode 100644 index 0000000..076a051 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b8d148212cfa5887e514ebfe4d486297432b5108c2e47220d77c5bfeb116aa97 +size 4142473312 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q6_K.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q6_K.gguf new file mode 100644 index 0000000..b02f750 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d4d3b0fdbeddf78a3bd4d4a63b591d7b656cdb1d274910e22e8a135ff122cc9f +size 4879702112 diff --git a/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.imatrix.gguf b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.imatrix.gguf new file mode 100644 index 0000000..0cc40e7 --- /dev/null +++ b/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3fb2c1b080f861732a718809b5c9aa6d9473de17370ad5f8fd34e549ba0464f5 +size 5916480 diff --git a/README.md b/README.md new file mode 100644 index 0000000..8d5bb44 --- /dev/null +++ b/README.md @@ -0,0 +1,138 @@ +--- +base_model: DavidAU/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32 +datasets: +- sequelbox/Titanium2.1-DeepSeek-R1 +- sequelbox/Tachibana2-DeepSeek-R1 +- sequelbox/Raiden-DeepSeek-R1 +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- merge +- programming +- code generation +- code +- coding +- coder +- chat +- code +- chat +- brainstorm +- qwen +- qwen3 +- qwencoder +- brainstorm20x +- esper +- esper-3 +- valiant +- valiant-labs +- qwen +- qwen-3 +- qwen-3-4b +- 4b +- reasoning +- code +- code-instruct +- python +- javascript +- dev-ops +- jenkins +- terraform +- scripting +- powershell +- azure +- aws +- gcp +- cloud +- problem-solving +- architect +- engineer +- developer +- creative +- analytical +- expert +- rationality +- conversational +- chat +- instruct +- float32 +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/DavidAU/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32 + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ1_S.gguf) | i1-IQ1_S | 1.6 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ1_M.gguf) | i1-IQ1_M | 1.7 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.9 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.0 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_S.gguf) | i1-IQ2_S | 2.1 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ2_M.gguf) | i1-IQ2_M | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.3 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q2_K.gguf) | i1-Q2_K | 2.5 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.5 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.7 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.8 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_S.gguf) | i1-IQ3_S | 2.8 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ3_M.gguf) | i1-IQ3_M | 2.9 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.1 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.4 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ4_XS.gguf) | i1-IQ4_XS | 3.4 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_0.gguf) | i1-Q4_0 | 3.6 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-IQ4_NL.gguf) | i1-IQ4_NL | 3.6 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_K_S.gguf) | i1-Q4_K_S | 3.6 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_K_M.gguf) | i1-Q4_K_M | 3.7 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q4_1.gguf) | i1-Q4_1 | 3.9 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q5_K_S.gguf) | i1-Q5_K_S | 4.2 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q5_K_M.gguf) | i1-Q5_K_M | 4.3 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-i1-GGUF/resolve/main/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32.i1-Q6_K.gguf) | i1-Q6_K | 5.0 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +