commit 51392fff12d4b5b9f1367cf992d943c3fc8eabbf Author: ModelHub XC Date: Thu Jul 30 06:23:19 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/R1-Router-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..339b6b1 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +R1-Router.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +R1-Router.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/R1-Router.i1-IQ1_M.gguf b/R1-Router.i1-IQ1_M.gguf new file mode 100644 index 0000000..e00c8dd --- /dev/null +++ b/R1-Router.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1947f3745ccd024582e18a047ee4bfc9388c437514d91f308f164d71bd29a661 +size 2042196768 diff --git a/R1-Router.i1-IQ1_S.gguf b/R1-Router.i1-IQ1_S.gguf new file mode 100644 index 0000000..ecd2cdc --- /dev/null +++ b/R1-Router.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:675835843c7e21bd34a338f8f6a8f4556c1cea27e414d013462fd0787dbd8b9a +size 1903668000 diff --git a/R1-Router.i1-IQ2_M.gguf b/R1-Router.i1-IQ2_M.gguf new file mode 100644 index 0000000..1ad42dc --- /dev/null +++ b/R1-Router.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:efb7d38770db7d32add2f1c1ae37755cc0227360e545a5b2c56579faa960ce0a +size 2780343072 diff --git a/R1-Router.i1-IQ2_S.gguf b/R1-Router.i1-IQ2_S.gguf new file mode 100644 index 0000000..92e195f --- /dev/null +++ b/R1-Router.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8f08f9e6336e4f42c467be99d893d1ab52c230ff7fe1dbd02c592368900e3b97 +size 2595638048 diff --git a/R1-Router.i1-IQ2_XS.gguf b/R1-Router.i1-IQ2_XS.gguf new file mode 100644 index 0000000..9887c16 --- /dev/null +++ b/R1-Router.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c83b156bb3817734c0833486eaf162945cf0eeec4cd992021fc0e9552033aa5f +size 2469022496 diff --git a/R1-Router.i1-IQ2_XXS.gguf b/R1-Router.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..9d28931 --- /dev/null +++ b/R1-Router.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6072afd7b9786585d87b8791a84f41772c38ab8ee21c6e83b102e0f5ee10c38d +size 2273078048 diff --git a/R1-Router.i1-IQ3_M.gguf b/R1-Router.i1-IQ3_M.gguf new file mode 100644 index 0000000..81654d0 --- /dev/null +++ b/R1-Router.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2f6359efc02253c0b7b9ac6037e573717a31549ea268604ebce798e90c425896 +size 3574012704 diff --git a/R1-Router.i1-IQ3_S.gguf b/R1-Router.i1-IQ3_S.gguf new file mode 100644 index 0000000..a729fdd --- /dev/null +++ b/R1-Router.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:640648d4f4291736890750a9808f98187a6522f5bedc5b6d7898d35bd5e22beb +size 3499193120 diff --git a/R1-Router.i1-IQ3_XS.gguf b/R1-Router.i1-IQ3_XS.gguf new file mode 100644 index 0000000..90d9f51 --- /dev/null +++ b/R1-Router.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:748a9fe4eeb13da2a805787f5be1bdf350ddc57733c0349da40c9028dd4b68ae +size 3346256672 diff --git a/R1-Router.i1-IQ3_XXS.gguf b/R1-Router.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..29f9f66 --- /dev/null +++ b/R1-Router.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ecc7708d64fe40e4db3421dd17f044a591f24841ab8a34eeb85387aab8f88191 +size 3114515232 diff --git a/R1-Router.i1-IQ4_NL.gguf b/R1-Router.i1-IQ4_NL.gguf new file mode 100644 index 0000000..b4a93cc --- /dev/null +++ b/R1-Router.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:40dc6d86f53f9be406eb84f53b328117502151ed99df2ee1298465945483e89c +size 4437814048 diff --git a/R1-Router.i1-IQ4_XS.gguf b/R1-Router.i1-IQ4_XS.gguf new file mode 100644 index 0000000..e048409 --- /dev/null +++ b/R1-Router.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6c0f43728343a8b9ac0f118b88bcfd487180c1faac85af4f674baff81e29613f +size 4218473248 diff --git a/R1-Router.i1-Q2_K.gguf b/R1-Router.i1-Q2_K.gguf new file mode 100644 index 0000000..452a941 --- /dev/null +++ b/R1-Router.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:824cf098f1b9479fdaa7a6133b2a0f3cf2872770c7f124e53b9874c69c012cdd +size 3015940896 diff --git a/R1-Router.i1-Q2_K_S.gguf b/R1-Router.i1-Q2_K_S.gguf new file mode 100644 index 0000000..ef16190 --- /dev/null +++ b/R1-Router.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:286a3d3f3e1573fd3d1cd259c1451ac4de8d97f9c6ae1b08e11fea3004aedf3f +size 2834074400 diff --git a/R1-Router.i1-Q3_K_L.gguf b/R1-Router.i1-Q3_K_L.gguf new file mode 100644 index 0000000..90b120f --- /dev/null +++ b/R1-Router.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:05e1d549883fead798f6f1fb306bd42bfd4d00931d7b7ec187d66814dc3eaf1f +size 4088460064 diff --git a/R1-Router.i1-Q3_K_M.gguf b/R1-Router.i1-Q3_K_M.gguf new file mode 100644 index 0000000..508ade9 --- /dev/null +++ b/R1-Router.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6644670552c4c9aae878ed25e7fc113752e945230a1b462e7073bb93a061e4e0 +size 3808391968 diff --git a/R1-Router.i1-Q3_K_S.gguf b/R1-Router.i1-Q3_K_S.gguf new file mode 100644 index 0000000..38389ec --- /dev/null +++ b/R1-Router.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:56bae93198751bcb641b56fc40783b85259f425f35648b573892995bac276e1f +size 3492369184 diff --git a/R1-Router.i1-Q4_0.gguf b/R1-Router.i1-Q4_0.gguf new file mode 100644 index 0000000..e93c636 --- /dev/null +++ b/R1-Router.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:10b946e6d96699c457bc7274499a51f5eaf34badbf3c7c1dff9e67af733ca468 +size 4444121888 diff --git a/R1-Router.i1-Q4_1.gguf b/R1-Router.i1-Q4_1.gguf new file mode 100644 index 0000000..1a23ad5 --- /dev/null +++ b/R1-Router.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bb42b598fc45e7cbb276fab93a595bc02f59d8af84413ad428e5477caa3a88ed +size 4873284384 diff --git a/R1-Router.i1-Q4_K_M.gguf b/R1-Router.i1-Q4_K_M.gguf new file mode 100644 index 0000000..c9dd21b --- /dev/null +++ b/R1-Router.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0eb56552a67b9de03db6f9bc9712a33efbcf698cbfd343d0557e33f3ab800063 +size 4683074336 diff --git a/R1-Router.i1-Q4_K_S.gguf b/R1-Router.i1-Q4_K_S.gguf new file mode 100644 index 0000000..5a3e42f --- /dev/null +++ b/R1-Router.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c64df1925306d91a07e4c2e7bc270195953ffd72e8eb96e978d6746869fa729b +size 4457769760 diff --git a/R1-Router.i1-Q5_K_M.gguf b/R1-Router.i1-Q5_K_M.gguf new file mode 100644 index 0000000..c6cae2d --- /dev/null +++ b/R1-Router.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:53c3a774a7b0f666fd9cc1730016a134a6ed68a7dd688f5ffb7db83037b63e0f +size 5444832032 diff --git a/R1-Router.i1-Q5_K_S.gguf b/R1-Router.i1-Q5_K_S.gguf new file mode 100644 index 0000000..3f85225 --- /dev/null +++ b/R1-Router.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a668ebcf2c2035935bed609516e2b20f1188f89a326c7cf4d617963a8e6e2bdc +size 5315177248 diff --git a/R1-Router.i1-Q6_K.gguf b/R1-Router.i1-Q6_K.gguf new file mode 100644 index 0000000..d2dfe0b --- /dev/null +++ b/R1-Router.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4602a79a802c99d60364be1be04f2cccc035cdb763593c2e3211a392e5340a71 +size 6254199584 diff --git a/R1-Router.imatrix.gguf b/R1-Router.imatrix.gguf new file mode 100644 index 0000000..de14f2a --- /dev/null +++ b/R1-Router.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6e42ba12b409416b624aee9040c637ed3b19bf99db0de3c68bbc08fe49d05f6c +size 4560352 diff --git a/README.md b/README.md new file mode 100644 index 0000000..393991a --- /dev/null +++ b/README.md @@ -0,0 +1,87 @@ +--- +base_model: hmhm1229/MoRE +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/hmhm1229/MoRE + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#R1-Router-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/R1-Router-GGUF + +**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/R1-Router-GGUF).** +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-IQ1_S.gguf) | i1-IQ1_S | 2.0 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-IQ1_M.gguf) | i1-IQ1_M | 2.1 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.6 | | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-IQ2_S.gguf) | i1-IQ2_S | 2.7 | | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-IQ2_M.gguf) | i1-IQ2_M | 2.9 | | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.9 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-Q2_K.gguf) | i1-Q2_K | 3.1 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.2 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.4 | | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.6 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-IQ3_S.gguf) | i1-IQ3_S | 3.6 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-IQ3_M.gguf) | i1-IQ3_M | 3.7 | | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.9 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.2 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.3 | | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.5 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-Q4_0.gguf) | i1-Q4_0 | 4.5 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.6 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-Q4_1.gguf) | i1-Q4_1 | 5.0 | | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.4 | | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.5 | | +| [GGUF](https://huggingface.co/mradermacher/R1-Router-i1-GGUF/resolve/main/R1-Router.i1-Q6_K.gguf) | i1-Q6_K | 6.4 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +