mradermacher/TaskRouter-1.5B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/TaskRouter-1.5B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-07 23:56:12 +08:00
commit 47f760ff5c
27 changed files with 210 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TaskRouter-1.5B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

75
README.md Normal file
View File

@@ -0,0 +1,75 @@
---
base_model: Ricky06662/TaskRouter-1.5B
language:
- en
library_name: transformers
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Ricky06662/TaskRouter-1.5B
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/TaskRouter-1.5B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-Q2_K.gguf) | i1-Q2_K | 0.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-Q4_1.gguf) | i1-Q4_1 | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/TaskRouter-1.5B-i1-GGUF/resolve/main/TaskRouter-1.5B.i1-Q6_K.gguf) | i1-Q6_K | 1.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
TaskRouter-1.5B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f429211e045dfddd1062834d8be0d16d44ac1f8b663812647527ca458b674024
size 541037216

3
TaskRouter-1.5B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:583f8748910664a2ee4940653c3044b476e021426a287d0adc78ed47304947b1
size 513103520

3
TaskRouter-1.5B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bdd78df5907133ec4cac6bb2da6b0e710809fc7e4f76c99a43163054bd738288
size 701332640

3
TaskRouter-1.5B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:754e0422606d059c57ef98e6eb6ebacd2a1b4bcbeefff6d95f9aeb7f8db02f59
size 664087712

3
TaskRouter-1.5B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bb388f1503f9deb95f17bc5c06cfb7160c73cb98c572211563f8fd89fef18406
size 626902688

3
TaskRouter-1.5B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c49a80d7214212225d9454a51b8f2384be80716ecff9479a9cf9ae5396c7cb21
size 587593376

3
TaskRouter-1.5B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f65d0981964382dd3ed2a9bb5e291e54c609314b2620c4bdf69563fc1994b343
size 876941984

3
TaskRouter-1.5B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a690574d35f20686cde00add82cf693f01dc083d560465f544b6dd9e74b8218f
size 862684832

3
TaskRouter-1.5B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b73c8a94d662d04eed8be704ac0866e2b416458786f5ee9f42a3cd2bec939e5
size 831977120

3
TaskRouter-1.5B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bb999e62cc4ab9d1a303770b39a81c16de65f07d81051b8ea74aee6fcc5f57a9
size 769070240

3
TaskRouter-1.5B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd218c85b8aad6663527629ccdc90e090b62e4bac0ed6c91c7cb299bc1f3f8cd
size 1067604128

3
TaskRouter-1.5B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a9764d7bb1a33d1dd041c845819c03801b11b87d9488be5fb8c16ae98df9e4de
size 1019711648

3
TaskRouter-1.5B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3ba791e8e8fdee5c958eb67c86efeaf2058bc3557c114271476695639c82e110
size 752880800

3
TaskRouter-1.5B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5651bdbe9474c2e30d887e5aefafeb233afc7574f78d4d6ef16fbac4c46e1b4f
size 716711072

3
TaskRouter-1.5B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0e9d96badedd9229d3ef21f3aa20b734de43947f848c208cbbf56d5d865e648f
size 980440736

3
TaskRouter-1.5B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a8a463c3e52415300e0d9f16d083829d7c6b53ad4fd3876004aa76a98f85d702
size 924456608

3
TaskRouter-1.5B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c84fe858d145176370fc8dacdf9163d478d149d006ee444ef9e5692abfd648fa
size 861222560

3
TaskRouter-1.5B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:130f5bd2820747b000e0d3c2594cda49a0a5bb151a8bb476d3bb234f338113d9
size 1068808352

3
TaskRouter-1.5B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba2d78cc69f3f22f2555f02b2bd56c8c07d5b44e542077a8e99ac0ded0465aad
size 1162700960

3
TaskRouter-1.5B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ea417844fb62516c2c5fe6cfcdca7cbf4a8cc2fa23cd5874d21bae3af29b410
size 1117321376

3
TaskRouter-1.5B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b4e745670ede772c0e688043f5fe9c26527c976b33d6291009a348904ff2158e
size 1071585440

3
TaskRouter-1.5B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:848544f4c0c98b5ac7b940ef95f7aa03a0a36780f791a12cbfc4fcfc4ff3c632
size 1285494944

3
TaskRouter-1.5B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:71fda5d54d67efba296225dc906fbae2c510eb58b36547b1c5c9da51436e3e56
size 1259174048

3
TaskRouter-1.5B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:00f118343c8850072fc45b27af0f9325eaa8de74a7534ebef8d2a3cc6fc4b9d2
size 1464179360

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6dd6aaea8092124532b1339a0e3542a79582453915eb79ad22032554d3a272eb
size 2042201