mradermacher/Qwen-BioTool-1.5B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen-BioTool-1.5B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-08 03:25:17 +08:00
commit 215811e5dd
27 changed files with 230 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-BioTool-1.5B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen-BioTool-1.5B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac5d56908bbce2472c56ef64133d03269072ce2c9bf370720df5fc4959051662
size 464462272

3
Qwen-BioTool-1.5B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f56c26957c32adc52c2623d042be5b24499cd5d0f0018101ba8d4524e3b41831
size 436528576

3
Qwen-BioTool-1.5B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:302b6113d3d03971900f7a1fd8c1a9b1ab7a13a4f57206a21e090a0b68246aea
size 601055680

3
Qwen-BioTool-1.5B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ef15f24a5c9a330b87b7ac69aa3a875d0322c452fbff42ed40132ff4bf47e60
size 563810752

3
Qwen-BioTool-1.5B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cfa22fa2ec2f436175eb6b62c18b5e80c74bc9aaf82aed15d282e9ddb8053986
size 550327744

3
Qwen-BioTool-1.5B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:35be508d14fc121867e20ccecdac79ec2a9bacffad655851cccf3839d8f78229
size 511018432

3
Qwen-BioTool-1.5B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0d4b404fe9f5bb43dd2dc08acd1930da7442d057e0d213921e0654e0e0c7f225
size 776665024

3
Qwen-BioTool-1.5B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc48ef8da0304c45467140ae431ddfc47731a87d51bb1cdf8b40fb7c1ca01d58
size 762407872

3
Qwen-BioTool-1.5B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:13f6b0e69f4313752e2d6e6444add05484d30759ab9b8e32ed505cf323d7cb20
size 731700160

3
Qwen-BioTool-1.5B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f0a28628d6a4c50ad1142a92aac9a3afb2285e121901b87d973e41acccfb5db6
size 668793280

3
Qwen-BioTool-1.5B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5387688449c23cf0a7c8c4814b763bbc440a2e4c24fb645ff7412084f6a5e283
size 936332224

3
Qwen-BioTool-1.5B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:440f6904fe7757a2b5d7be6d8d7022ef36306d5d04c3df1e321447ebaf63050b
size 895732672

3
Qwen-BioTool-1.5B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3ded2e8025caf63496295ed24d0dacf723822d8d112e04891064697ea1ce7823
size 676305856

3
Qwen-BioTool-1.5B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:978673a6606276452746aeb290ee34f7ebdc12ca542e0112d59e4d34e6c09a88
size 640136128

3
Qwen-BioTool-1.5B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1f76be84cc1e7f5969f97a102e911f882be5313e367ab4ef05030f28f13805a0
size 880163776

3
Qwen-BioTool-1.5B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4148f455b32b785ae85b56cbc68004f7c54fa10f7d3f1e606225444b80ca2374
size 824179648

3
Qwen-BioTool-1.5B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1b6be7aa19583f745bdf50c717e36fe2f9c1f756446ef6fae164c70cc7b323fd
size 760945600

3
Qwen-BioTool-1.5B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2cb42abf9cebcbf002c989737a22c08340280e1a13672a73cf2280a3e184d40c
size 937536448

3
Qwen-BioTool-1.5B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2601109a357cb0328d5bbe997fba77ed2c62b148c77856ebb526d1e1f7cdae3b
size 1016843200

3
Qwen-BioTool-1.5B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:720cb14a235ed867fbecef2da49ce816de4eb5572f85eac26c695a9433252313
size 986049472

3
Qwen-BioTool-1.5B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4b134d51989e7653ef1c94f7a7d45e17cb258aa26414012763d1f00abb5ecc6e
size 940313536

3
Qwen-BioTool-1.5B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d5dc0063185fb8776f63ea6739802d26966e996d025ea6564180071fd9858605
size 1125051328

3
Qwen-BioTool-1.5B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:90a4320561be75a42f85dd971286e1752c3aec5093265ee1e58b6f2a12eb1cce
size 1098730432

3
Qwen-BioTool-1.5B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a3ae46d8470b4150b0fd9a5716c76ce50428fdcc1755d9777a46c388740a490d
size 1272740800

3
Qwen-BioTool-1.5B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5e988731b747bf6b5bcb8bd871257b5bdf52b8f14edd295f8ec7acfac62b1a0f
size 2065888

95
README.md Normal file
View File

@@ -0,0 +1,95 @@
---
base_model: Rumiii/Qwen-BioTool-1.5B
datasets:
- gxx27/BioTool
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- qwen2
- function-calling
- tool-use
- biomedical
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Rumiii/Qwen-BioTool-1.5B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen-BioTool-1.5B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-Q4_0.gguf) | i1-Q4_0 | 1.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-Q4_1.gguf) | i1-Q4_1 | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-BioTool-1.5B-i1-GGUF/resolve/main/Qwen-BioTool-1.5B.i1-Q6_K.gguf) | i1-Q6_K | 1.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->