mradermacher/MUSEG-3B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/MUSEG-3B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-04 03:36:15 +08:00
commit 10854ced74
27 changed files with 220 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MUSEG-3B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
MUSEG-3B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a966bcdac9f707a16bdb620f661924d2a359f90a84e5cfa1887f10f78ff367e
size 850028224

3
MUSEG-3B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ca800e48b4e709f74bc9ccdb9ddf219cd30d9e881a6963cf905332d34771828a
size 791094976

3
MUSEG-3B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ff4b8e390ec1b48dcc38fc0600008d370327dc8559a3fa5c466f6d4ede3c7e5
size 1140516544

3
MUSEG-3B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:14030d96fd4f34ea1854218bcf0dd7e2ec1468ac7aba4fe3bafdbb35eae1d271
size 1061938880

3
MUSEG-3B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7bb0584cf9f745b3566fa5b96cf6a1295b7cda001ef36ba4d61fa6f68f425a3c
size 1031546560

3
MUSEG-3B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:918138412841b38dc1c22d3f86fd1399e24e68ee9c966e18d9e4233b4c3e1ca0
size 948250304

3
MUSEG-3B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3f7823ebeb67bfb39056628b652a53bca5ebd7bd3a12bcf6728ea99f4ceced4
size 1488895680

3
MUSEG-3B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:80599a9f27146a4f37ec32974645b38b367e1998f9575b9f532341b50861b896
size 1456864960

3
MUSEG-3B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5e7534847e54b305d0e1359229eb85bd1ff287f1618dd16abeebc869b9332d3
size 1391836864

3
MUSEG-3B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:60537c00d5f5ecdc92af4f444c3d4cd88b701757f9d4253d6a5859bd84b42354
size 1282827968

3
MUSEG-3B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ab130500e984133bb57c3dd10ec9e9eb2ecc663d8815e332689b90f91d2ed75
size 1825210048

3
MUSEG-3B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ff5f83e3cf12976cc2406bb9cd989f0eb48ec86d24e8f0c9732dc0cda36b0ad
size 1739095744

3
MUSEG-3B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd5e5be5990f458d310b5b9ad2c0ddd51bd9d5ebdffec8a65d0d7888a13128ba
size 1274756800

3
MUSEG-3B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:89edf5408709f01703ce6af1eba2d1c903b408c0c06099a64a10e88dcb50928a
size 1198128832

3
MUSEG-3B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:72828b1a1ef4d1b2fbcb31ba34605a77b0dbc185ff86149d68d98b913782a426
size 1707392704

3
MUSEG-3B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:81d7da8ecf64ae06ef36491c9b96ba61846aefa23230002117742955993d39a2
size 1590476480

3
MUSEG-3B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2d7bbd8b1ae77c3bf26eb77dd1b4dd0deb34391c055f9a7cadec43123353e1f7
size 1454358208

3
MUSEG-3B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e345b8f6a068c3552c42011ce69dfe970ce2968c20563462389d10ab69b625f
size 1828486848

3
MUSEG-3B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:768cf96eae27ea8f4f2aa91abe75410ff6f14b4252e7992325e096ac97411114
size 1996259008

3
MUSEG-3B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d5d525a4fd0dbfc5df13209482e3467e981cd0becacdbf781cf3bb20be47cb57
size 1929903808

3
MUSEG-3B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2ed3a8cb917c2163087d6c51873463bd6e3e4abc2f51309f9aa225dfe065f1d
size 1834385088

3
MUSEG-3B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd235461051c9f2676614095b1d3207321b1c3e98a305f61fe99addc5bbeb894
size 2224815808

3
MUSEG-3B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7bbf4eee13be93addfb4d54d54912b3f669de8c0a608a770941ba6edc9d9ed71
size 2169667264

3
MUSEG-3B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ac581f9ba88212de156be621c8417087bbb621e3204d23edb88c8bf46c70967
size 2538159808

85
README.md Normal file
View File

@@ -0,0 +1,85 @@
---
base_model: Darwin-Project/MUSEG-3B
datasets:
- PolyU-ChenLab/ET-Instruct-164K
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Darwin-Project/MUSEG-3B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#MUSEG-3B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/MUSEG-3B-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/MUSEG-3B-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-IQ2_S.gguf) | i1-IQ2_S | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.3 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-Q2_K.gguf) | i1-Q2_K | 1.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.7 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.8 | |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.9 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-Q4_0.gguf) | i1-Q4_0 | 1.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-Q4_1.gguf) | i1-Q4_1 | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/MUSEG-3B-i1-GGUF/resolve/main/MUSEG-3B.i1-Q6_K.gguf) | i1-Q6_K | 2.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54d688e3d714f455dcf1fd8f51fc06252c06239a6df9ae7f58d8f50fa6adc382
size 3362977