mradermacher/ChatMusician-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/ChatMusician-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-30 21:13:18 +08:00
commit 416983228e
27 changed files with 211 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
ChatMusician.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
ChatMusician.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:93b5e2e91a5e6e8299af95a0947da824e787674c7a4ff43d2459f74d91b26c84
size 1650971520

3
ChatMusician.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:01fc8d22ba3df86095ac016bfd536ddb7293f938f4e7c74af471aea460027104
size 1528583040

3
ChatMusician.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d8f3db74641c769f0c983fad7e8bcf4a97edf74b36ba7bf20f700b71238ba334
size 2359751552

3
ChatMusician.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ead7dcf8b9d1a81cc08a4d9b50b736dde264754ce65b48ba01edf08a919f3266
size 2196566912

3
ChatMusician.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e5cdcda381b77a3d42f179dcdd3df0c5f974b14aa84d024bfa3310e5781c5fed
size 2034914176

3
ChatMusician.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:24ced4e9c7a87fa0f71bc5fe893093cf1864ee71b544fd0524ec9ba56094468c
size 1854952320

3
ChatMusician.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:70e378006ddb0c82cf9cbebf7c1943eb0af98291d58d92ea296228f53d3a5922
size 3114865536

3
ChatMusician.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a6723ad320efac8597a7a965612661edc09320e2c7abef3abcc93d7fd269f82
size 2948305792

3
ChatMusician.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d5f8aa883e9a744ac2311e7eba025e80b6acc1fae41e8eb9a2a7600252eae9d8
size 2796524416

3
ChatMusician.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c5bcda5e8d13b07164f7e11e08fdc4f4a8c0d4f03cbd22dfdf9d36ce054ea30c
size 2585392000

3
ChatMusician.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5a42d354e06a419ede42de3510b85eef4521d025c23ed4e4e7a666e02452596f
size 3825808256

3
ChatMusician.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e9030bd7b4a2afb1c8b1f8d958e21411a4d8358b807256f022f16673614c4b24
size 3619337088

3
ChatMusician.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a80811010efd0642d62f47c118040e3dd6447fc0cd1df24bddcd79a0d48de68
size 2532864896

3
ChatMusician.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bcdc9ca015f1d55353fc94e5acc2a3d37233de92cbf3ae2c9e29ce2e2d699de8
size 2319545216

3
ChatMusician.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8ef6fe10056f02dfa43ee246070f41cd227740f48f19a0e8d4e1596fc1aa4522
size 3597112192

3
ChatMusician.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a510c7bd1e611518d6babb6f172e6b422b8c90fdef3da7ebc28d178d2bd8ba5f
size 3298005888

3
ChatMusician.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e87e2cc446d439529177afcab4080fa06eb4454ae131de5d1fa9d25532d7800a
size 2948305792

3
ChatMusician.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7f06927b115d6ccb1d9279b6ca38aa9733d81101613a3a1da596a0bf43fe7bd2
size 3837080448

3
ChatMusician.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc4db68e8595378b0befcfa60a570e66baf3b9520fbb53eaf430c27f4adf4702
size 4238750592

3
ChatMusician.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b8030e4507bc3f0a74c1b92ea7b09c56e84da482ee817431ad90e475ceb4fd39
size 4081005440

3
ChatMusician.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:db795b0c1b92c20b82e87adbbe1856ce9c64d571df8794a243183871f27a455f
size 3856741248

3
ChatMusician.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f684c5d1022bb8a8f51ab5007139dc5cb153c7e73bf74c9acc5a30887b357c79
size 4783158144

3
ChatMusician.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:80c31bbd5e899a0e9839042937264805fc6ac91770906b4f70596898bb55adef
size 4651692928

3
ChatMusician.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e2e4f9de223793ee5a376c7cf393b32f586b1331d5a02f56d5b742d809ba99cd
size 5529195392

76
README.md Normal file
View File

@@ -0,0 +1,76 @@
---
base_model: m-a-p/ChatMusician
language:
- en
library_name: transformers
license: mit
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/m-a-p/ChatMusician
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/ChatMusician-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-IQ1_S.gguf) | i1-IQ1_S | 1.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-IQ1_M.gguf) | i1-IQ1_M | 1.8 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-IQ2_S.gguf) | i1-IQ2_S | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-IQ2_M.gguf) | i1-IQ2_M | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-Q2_K.gguf) | i1-Q2_K | 2.6 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.7 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-IQ3_S.gguf) | i1-IQ3_S | 3.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-IQ3_M.gguf) | i1-IQ3_M | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-IQ4_XS.gguf) | i1-IQ4_XS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-IQ4_NL.gguf) | i1-IQ4_NL | 3.9 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-Q4_0.gguf) | i1-Q4_0 | 3.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-Q4_1.gguf) | i1-Q4_1 | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-Q5_K_S.gguf) | i1-Q5_K_S | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-Q5_K_M.gguf) | i1-Q5_K_M | 4.9 | |
| [GGUF](https://huggingface.co/mradermacher/ChatMusician-i1-GGUF/resolve/main/ChatMusician.i1-Q6_K.gguf) | i1-Q6_K | 5.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84fb066a0a8a8313b1e18b7bcac2b76dc2bf5eae0ff4a10f7ed301c57cae6297
size 4562173