mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-11 14:41:41 +08:00
commit 3d788563a5
27 changed files with 224 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Galactic-Qwen-14B-Exp1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Galactic-Qwen-14B-Exp1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e787ae58baf8559e83f97673a36b4b7e8a48c3dfbcb7ca86c4e6185c9e8de786
size 3870225824

3
Galactic-Qwen-14B-Exp1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6f46441be5b8c3343bda4ff8734ccd8eb9bd6090f1787fcb9849919b417df3db
size 3605910944

3
Galactic-Qwen-14B-Exp1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1066756aab9d9fb43727ea861ea427fdb2bdad1da87a03554f6ad2fe5b891cf
size 5353855776

3
Galactic-Qwen-14B-Exp1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:82d27670a431dcc97d85480fd84fb1b4bcda70f3eecf52340d9d0d7d645f49e5
size 5001435936

3
Galactic-Qwen-14B-Exp1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21edce9591cb74aa292fabacefa13093386732a34c0a69ce6c939c8d586548e5
size 4702492064

3
Galactic-Qwen-14B-Exp1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e70fa2f96b876abc6bb0f6fb6da0fd571791baf7c118950114f20b8a6ea97e8a
size 4310750624

3
Galactic-Qwen-14B-Exp1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7497e7624d7c78e50a0a02be676d13216388a153922a1ce453c7047488da7cfc
size 6913976160

3
Galactic-Qwen-14B-Exp1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ab42eb22f5dcf2bd39b4ae1b16b94823fd01954be3f83ffffad6810d92e6cff
size 6690457440

3
Galactic-Qwen-14B-Exp1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9696e33618dac8b3c304a9398bbd27992f98b1ca006a808f17b817aed68de0ce
size 6380799840

3
Galactic-Qwen-14B-Exp1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3d7a668f447d10f7cece921092bf537a907a6ac18fca6e3551d38cc333887fb
size 5944417056

3
Galactic-Qwen-14B-Exp1.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d67c8d1297741f1c4e57c64c36f814d913c2dda6d46274843930f0aba94cc73f
size 8546349952

3
Galactic-Qwen-14B-Exp1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:15c3f7ede5079828fa6361aad8bb3f6de43efac3a85c6e1a40e0efa2144c094b
size 8117071072

3
Galactic-Qwen-14B-Exp1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1d785b4d1e023e6d666359e4036abbb52d5bf53358585524d4eec903baef9516
size 5768143328

3
Galactic-Qwen-14B-Exp1.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4d033337799bb65813ee3ff78194a6d09d7bfa814821923a2cbab24f898d1e45
size 5394833888

3
Galactic-Qwen-14B-Exp1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc39388a178e5fb3932c24ec571b2db0c85d2ea4149ce7b5c0efbd08d25e03f5
size 7922206560

3
Galactic-Qwen-14B-Exp1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8c1d5cd30e7bff20f0fb3b89059a7f44798406990a69b84c4d1a793796415e58
size 7336642400

3
Galactic-Qwen-14B-Exp1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d2b9ffdeb6258dd68d364e28fd959bf8825d684edd9c5196e4c554ed34fe28f8
size 6657034080

3
Galactic-Qwen-14B-Exp1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e05874a6844e4dc9b384e7f6b89e93cda5d36a935fda7a9857fe4bee92bdf717
size 8541434752

3
Galactic-Qwen-14B-Exp1.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c6e13dd127b04373ad90875abe7ebdb021b8550663e798a5b98b8a7d5eb11a4d
size 9389179072

3
Galactic-Qwen-14B-Exp1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ea94a868b7079cd7c03925af16a4cd15b1c25d5ecebd52db308a9aa7a644756e
size 8985277312

3
Galactic-Qwen-14B-Exp1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:31ac9e656c054428ff118ccd197ce247494815fd038fabfa5a23479b217e73a0
size 8570598272

3
Galactic-Qwen-14B-Exp1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb72cd9f88d9374f0ab7491e226ffcef2b70de3e751588adff798630a711ac23
size 10505784832

3
Galactic-Qwen-14B-Exp1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:32307518cb177d392c058f9305b8f77aade66b4853cf1cb679eebd8679183898
size 10263465472

3
Galactic-Qwen-14B-Exp1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b0bed0c7e51059e87b498a359b9b3855fa00f1099940ad49723488a8ca56840
size 12121324096

89
README.md Normal file
View File

@@ -0,0 +1,89 @@
---
base_model: prithivMLmods/Galactic-Qwen-14B-Exp1
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- math
- 14b
- qwen
- code
- trl
- Exp1
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/prithivMLmods/Galactic-Qwen-14B-Exp1
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Galactic-Qwen-14B-Exp1-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-IQ1_S.gguf) | i1-IQ1_S | 3.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-IQ1_M.gguf) | i1-IQ1_M | 4.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-IQ2_M.gguf) | i1-IQ2_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-Q2_K.gguf) | i1-Q2_K | 5.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.5 | |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-IQ3_S.gguf) | i1-IQ3_S | 6.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-Q4_0.gguf) | i1-Q4_0 | 8.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.6 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-Q4_1.gguf) | i1-Q4_1 | 9.5 | |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.4 | |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/Galactic-Qwen-14B-Exp1-i1-GGUF/resolve/main/Galactic-Qwen-14B-Exp1.i1-Q6_K.gguf) | i1-Q6_K | 12.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d937e192dc4b07760b3977cc470246ec96b2ac03720321d11dc7d2f3bb9cb18c
size 8563597