mradermacher/WindEngine-24B-Instruct-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/WindEngine-24B-Instruct-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-11 05:20:16 +08:00
commit 9b431cd2b5
25 changed files with 207 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

58
.gitattributes vendored Normal file
View File

@@ -0,0 +1,58 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
WindEngine-24B-Instruct.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

80
README.md Normal file
View File

@@ -0,0 +1,80 @@
---
base_model: Darkknight535/WinterEngine-24B-Instruct
language:
- en
library_name: transformers
quantized_by: mradermacher
tags:
- merge
- mergekit
- lazymergekit
- PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
- SicariusSicariiStuff/Redemption_Wind_24B
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Darkknight535/WinterEngine-24B-Instruct
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/WindEngine-24B-Instruct-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | |
| [GGUF](https://huggingface.co/mradermacher/WindEngine-24B-Instruct-i1-GGUF/resolve/main/WindEngine-24B-Instruct.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
WindEngine-24B-Instruct.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:771007f9eaa4c6605eb4709dee43940675654213ad3956f465e0c6ab676d3c07
size 5750495744

3
WindEngine-24B-Instruct.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd7a1150777f78cd2bfcdc771cfecea24c1fd4f326d53a1184467275571f8e2d
size 5273721344

3
WindEngine-24B-Instruct.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c7ce7eda2b1948877f76a996817b31ad08f9febfc0c52ebd21488a871deaf14b
size 8114051584

3
WindEngine-24B-Instruct.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7200803d0320f195f0baee6c000add3050e6279f853e86b69b6d5682b5486175
size 7478352384

3
WindEngine-24B-Instruct.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a69a4e766583e31f6e4c676d2510892f0e11c0eaf85b444ab118634ba30e4fad
size 7207033344

3
WindEngine-24B-Instruct.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0d4812cccc0a02e054850990f54b05933e589b9d2fe9ede771ca44f01c28aed1
size 6545119744

3
WindEngine-24B-Instruct.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd301e362c7db2227ef8830ace6f8e326f63fbe848978a2112b70179b485d6b4
size 10650950144

3
WindEngine-24B-Instruct.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8955897330584843271e35fa3b0b38e4a7776c17d46dbb61e90d6f936dd442e5
size 10428127744

3
WindEngine-24B-Instruct.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:840f4df8c2d5047c5cc219b0196f653c5108e823ddc9c5a656e76bd533157a9c
size 9907116544

3
WindEngine-24B-Instruct.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a4efbb88d47876a6af954db69890e4930a76c30ba411b233fc8dbe424e24f11
size 9280592384

3
WindEngine-24B-Instruct.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5fcbde60c0f85fe14597a8580042edcf4013922c14527147538deac7af02ba67
size 12758915584

3
WindEngine-24B-Instruct.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:91b24313d6db936204e1cf501c3d3355ca4e9fc9a1b5ab04749dd376ab657d5c
size 8890325504

3
WindEngine-24B-Instruct.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:69b8731c44f45187fb06cee00492b458e5b9112e0d09abd1b70eb78cbc3d41d0
size 8320162304

3
WindEngine-24B-Instruct.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e24ef201113576782ffd9610b1a4f4b89ca4b9c16334188236fae6890773d897
size 12400761344

3
WindEngine-24B-Instruct.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a02c53adba05fb03bc9cbe7fb28cf3aa9d9b1742c337a840319288143eda72f6
size 11474082304

3
WindEngine-24B-Instruct.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b9a824de208a0e50a5fd74b61e0475cbb73da439422fe5c35ca95e58fd42d430
size 10400274944

3
WindEngine-24B-Instruct.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a453cc725408b0e8e6d90ddf142c6ed475522ac11a18b60c938bd9b93eb8b42
size 13494229504

3
WindEngine-24B-Instruct.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3250acfb50e2867f2450f14dce66be1d34edd9848ccfc1fe0434e210083db29f
size 14873106944

3
WindEngine-24B-Instruct.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d1421477f7269f28244a83d066e45d35d2313ad0abd80e2f21580702b382f1c5
size 14333909504

3
WindEngine-24B-Instruct.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5d6762cb3ccd185b952e395c69ea4d28e411233c1326d40a27d348b8ea72975d
size 13549279744

3
WindEngine-24B-Instruct.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a6ead71593bfcc06fbd2360df39e6a08ef7326acfb61af23f2baadfe4255ad8e
size 16763984384

3
WindEngine-24B-Instruct.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e00e33de57b4834b5df9bed4af480bfbb878a05f8ccdb82ae246c53e60d6592e
size 16304413184

3
WindEngine-24B-Instruct.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2bd74b07a50dd006a0a1e362bbc894efc121ce59c47629d1e7c2c596334453b8
size 19345938944