初始化项目,由ModelHub XC社区提供模型

Model: mradermacher/WBCR-SLERP-24B-v1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-15 11:19:03 +08:00
commit 3383ff451a
26 changed files with 214 additions and 0 deletions

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
WBCR-SLERP-24B-v1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text

83
README.md Normal file
View File

@@ -0,0 +1,83 @@
---
base_model: Naphula/WBCR-SLERP-24B-v1
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Naphula/WBCR-SLERP-24B-v1
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#WBCR-SLERP-24B-v1-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | |
| [GGUF](https://huggingface.co/mradermacher/WBCR-SLERP-24B-v1-i1-GGUF/resolve/main/WBCR-SLERP-24B-v1.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:79d887437876263184fd6277a3aabdc295807776b5c017fbfb2c8c765650c91c
size 5750497088

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34fd655702fff94debbe3f226ba9ac293a4763be258b754b2e5ef1f66fd6cf95
size 5273722688

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:162b04162e5163d14b4fc27ab1ecf97510a40b310d6772ca2183ee398c5ec3e8
size 8114052928

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fd94b6d29fb2ea23c1afedb8faed25393da9129345fe4f028a708479f04e8edc
size 7478353728

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d35f5af8c660afb9fa1c46f00ace11a9e8d63374d4d9984e1cfd6bde826ed4ba
size 7207034688

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1746e45cc7a6cc167fc06a3fdde1b2924805149122a29dd3281d7967536afe0d
size 6545121088

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5b2ec95514963055fcfdf7a9cb5df85bc27bf2d8a20519e730e14699f521f360
size 10650951488

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:68e324a4ff21a69570903be9eb6c59ffb8d0d7762d060d1290737db3196c11df
size 10428129088

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff11e6da1b77ea597aa732580d19d7db6ea82b24ad43a7e4cc3be0a529740673
size 9907117888

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3719f234b1f477ddf0e7211ad75bac09620742fc0c047c48eb45ff3db755145d
size 9280593728

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e6abb2220821a3587152e6b4f2e509663e9c8761845182b31f232facfafa89ec
size 12758916928

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e57c11e9ab182e290050e8caad9286c8b389230d02d4ab87c5337593eb71146a
size 8890326848

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c31a818449b2c810b3de271632c5c9eb103abebb8d3951bdeb9623bb321c28c
size 8320163648

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c318f5175416fe12940676e0750c33217c27afd933ace97c41a6ebd71158302
size 12400762688

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7225c5d0b7803ade59e3f8ce1b3ced5a9bf340607b319cdb34366502b41c527
size 11474083648

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36e1aaa5731f060bc6e9631234efbc18ec78d85bc2a06c8b6a7fc42e7d36a366
size 10400276288

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ebdce254ef35cbb4a16a148379b49ba0c12c42726b29808f23c2f174b8a69549
size 13494230848

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b5759066b7771b248ff38f4137a747a974b1656a9f7b1d164ef5b7502259228
size 14873108288

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df622854ceb700a14316c0879c79a066be7b40801b8c140202dbfab6a71fff5c
size 14333910848

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e085174f3da5dab4bff06c22c03612cf3d027767abd1bcf266e1fd058c191ed1
size 13549281088

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:386bdbbc362caf010f576f8bdf6adb6a85b65c5bfd4566889883a038a15fb32e
size 16763985728

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:568e25cd01e718ca72544584dc4f4c8c24a3981dcfd139cf46a247c8a4f7d1d2
size 16304414528

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f0d137a749b07dfbf93536e700bb6c2bcc1b0c1684dec1acb73bbb661d095f2
size 19345940288

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aac1fabf98c5013213a7b330b53d4aad6fb891aecd57ebe80bb0a0a1b7361a06
size 10037312