初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/L3-ColdBrew-OldSpice-GGUF Source: Original Platform
This commit is contained in:
47
.gitattributes
vendored
Normal file
47
.gitattributes
vendored
Normal file
@@ -0,0 +1,47 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
L3-ColdBrew-OldSpice.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-ColdBrew-OldSpice.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-ColdBrew-OldSpice.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-ColdBrew-OldSpice.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-ColdBrew-OldSpice.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-ColdBrew-OldSpice.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-ColdBrew-OldSpice.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-ColdBrew-OldSpice.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-ColdBrew-OldSpice.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-ColdBrew-OldSpice.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-ColdBrew-OldSpice.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-ColdBrew-OldSpice.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
L3-ColdBrew-OldSpice.IQ4_XS.gguf
Normal file
3
L3-ColdBrew-OldSpice.IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f0b5dbdf5349b1dd82a10ba0b633ceb6c4a25b5ef1a6013a13404cdb76144cf9
|
||||
size 5425993824
|
||||
3
L3-ColdBrew-OldSpice.Q2_K.gguf
Normal file
3
L3-ColdBrew-OldSpice.Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:26a92c10eba6a9fb6f5f110552de74ebfa510c57ce012970093946742361bd90
|
||||
size 3821131872
|
||||
3
L3-ColdBrew-OldSpice.Q3_K_L.gguf
Normal file
3
L3-ColdBrew-OldSpice.Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:bf6d8693f87bb7b0167e1bdcb26b2905ffdc0a995ca31f1b50e34cad6e8d3a71
|
||||
size 5236324448
|
||||
3
L3-ColdBrew-OldSpice.Q3_K_M.gguf
Normal file
3
L3-ColdBrew-OldSpice.Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1f524d6818185e206d955f66ff3358a5e7a8bc06837ddc0cdfc21796a6edc543
|
||||
size 4853594208
|
||||
3
L3-ColdBrew-OldSpice.Q3_K_S.gguf
Normal file
3
L3-ColdBrew-OldSpice.Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4804385aa2a36e1f8d3d1fb4263d9b763e7e5b4b3d1c64bb20b6a0804264062d
|
||||
size 4414503008
|
||||
3
L3-ColdBrew-OldSpice.Q4_K_M.gguf
Normal file
3
L3-ColdBrew-OldSpice.Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6fe7a58f6b09e134433abae483e6eda7a46e920f7ec5a9f71bbdbab1ee2586ce
|
||||
size 5967353952
|
||||
3
L3-ColdBrew-OldSpice.Q4_K_S.gguf
Normal file
3
L3-ColdBrew-OldSpice.Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e2a8c45c699183d43b084ba12c2fc55ea42c258d86a735fc56be4ca521e1c823
|
||||
size 5681748064
|
||||
3
L3-ColdBrew-OldSpice.Q5_K_M.gguf
Normal file
3
L3-ColdBrew-OldSpice.Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ad1b7f5b2198016abd246764ac23d2c3bb68336da12548139778105e6f3cbfad
|
||||
size 6966253664
|
||||
3
L3-ColdBrew-OldSpice.Q5_K_S.gguf
Normal file
3
L3-ColdBrew-OldSpice.Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9e4f7f4a74cdc60c7cd91d968488642ba30acf86ce624afebc0e6d573e7f54ab
|
||||
size 6799136864
|
||||
3
L3-ColdBrew-OldSpice.Q6_K.gguf
Normal file
3
L3-ColdBrew-OldSpice.Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e5f464615e6bf95b1c3b05bd86863bc69f16ec0790dc191200a1af8efd64491e
|
||||
size 8027584608
|
||||
3
L3-ColdBrew-OldSpice.Q8_0.gguf
Normal file
3
L3-ColdBrew-OldSpice.Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ec188986bfdc0d08190b6efbe73475ee0fc99cc3a9b1ab93bb6cc30ec9a12d88
|
||||
size 10394925152
|
||||
3
L3-ColdBrew-OldSpice.f16.gguf
Normal file
3
L3-ColdBrew-OldSpice.f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b617c50bc3fc2c3bd6abdd20b57e142867903a24e57efc309680392e473d7e71
|
||||
size 19558824032
|
||||
66
README.md
Normal file
66
README.md
Normal file
@@ -0,0 +1,66 @@
|
||||
---
|
||||
base_model: SvalTek/L3-ColdBrew-OldSpice
|
||||
language:
|
||||
- en
|
||||
library_name: transformers
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- mergekit
|
||||
- merge
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: -->
|
||||
static quants of https://huggingface.co/SvalTek/L3-ColdBrew-OldSpice
|
||||
|
||||
<!-- provided-files -->
|
||||
weighted/imatrix quants are available at https://huggingface.co/mradermacher/L3-ColdBrew-OldSpice-i1-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-ColdBrew-OldSpice-GGUF/resolve/main/L3-ColdBrew-OldSpice.Q2_K.gguf) | Q2_K | 3.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-ColdBrew-OldSpice-GGUF/resolve/main/L3-ColdBrew-OldSpice.Q3_K_S.gguf) | Q3_K_S | 4.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-ColdBrew-OldSpice-GGUF/resolve/main/L3-ColdBrew-OldSpice.Q3_K_M.gguf) | Q3_K_M | 5.0 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-ColdBrew-OldSpice-GGUF/resolve/main/L3-ColdBrew-OldSpice.Q3_K_L.gguf) | Q3_K_L | 5.3 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-ColdBrew-OldSpice-GGUF/resolve/main/L3-ColdBrew-OldSpice.IQ4_XS.gguf) | IQ4_XS | 5.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-ColdBrew-OldSpice-GGUF/resolve/main/L3-ColdBrew-OldSpice.Q4_K_S.gguf) | Q4_K_S | 5.8 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-ColdBrew-OldSpice-GGUF/resolve/main/L3-ColdBrew-OldSpice.Q4_K_M.gguf) | Q4_K_M | 6.1 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-ColdBrew-OldSpice-GGUF/resolve/main/L3-ColdBrew-OldSpice.Q5_K_S.gguf) | Q5_K_S | 6.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-ColdBrew-OldSpice-GGUF/resolve/main/L3-ColdBrew-OldSpice.Q5_K_M.gguf) | Q5_K_M | 7.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-ColdBrew-OldSpice-GGUF/resolve/main/L3-ColdBrew-OldSpice.Q6_K.gguf) | Q6_K | 8.1 | very good quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-ColdBrew-OldSpice-GGUF/resolve/main/L3-ColdBrew-OldSpice.Q8_0.gguf) | Q8_0 | 10.5 | fast, best quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-ColdBrew-OldSpice-GGUF/resolve/main/L3-ColdBrew-OldSpice.f16.gguf) | f16 | 19.7 | 16 bpw, overkill |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||

|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time.
|
||||
|
||||
<!-- end -->
|
||||
Reference in New Issue
Block a user