mradermacher/BotnetCode1.5-7b-TOP-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Compare commits

base: mradermacher:d77e40b197cbbb21572949d5e8b67d0f6cae29ef
Branches Tags
mradermacher:main
..
compare: mradermacher:e98fa1e3ba53aabb81d3f4ea5f555e16e9c40c6d
Branches Tags
mradermacher:main

10 Commits
d77e40b197 ... e98fa1e3ba

Author SHA1 Message Date
Michael Radermacher
e98fa1e3ba auto-patch README.md 2024-07-31 01:33:57 +00:00
Michael Radermacher
ccb6dbbb97 auto-patch README.md 2024-07-31 01:33:57 +00:00
Michael Radermacher
bae6121011 uploaded from nethype/db2 2024-07-31 01:33:26 +00:00
Michael Radermacher
0e2764f0dc uploaded from nethype/db2 2024-07-31 01:29:19 +00:00
Michael Radermacher
cf75c924fe uploaded from nethype/db2 2024-07-31 01:26:00 +00:00
Michael Radermacher
e5b17bd3b0 uploaded from nethype/db2 2024-07-30 21:36:33 +00:00
Michael Radermacher
a234582085 uploaded from nethype/db2 2024-07-30 21:35:50 +00:00
Michael Radermacher
c2adf75fb7 uploaded from nethype/db2 2024-07-30 21:34:43 +00:00
Michael Radermacher
cf82109976 uploaded from nethype/db2 2024-07-30 21:34:19 +00:00
Michael Radermacher
d6ccb4468d uploaded from nethype/db2 2024-07-30 21:34:16 +00:00
10 changed files with 40 additions and 0 deletions
Expand all files Collapse all files

8
.gitattributes vendored
View File

@@ -40,3 +40,11 @@ BotnetCode1.5-7b-TOP.f16.gguf filter=lfs diff=lfs merge=lfs -text
BotnetCode1.5-7b-TOP.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
BotnetCode1.5-7b-TOP.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
BotnetCode1.5-7b-TOP.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
BotnetCode1.5-7b-TOP.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
BotnetCode1.5-7b-TOP.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
BotnetCode1.5-7b-TOP.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
BotnetCode1.5-7b-TOP.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
BotnetCode1.5-7b-TOP.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
BotnetCode1.5-7b-TOP.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
BotnetCode1.5-7b-TOP.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
BotnetCode1.5-7b-TOP.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text

3
BotnetCode1.5-7b-TOP.IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:03b0f3f3649ae6afd285d697dceed93c9c6a8e957578024b53f8fefac3793524
size 3357543392

3
BotnetCode1.5-7b-TOP.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba69b4eacdbe3060f8140747634108443829532b656aaa2fa09874f52e3f732a
size 4071533536

3
BotnetCode1.5-7b-TOP.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7e5eccec98db8aa25dcda40ea8cf575a863ff040089cd58083e0e295b0ac522
size 3986820064

3
BotnetCode1.5-7b-TOP.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e2ff1ae080664f92a53fa70a988a889264f4b5a77a88788890c1fcd317b9bf7
size 3500805088

3
BotnetCode1.5-7b-TOP.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e3343271dbcefa39b5eb5d3e3068b6fb49ac797cec0bf7e99aca8d245421fa5d
size 4738591712

3
BotnetCode1.5-7b-TOP.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c6145fb96ab1ba4171050a3174170825d4c77e2a6de1259eb8d41a4de91f216b
size 5428161504

3
BotnetCode1.5-7b-TOP.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:83ecd9f1ed7ae8883e86a4fe02315174dd15407fe1e6da07b53609fecdc49063
size 5148453856

3
BotnetCode1.5-7b-TOP.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:40e0b19a8e6e868a4d3d6dcbc2ae62d05d8f27b72950d2ad279639d685adc3fe
size 6377589728

8
README.md
View File

@@ -31,10 +31,18 @@ more details, including on how to concatenate multi-part files.
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/BotnetCode1.5-7b-TOP-GGUF/resolve/main/BotnetCode1.5-7b-TOP.Q2_K.gguf) | Q2_K | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/BotnetCode1.5-7b-TOP-GGUF/resolve/main/BotnetCode1.5-7b-TOP.IQ3_XS.gguf) | IQ3_XS | 3.5 | |
| [GGUF](https://huggingface.co/mradermacher/BotnetCode1.5-7b-TOP-GGUF/resolve/main/BotnetCode1.5-7b-TOP.Q3_K_S.gguf) | Q3_K_S | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/BotnetCode1.5-7b-TOP-GGUF/resolve/main/BotnetCode1.5-7b-TOP.IQ3_S.gguf) | IQ3_S | 3.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/BotnetCode1.5-7b-TOP-GGUF/resolve/main/BotnetCode1.5-7b-TOP.IQ3_M.gguf) | IQ3_M | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/BotnetCode1.5-7b-TOP-GGUF/resolve/main/BotnetCode1.5-7b-TOP.Q3_K_M.gguf) | Q3_K_M | 3.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/BotnetCode1.5-7b-TOP-GGUF/resolve/main/BotnetCode1.5-7b-TOP.Q3_K_L.gguf) | Q3_K_L | 4.1 | |
| [GGUF](https://huggingface.co/mradermacher/BotnetCode1.5-7b-TOP-GGUF/resolve/main/BotnetCode1.5-7b-TOP.IQ4_XS.gguf) | IQ4_XS | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/BotnetCode1.5-7b-TOP-GGUF/resolve/main/BotnetCode1.5-7b-TOP.Q4_K_S.gguf) | Q4_K_S | 4.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/BotnetCode1.5-7b-TOP-GGUF/resolve/main/BotnetCode1.5-7b-TOP.Q4_K_M.gguf) | Q4_K_M | 4.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/BotnetCode1.5-7b-TOP-GGUF/resolve/main/BotnetCode1.5-7b-TOP.Q5_K_S.gguf) | Q5_K_S | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/BotnetCode1.5-7b-TOP-GGUF/resolve/main/BotnetCode1.5-7b-TOP.Q5_K_M.gguf) | Q5_K_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/BotnetCode1.5-7b-TOP-GGUF/resolve/main/BotnetCode1.5-7b-TOP.Q6_K.gguf) | Q6_K | 6.5 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/BotnetCode1.5-7b-TOP-GGUF/resolve/main/BotnetCode1.5-7b-TOP.Q8_0.gguf) | Q8_0 | 7.8 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/BotnetCode1.5-7b-TOP-GGUF/resolve/main/BotnetCode1.5-7b-TOP.f16.gguf) | f16 | 14.6 | 16 bpw, overkill |