bartowski/RekaAI_reka-flash-3-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Compare commits

base: bartowski:07674e00d7ea585d51438e46d570e172e1687e23
Branches Tags
bartowski:main
...
compare: bartowski:02951df8711b30e85faaa672a4ec4c3c3c6c0e37
Branches Tags
bartowski:main

10 Commits
07674e00d7 ... 02951df871

Author SHA1 Message Date
Bartowski
02951df871 Update metadata with huggingface_hub 2025-03-12 07:40:45 +00:00
Bartowski
7465f519b9 Upload README.md with huggingface_hub 2025-03-12 07:40:42 +00:00
Bartowski
a619a1e1a6 Upload RekaAI_reka-flash-3-bf16.gguf with huggingface_hub 2025-03-12 07:40:29 +00:00
Bartowski
e9abec8538 Upload RekaAI_reka-flash-3-IQ2_XXS.gguf with huggingface_hub 2025-03-12 07:36:48 +00:00
Bartowski
f281409247 Upload RekaAI_reka-flash-3-IQ2_XS.gguf with huggingface_hub 2025-03-12 07:34:09 +00:00
Bartowski
94c97747d9 Upload RekaAI_reka-flash-3-IQ2_S.gguf with huggingface_hub 2025-03-12 07:29:57 +00:00
Bartowski
6e38227eae Upload RekaAI_reka-flash-3-IQ2_M.gguf with huggingface_hub 2025-03-12 07:25:52 +00:00
Bartowski
01d2ab51ea Upload RekaAI_reka-flash-3-Q2_K.gguf with huggingface_hub 2025-03-12 07:23:56 +00:00
Bartowski
d63339b54f Upload RekaAI_reka-flash-3-Q2_K_L.gguf with huggingface_hub 2025-03-12 07:22:21 +00:00
Bartowski
ebd9e994bd Upload RekaAI_reka-flash-3-IQ3_XXS.gguf with huggingface_hub 2025-03-12 07:20:56 +00:00
10 changed files with 27 additions and 13 deletions
Expand all files Collapse all files

2
.gitattributes vendored
View File

@@ -59,3 +59,5 @@ RekaAI_reka-flash-3-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
RekaAI_reka-flash-3-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
RekaAI_reka-flash-3-bf16.gguf filter=lfs diff=lfs merge=lfs -text
RekaAI_reka-flash-3.imatrix filter=lfs diff=lfs merge=lfs -text
RekaAI_reka-flash-3-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
RekaAI_reka-flash-3-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text

8
README.md
View File

@@ -20,9 +20,13 @@ Run them directly with [llama.cpp](https://github.com/ggerganov/llama.cpp), or a
## Prompt format
```
human: {prompt} <sep> assistant:
human: {system_prompt} {prompt} <sep> assistant:
```
## What's new:
Fix chat template
## Download a file (not the whole branch) from below:
| Filename | Quant type | File Size | Split | Description |
@@ -52,6 +56,8 @@ human: {prompt} <sep> assistant:
| [reka-flash-3-Q2_K.gguf](https://huggingface.co/bartowski/RekaAI_reka-flash-3-GGUF/blob/main/RekaAI_reka-flash-3-Q2_K.gguf) | Q2_K | 8.63GB | false | Very low quality but surprisingly usable. |
| [reka-flash-3-IQ2_M.gguf](https://huggingface.co/bartowski/RekaAI_reka-flash-3-GGUF/blob/main/RekaAI_reka-flash-3-IQ2_M.gguf) | IQ2_M | 8.51GB | false | Relatively low quality, uses SOTA techniques to be surprisingly usable. |
| [reka-flash-3-IQ2_S.gguf](https://huggingface.co/bartowski/RekaAI_reka-flash-3-GGUF/blob/main/RekaAI_reka-flash-3-IQ2_S.gguf) | IQ2_S | 8.12GB | false | Low quality, uses SOTA techniques to be usable. |
| [reka-flash-3-IQ2_XS.gguf](https://huggingface.co/bartowski/RekaAI_reka-flash-3-GGUF/blob/main/RekaAI_reka-flash-3-IQ2_XS.gguf) | IQ2_XS | 7.83GB | false | Low quality, uses SOTA techniques to be usable. |
| [reka-flash-3-IQ2_XXS.gguf](https://huggingface.co/bartowski/RekaAI_reka-flash-3-GGUF/blob/main/RekaAI_reka-flash-3-IQ2_XXS.gguf) | IQ2_XXS | 7.39GB | false | Very low quality, uses SOTA techniques to be usable. |
## Embed/output weights

4
RekaAI_reka-flash-3-IQ2_M.gguf
View File

@@ -1,3 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9a2b67eff4fa6643e8a882baeabc8e5b5eccd99e4260b05846b459a5cc54ab80
size 8514037440
oid sha256:a680fd5897b4b7e56cdee854c1ed895ab10c0dc76466ee7fdc1e12b1ed1aa0f5
size 8514037504

4
RekaAI_reka-flash-3-IQ2_S.gguf
View File

@@ -1,3 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:262ae21aea1eb93be18e20397255b3a3348868d5a93f2a297cb1671c9700afb7
size 8123672256
oid sha256:c1a72fbbb274475fafa8441c8b12822c5d1ed302296f03a09875f66569b5eeaa
size 8123672320

3
RekaAI_reka-flash-3-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd5b685b62f0303255fe5a712b4d7c8a42de615f3587f7a451970daa0a172996
size 7827482368

3
RekaAI_reka-flash-3-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b012f332ee6b78adf11618c7920d349223211638793d89b3f35d19a60b425deb
size 7385212672

4
RekaAI_reka-flash-3-IQ3_XXS.gguf
View File

@@ -1,3 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3d8ee19f6b7a2ed8d44aef5569c018c677b85c5a71d7906397f0a01a2e259fbf
size 9177982656
oid sha256:72fdea8a25ccb27a2cb300814b959bcf2261f1cf175abc0c47c9557e2b587eba
size 9177982720

4
RekaAI_reka-flash-3-Q2_K.gguf
View File

@@ -1,3 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3fd104f10c59ff176755067f6cba4d3762a4f0e95f7bd40b1abb362c0170c8e0
size 8630896320
oid sha256:50272dc5f2a48c3e3e0df716f7eca018cb0143e5d358e00b030eba6c0334a7b4
size 8630896384

4
RekaAI_reka-flash-3-Q2_K_L.gguf
View File

@@ -1,3 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a9492a5d21e0782e4c56bc366674c8f217574feb6d07d88390c1f345bddce04
size 9233008320
oid sha256:c72fce2dee92256a1ee3dff58c44200661ea640df02b497c83e138606d9abb78
size 9233008384

4
RekaAI_reka-flash-3-bf16.gguf
View File

@@ -1,3 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:229652c7bdf6b9c21470b8586a06fc099f1bf86356fb6a90c0da41ef9065670f
size 41815623104
oid sha256:f83338664a2469b542c225b573b54a893b99e1ca4454e71f7f616b2ffb3568c4
size 41815623136