Compare commits
10 Commits
25f44c5730
...
f7cdad162e
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
f7cdad162e | ||
|
|
daea2af10c | ||
|
|
f143db7cf8 | ||
|
|
d05d2f1b3a | ||
|
|
5ababa367f | ||
|
|
c109687758 | ||
|
|
6ecaac7812 | ||
|
|
4f8d0a14b3 | ||
|
|
f3eb37c0a6 | ||
|
|
48ce02d176 |
9
.gitattributes
vendored
9
.gitattributes
vendored
@@ -53,3 +53,12 @@ gemma-3-27b-it-codeforces-sft-i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
gemma-3-27b-it-codeforces-sft-i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
gemma-3-27b-it-codeforces-sft-i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
gemma-3-27b-it-codeforces-sft-i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
gemma-3-27b-it-codeforces-sft-i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
gemma-3-27b-it-codeforces-sft-i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
gemma-3-27b-it-codeforces-sft-i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
gemma-3-27b-it-codeforces-sft-i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
gemma-3-27b-it-codeforces-sft-i1-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
gemma-3-27b-it-codeforces-sft-i1-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
gemma-3-27b-it-codeforces-sft-i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
gemma-3-27b-it-codeforces-sft-i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
gemma-3-27b-it-codeforces-sft-i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
|
||||
25
README.md
25
README.md
@@ -12,31 +12,6 @@ tags:
|
||||
|
||||
Quantized to `i1-GGUF` using [SpongeQuant](https://github.com/SpongeEngine/SpongeQuant), the Oobabooga of LLM quantization.
|
||||
|
||||
<div style="display: flex; gap: 20px; align-items: center; margin-top:0;">
|
||||
<a href="https://github.com/SpongeEngine/SpongeQuant">
|
||||
<img src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/github-button.png" width="173">
|
||||
</a>
|
||||
<a href="https://discord.gg/azNmr2Gdgy">
|
||||
<img src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/discord-button.png" width="173">
|
||||
</a>
|
||||
</div>
|
||||
|
||||
***
|
||||
<figure>
|
||||
<img src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/094.png" alt="UN Building Night">
|
||||
<figcaption>UN Building Night</figcaption>
|
||||
</figure>
|
||||
|
||||
<figure>
|
||||
<audio controls>
|
||||
<source src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/011.mp3" type="audio/mp3">
|
||||
Your browser does not support the audio element.
|
||||
</audio>
|
||||
<figcaption>Chuck Berry – Johnny B. Goode (USA, 1958)</figcaption>
|
||||
</figure>
|
||||
|
||||
***
|
||||
|
||||
### What is a GGUF?
|
||||
GGUF is a file format used for running large language models (LLMs) on different types of computers. It supports both regular processors (CPUs) and graphics cards (GPUs), making it easier to run models across a wide range of hardware. Many LLMs require powerful and expensive GPUs, but GGUF improves compatibility and efficiency by optimizing how models are loaded and executed. If a GPU doesn't have enough memory, GGUF can offload parts of the model to the CPU, allowing it to run even when GPU resources are limited. GGUF is designed to work well with quantized models, which use less memory and run faster, making them ideal for lower-end hardware. However, it can also store full-precision models when needed. Thanks to these optimizations, GGUF allows LLMs to run efficiently on everything from high-end GPUs to laptops and even CPU-only systems.
|
||||
|
||||
|
||||
3
gemma-3-27b-it-codeforces-sft-i1-Q4_0.gguf
Normal file
3
gemma-3-27b-it-codeforces-sft-i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4b189769bb8a98bb934e2ea2d14cc903058e5c5ad8e85d770069c663409306bb
|
||||
size 15617974496
|
||||
3
gemma-3-27b-it-codeforces-sft-i1-Q4_1.gguf
Normal file
3
gemma-3-27b-it-codeforces-sft-i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:29afb015141ad01645db9e65ef9177d1264c51fc6d269c83b7b5807d72cfefa4
|
||||
size 17167294688
|
||||
3
gemma-3-27b-it-codeforces-sft-i1-Q4_K_M.gguf
Normal file
3
gemma-3-27b-it-codeforces-sft-i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:900d8430a59107e571714f0edb9c85252ad93f36f3a8554778c80df4189dd422
|
||||
size 16546689248
|
||||
3
gemma-3-27b-it-codeforces-sft-i1-Q4_K_S.gguf
Normal file
3
gemma-3-27b-it-codeforces-sft-i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:794f89d7257204e3d9fd5a7df917ce96052117bec763bbf21f97bc6434d1fd69
|
||||
size 15674056928
|
||||
3
gemma-3-27b-it-codeforces-sft-i1-Q5_0.gguf
Normal file
3
gemma-3-27b-it-codeforces-sft-i1-Q5_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:dce14c8e3aa14c3b7817445420b9eb71c034c40d998732e08a5d3a433f03f53e
|
||||
size 18817769696
|
||||
3
gemma-3-27b-it-codeforces-sft-i1-Q5_1.gguf
Normal file
3
gemma-3-27b-it-codeforces-sft-i1-Q5_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:39880638a2610682f6245357e71be77b9a5eec0c3cc0cf5a7a042050f28ae163
|
||||
size 20367089888
|
||||
3
gemma-3-27b-it-codeforces-sft-i1-Q5_K_M.gguf
Normal file
3
gemma-3-27b-it-codeforces-sft-i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b1983135203b8d9af1dd4ba214ebe60e9fe54fde8aba22770ce4ab21418dcf22
|
||||
size 19271676128
|
||||
3
gemma-3-27b-it-codeforces-sft-i1-Q5_K_S.gguf
Normal file
3
gemma-3-27b-it-codeforces-sft-i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:015d74959f06deacc13e82fcab5bf1d34ea3c826b1f12502aff887200d4cf673
|
||||
size 18767192288
|
||||
3
gemma-3-27b-it-codeforces-sft-i1-Q6_K.gguf
Normal file
3
gemma-3-27b-it-codeforces-sft-i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d00b42655e997902e79d71234ec27bfc3837eecc4d3e02c8cbb7453e3876a450
|
||||
size 22166974688
|
||||
Reference in New Issue
Block a user