matrixportalx/Gemmasutra-Small-4B-v1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: matrixportalx/Gemmasutra-Small-4B-v1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-22 08:20:17 +08:00
commit 8faa09ad07
24 changed files with 170 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q2_k.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.f16.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.fp16.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q3_k_l.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q3_k_s.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q3-k-s.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q5-k-m.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q2-k.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q4-k-m.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q6-k.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q3-k-l.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q4-k-s.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q4-0.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q8-0.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q3-k-m.gguf filter=lfs diff=lfs merge=lfs -text
gemmasutra-small-4b-v1.q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text

47
README.md Normal file
View File

@@ -0,0 +1,47 @@
---
tags:
- gguf
- llama.cpp
- quantized
- text-generation
license: other
base_model: TheDrummer/Gemmasutra-Small-4B-v1
datasets:
- Gemmasutra-Small-4B-v1
---
# Gemmasutra-Small-4B-v1 GGUF Quantized Models
## Model Information
- **Base Model:** [TheDrummer/Gemmasutra-Small-4B-v1](https://huggingface.co/TheDrummer/Gemmasutra-Small-4B-v1)
- **Quantized by:** [matrixportal](https://huggingface.co/matrixportal)
- **Format:** GGUF (for llama.cpp compatible tools)
- **Quantized on:** 2025-04-09
## Recommended Downloads
- **Q4_K_M:** [`gemmasutra-small-4b-v1.q4_k_m.gguf`](https://huggingface.co/matrixportal/Gemmasutra-Small-4B-v1-GGUF/resolve/main/gemmasutra-small-4b-v1.q4_k_m.gguf)
- **Q4_0:** [`gemmasutra-small-4b-v1.q4_0.gguf`](https://huggingface.co/matrixportal/Gemmasutra-Small-4B-v1-GGUF/resolve/main/gemmasutra-small-4b-v1.q4_0.gguf)
- **Q8_0:** [`gemmasutra-small-4b-v1.q8_0.gguf`](https://huggingface.co/matrixportal/Gemmasutra-Small-4B-v1-GGUF/resolve/main/gemmasutra-small-4b-v1.q8_0.gguf)
## All Available Quantizations
| File | Download |
|------|----------|
| `gemmasutra-small-4b-v1.f16.gguf` | [Download](https://huggingface.co/matrixportal/Gemmasutra-Small-4B-v1-GGUF/resolve/main/gemmasutra-small-4b-v1.f16.gguf) |
| `gemmasutra-small-4b-v1.q2_k.gguf` | [Download](https://huggingface.co/matrixportal/Gemmasutra-Small-4B-v1-GGUF/resolve/main/gemmasutra-small-4b-v1.q2_k.gguf) |
| `gemmasutra-small-4b-v1.q3_k_m.gguf` | [Download](https://huggingface.co/matrixportal/Gemmasutra-Small-4B-v1-GGUF/resolve/main/gemmasutra-small-4b-v1.q3_k_m.gguf) |
| `gemmasutra-small-4b-v1.q4_0.gguf` | [Download](https://huggingface.co/matrixportal/Gemmasutra-Small-4B-v1-GGUF/resolve/main/gemmasutra-small-4b-v1.q4_0.gguf) |
| `gemmasutra-small-4b-v1.q4_k_m.gguf` | [Download](https://huggingface.co/matrixportal/Gemmasutra-Small-4B-v1-GGUF/resolve/main/gemmasutra-small-4b-v1.q4_k_m.gguf) |
| `gemmasutra-small-4b-v1.q5_k_m.gguf` | [Download](https://huggingface.co/matrixportal/Gemmasutra-Small-4B-v1-GGUF/resolve/main/gemmasutra-small-4b-v1.q5_k_m.gguf) |
| `gemmasutra-small-4b-v1.q6_k.gguf` | [Download](https://huggingface.co/matrixportal/Gemmasutra-Small-4B-v1-GGUF/resolve/main/gemmasutra-small-4b-v1.q6_k.gguf) |
| `gemmasutra-small-4b-v1.q8_0.gguf` | [Download](https://huggingface.co/matrixportal/Gemmasutra-Small-4B-v1-GGUF/resolve/main/gemmasutra-small-4b-v1.q8_0.gguf) |
## Usage Instructions
1. Download desired GGUF file
2. Use with compatible tools:
- [llama.cpp](https://github.com/ggerganov/llama.cpp)
- [Ollama](https://ollama.ai/)
- [LM Studio](https://lmstudio.ai/)
- [GPT4All](https://gpt4all.io)
💡 **Tip:** Q4_K_M offers the best balance for most use cases.

3
gemmasutra-small-4b-v1.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:442ad49b87fadc380c21522b45418f7882f6c2c24a6ff002a78ec5607bd30f63
size 7727230944

3
gemmasutra-small-4b-v1.fp16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b9a815373c948a4eaba4bb3ae426d75eaa9a66401d589b87c0798e7f01b762db
size 7727230944

3
gemmasutra-small-4b-v1.q2-k.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d52b6270a489bbccaff7882494859b0327d9c03f423722e3623ece4e9240bea8
size 1685184480

3
gemmasutra-small-4b-v1.q2_k.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d52b6270a489bbccaff7882494859b0327d9c03f423722e3623ece4e9240bea8
size 1685184480

3
gemmasutra-small-4b-v1.q3-k-l.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c6692e3a4d8c64a2c4d5e43e5cf96ad3f57aa4ec0a189314586b27ded8a48a07
size 2203086816

3
gemmasutra-small-4b-v1.q3-k-m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c43fafc8d13840f396a7332245c2ac24998de9f5bdb60a813af60ad6cd82fb0b
size 2060349408

3
gemmasutra-small-4b-v1.q3-k-s.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:51e1b9653e3b77c5f051606986953b4dc9f5b51f75dd6c3ec50ac30816a132ce
size 1896525792

3
gemmasutra-small-4b-v1.q3_k_l.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c6692e3a4d8c64a2c4d5e43e5cf96ad3f57aa4ec0a189314586b27ded8a48a07
size 2203086816

3
gemmasutra-small-4b-v1.q3_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c43fafc8d13840f396a7332245c2ac24998de9f5bdb60a813af60ad6cd82fb0b
size 2060349408

3
gemmasutra-small-4b-v1.q3_k_s.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:51e1b9653e3b77c5f051606986953b4dc9f5b51f75dd6c3ec50ac30816a132ce
size 1896525792

3
gemmasutra-small-4b-v1.q4-0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:04f2e9d383913cb3310bbb96c8360b2f70c541ec22203bbd25a4926b6db92c9c
size 2330820576

3
gemmasutra-small-4b-v1.q4-k-m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:659a22180e4f813d3192c2798ebfca08941b19f86662b639043ee4c246570b3c
size 2458554336

3
gemmasutra-small-4b-v1.q4-k-s.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:43b77a5c92bfd5d6c0ade9aa301b7089872a8fdd956895d0844df09cdb33b252
size 2345271264

3
gemmasutra-small-4b-v1.q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:04f2e9d383913cb3310bbb96c8360b2f70c541ec22203bbd25a4926b6db92c9c
size 2330820576

3
gemmasutra-small-4b-v1.q4_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:659a22180e4f813d3192c2798ebfca08941b19f86662b639043ee4c246570b3c
size 2458554336

3
gemmasutra-small-4b-v1.q4_k_s.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:43b77a5c92bfd5d6c0ade9aa301b7089872a8fdd956895d0844df09cdb33b252
size 2345271264

3
gemmasutra-small-4b-v1.q5-k-m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:56810ff8cb54c4aeafdafd4b6de286fbc1742ac97a17c6af43e9ecbe88c0dd99
size 2805370848

3
gemmasutra-small-4b-v1.q5_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:56810ff8cb54c4aeafdafd4b6de286fbc1742ac97a17c6af43e9ecbe88c0dd99
size 2805370848

3
gemmasutra-small-4b-v1.q6-k.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:56d20e3855cfad9171933d01f4a3361425569a6527239765a8a26f2383cae52d
size 3173863392

3
gemmasutra-small-4b-v1.q6_k.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:56d20e3855cfad9171933d01f4a3361425569a6527239765a8a26f2383cae52d
size 3173863392

3
gemmasutra-small-4b-v1.q8-0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:743823a14345efff669ea7a47c802faae237d5fbf07e1ee7642dacb1374c098e
size 4108660704

3
gemmasutra-small-4b-v1.q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:743823a14345efff669ea7a47c802faae237d5fbf07e1ee7642dacb1374c098e
size 4108660704