TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-27 19:40:39 +08:00
commit e82a1d6169
21 changed files with 210 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

61
.gitattributes vendored Normal file
View File

@@ -0,0 +1,61 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1i-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1i-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1i-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1i-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1i-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1i-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1i-f16.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-f16.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-BF16.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1-f32.gguf filter=lfs diff=lfs merge=lfs -text

3
Gemmasutra-Mini-2B-v1-BF16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c7248e06f63fd90c26a022c749bd9c30e1f0f1e2717092b5856f042a0e882edf
size 5235213760

3
Gemmasutra-Mini-2B-v1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1fe311576032985f3eca62c0233d276f2fa972681bddb893ddfdd1a5132f31ee
size 1229830016

3
Gemmasutra-Mini-2B-v1-Q3_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b2e9db42418c6c16d9ff726c20009aaf094eaacd3b38a028b31e4944457bf16
size 1461667264

3
Gemmasutra-Mini-2B-v1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:544ffa229168a8c980168ce6b9c39ed7c713c5c5a67845ea8a751c932b4ca2ce
size 1550435776

3
Gemmasutra-Mini-2B-v1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:64c414a3a278d8843394b578ecf6326eacd470bd01a4292bdcaf01b9802ff5e5
size 1461667712

3
Gemmasutra-Mini-2B-v1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:77d2dcdae0d99a814074b030b5c77ee969c70e20fb6c471de1ee252b651bab30
size 1360659904

3
Gemmasutra-Mini-2B-v1-Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:39bf699490eb8d4e0590339247502ec790cb46976a304eebd42220011370207b
size 1629509056

3
Gemmasutra-Mini-2B-v1-Q4_0_4_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b10a8b4ef16f64753ef0de35fdfd7bd11ce15daad21e269f78237a6610e7197
size 1629509056

3
Gemmasutra-Mini-2B-v1-Q4_0_8_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0de7a04368f20faa2833c6370158463f653ebf9d9a8c74f5df202c475c32e5c7
size 1629509056

3
Gemmasutra-Mini-2B-v1-Q4_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ecd0e1275c40c9c858ca66217e0c005e94e3c16e4c0f9377545bec5783ad22cb
size 1708582336

3
Gemmasutra-Mini-2B-v1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:29ba3db911fbadef4452ba757ddd9ce58fb892b7a872f19eefd0743c961797fb
size 1708582784

3
Gemmasutra-Mini-2B-v1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:843be91da345256357182a2131815d22d8423558adf1b0deee88b3a61e117186
size 1638651328

3
Gemmasutra-Mini-2B-v1-Q5_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84692ccc0458816e701296781a28911e727859c69c5757bcd89b5253a141c51b
size 1923278272

3
Gemmasutra-Mini-2B-v1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2aee754987cea34673a0b72d9298d0c09ef68f05aa4239bf9dddbb896bc8cf84
size 1923278720

3
Gemmasutra-Mini-2B-v1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2359edea9b20b6e54a1d96be8645c00be768a55f2f4608d37b6684805df7618f
size 1882543552

3
Gemmasutra-Mini-2B-v1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34bdca7d62ae0b15366a6f3d7f457d6d8ef96343e72c5e4555b6475c4a78e839
size 2151393152

3
Gemmasutra-Mini-2B-v1-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f3cf6a090f92f132bf3c77d49158fb1f63d6acf6c2f473d1b453620fa796568
size 2784495488

3
Gemmasutra-Mini-2B-v1-f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9270ba3b358b9689340f2b0b1b79a5666718e516e38b569ad736613de81cc741
size 5235214208

3
Gemmasutra-Mini-2B-v1-f32.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8043cf59f9332f0a962826a518129ba07b1054663d827ad4bf511454c34e7be7
size 10463413696

92
README.md Normal file
View File

@@ -0,0 +1,92 @@
---
license: other
---
# Join our Discord! https://discord.gg/Nbv9pQ88Xb
### Works on [Kobold 1.72](https://github.com/LostRuins/koboldcpp/releases/tag/v1.72) and [Layla (iOS / Android)](https://www.layla-network.ai/)
---
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/HjVYV2h_YTL9P-insb7fz.png)
[BeaverAI](https://huggingface.co/BeaverAI) team proudly presents
# Gemmasutra Mini 2B v1 🧘
*Gemma's been training for ALL of you.*
![image/webp](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/w0Oi8TReoQNT3ljm5Wf6c.webp)
*A tiny RP model packing an unbelievable PUNCH. Finetuned by yours truly.*
## Description
Gone are the days when models below 7B were too small to give you a satisfying RP experience.
Gemmasutra Mini 2B v1 marks the beginning of a new chapter in our local LLM community.
Be it in your browser, your crappy laptop, your mid-tier phone running [Layla](https://www.layla-network.ai/), or your Raspberry Pi...
This lil 2B will give you a playthrough worth having.
A model for thee, a model for all!
*(And yes, it is uncensored and unaligned. Enjoy!)*
## Links
- Original: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1
- GGUF: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
- iMatrix (recommended / better quants): https://huggingface.co/MarsupialAI/Gemmasutra-Mini-2B-v1_iMatrix_GGUF
## Usage
- For the best experience, use the Gemma Instruct template and modify it to support the `system` role (e.g., `<start_of_turn>system`)
- Chat Completion works well too
- Don't use it for Math
## Examples
A big thanks to @kurgan1138 for most of the logs!
### SFW
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/IstS_eSV_Z52jII1UkZ7d.png)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/eLU-AlpTd8VCI9H7gOmX2.png)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/Rnpwj1XE0CflOnOyJtJSK.png)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/7Y9x9A2HYoyfMkrBpBeO4.png)
#### 4K context
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/te_wnC9Tcg2BVeLrtARjr.png)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/oTiXmVmK7KiI26wgHmS1u.png)
### NSFW NSFW NSFW NSFW NSFW
### NSFW NSFW NSFW NSFW NSFW
### NSFW NSFW NSFW NSFW NSFW
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/J9SwuYQBULHY9Wobljv5V.png)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/qhCgIEAeXJqA0Msq5mAFA.png)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/RkgOg_mvjADiXgb5859gm.png)
#### Forgiveness Meter
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/_NnPS-kwD7ZpoWUa3wvux.png)
#### Group Character
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/TxF2YbcUwJOtcqxWSKybZ.png)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/CQKkSq6lXj7yKuwcoPdeQ.png)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/4uWEjHylkhgPOu1UTkg8w.png)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/q0KFuHhh3ybz51DQze89G.png)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/Ll8CA5RR7ugTi72P2HBb8.png)