92 lines
3.6 KiB
Markdown
92 lines
3.6 KiB
Markdown
---
|
|
license: other
|
|
---
|
|
# Join our Discord! https://discord.gg/Nbv9pQ88Xb
|
|
|
|
### Works on [Kobold 1.72](https://github.com/LostRuins/koboldcpp/releases/tag/v1.72) and [Layla (iOS / Android)](https://www.layla-network.ai/)
|
|
|
|
---
|
|
|
|
|
|
|
|
[BeaverAI](https://huggingface.co/BeaverAI) team proudly presents
|
|
|
|
# Gemmasutra Mini 2B v1 🧘
|
|
|
|
*Gemma's been training for ALL of you.*
|
|
|
|
|
|
|
|
*A tiny RP model packing an unbelievable PUNCH. Finetuned by yours truly.*
|
|
|
|
## Description
|
|
|
|
Gone are the days when models below 7B were too small to give you a satisfying RP experience.
|
|
|
|
Gemmasutra Mini 2B v1 marks the beginning of a new chapter in our local LLM community.
|
|
|
|
Be it in your browser, your crappy laptop, your mid-tier phone running [Layla](https://www.layla-network.ai/), or your Raspberry Pi...
|
|
|
|
This lil 2B will give you a playthrough worth having.
|
|
|
|
A model for thee, a model for all!
|
|
|
|
*(And yes, it is uncensored and unaligned. Enjoy!)*
|
|
|
|
## Links
|
|
|
|
- Original: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1
|
|
- GGUF: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
|
|
- iMatrix (recommended / better quants): https://huggingface.co/MarsupialAI/Gemmasutra-Mini-2B-v1_iMatrix_GGUF
|
|
|
|
## Usage
|
|
|
|
- For the best experience, use the Gemma Instruct template and modify it to support the `system` role (e.g., `<start_of_turn>system`)
|
|
- Chat Completion works well too
|
|
- Don't use it for Math
|
|
|
|
## Examples
|
|
|
|
A big thanks to @kurgan1138 for most of the logs!
|
|
|
|
### SFW
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
#### 4K context
|
|
|
|
|
|
|
|
|
|
|
|
### NSFW NSFW NSFW NSFW NSFW
|
|
### NSFW NSFW NSFW NSFW NSFW
|
|
### NSFW NSFW NSFW NSFW NSFW
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
#### Forgiveness Meter
|
|
|
|
|
|
|
|
#### Group Character
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
 |