初始化项目,由ModelHub XC社区提供模型
Model: SufficientPrune3897/Gemma-3-12B-Character-Creator-V2-GGUF Source: Original Platform
This commit is contained in:
40
.gitattributes
vendored
Normal file
40
.gitattributes
vendored
Normal file
@@ -0,0 +1,40 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Gemma-3-12B-Character-Creator-V2-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Gemma-3-12B-Character-Creator-V2-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Gemma-3-12B-Character-Creator-V2-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Gemma-3-12B-Character-Creator-V2-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Gemma-3-12B-Character-Creator-V2-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
3
Gemma-3-12B-Character-Creator-V2-IQ3_M.gguf
Normal file
3
Gemma-3-12B-Character-Creator-V2-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4df926f1fbc0dcda85b4fd07987fb01e9294554884f3052d6e688a4e0ac85fb1
|
||||||
|
size 5655721664
|
||||||
3
Gemma-3-12B-Character-Creator-V2-IQ4_NL.gguf
Normal file
3
Gemma-3-12B-Character-Creator-V2-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d441ba52a7ffe9a5ab0342c82d3cedf8890d099674678156c436047741deb502
|
||||||
|
size 6931400384
|
||||||
3
Gemma-3-12B-Character-Creator-V2-Q4_K_M.gguf
Normal file
3
Gemma-3-12B-Character-Creator-V2-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1fc689c92fb8effdc0124b226f89d7f8104fe2be698032e3254f57066855b634
|
||||||
|
size 7300777664
|
||||||
3
Gemma-3-12B-Character-Creator-V2-Q5_K_M.gguf
Normal file
3
Gemma-3-12B-Character-Creator-V2-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ffcaf27a6e0c86df68fe95a531e1b65283fbe1d6bd17b23d49e1b59acd90ff82
|
||||||
|
size 8445036224
|
||||||
3
Gemma-3-12B-Character-Creator-V2-Q8_0.gguf
Normal file
3
Gemma-3-12B-Character-Creator-V2-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f35abb7feb52675284970087c11da741228af24a5b67bb8999ee18a78c660f97
|
||||||
|
size 12510211904
|
||||||
69
README.md
Normal file
69
README.md
Normal file
@@ -0,0 +1,69 @@
|
|||||||
|
---
|
||||||
|
base_model:
|
||||||
|
- p-e-w/gemma-3-12b-it-heretic-v2
|
||||||
|
tags:
|
||||||
|
- text-generation-inference
|
||||||
|
- transformers
|
||||||
|
- unsloth
|
||||||
|
- gemma3
|
||||||
|
- roleplay
|
||||||
|
- sillytavern
|
||||||
|
- characters
|
||||||
|
- gguf
|
||||||
|
license: apache-2.0
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
---
|
||||||
|
|
||||||
|
# Gemma-3-12B-Character-Creator-V2 - GGUF Quants
|
||||||
|
|
||||||
|
GGUF quantizations of [SufficientPrune3897/Gemma-3-12B-Character-Creator-V2](https://huggingface.co/SufficientPrune3897/Gemma-3-12B-Character-Creator-V2).
|
||||||
|
|
||||||
|
This is a model made to create characters that can be used in Sillytavern, cai, jai and other such roleplay scenarios. The resulting characters should be about ~2k tokens and follow a prebaked structure.
|
||||||
|
|
||||||
|
Versions:
|
||||||
|
- 8B llama 3.3 based and [GGUFs](https://huggingface.co/SufficientPrune3897/Llama-3.3-8B-Character-Creator-V2-GGUF)
|
||||||
|
- 12B gemma 3 based (this one) and GGUFs
|
||||||
|
- 24B mistral small 3.2 based and GGUFs
|
||||||
|
- (maybe) 27B gemma 3 based and GGUFs
|
||||||
|
|
||||||
|
## How to use it:
|
||||||
|
- Simply tell the model what you want your character to be.
|
||||||
|
- It should know many popular franchises, the bigger the model, the more it knows.
|
||||||
|
- Fully uncensored.
|
||||||
|
- Asking for a different structure than the one the model uses might significantly reduce result quality.
|
||||||
|
- While follow up questions are supported, you will often get better results adjusting your original prompt.
|
||||||
|
- Supports asking for: prompts for pictures of the char, asking for changes and making an intro.
|
||||||
|
|
||||||
|
## Changes [from V1](https://huggingface.co/SufficientPrune3897/gemma-3-27b-Character-Creator)
|
||||||
|
- No longer supports Groups and scenarios
|
||||||
|
- Characters should be much better
|
||||||
|
- It actually follows a structure and doesnt start making shit up after ~1k tokens
|
||||||
|
|
||||||
|
## Available Quants
|
||||||
|
|
||||||
|
| Filename | Quant | Size | Description |
|
||||||
|
|----------|-------|------|-------------|
|
||||||
|
| `Gemma-3-12B-Character-Creator-V2-Q8_0.gguf` | Q8_0 | 12GB | Maximum quality, near-lossless |
|
||||||
|
| `Gemma-3-12B-Character-Creator-V2-Q5_K_M.gguf` | Q5_K_M | 7.9GB | High quality, recommended |
|
||||||
|
| `Gemma-3-12B-Character-Creator-V2-Q4_K_M.gguf` | Q4_K_M | 6.9GB | Good quality, good balance |
|
||||||
|
| `Gemma-3-12B-Character-Creator-V2-IQ4_NL.gguf` | IQ4_NL | 6.5GB | Good quality, slightly smaller than Q4_K_M |
|
||||||
|
| `Gemma-3-12B-Character-Creator-V2-IQ3_M.gguf` | IQ3_M | 5.3GB | Smaller, some quality loss |
|
||||||
|
|
||||||
|
## V3 and beyond:
|
||||||
|
The next version will either reintroduce scenarios, groups or feature reasoning. Probably both. Perhaps even lorebooks, although I'm still unsure how to execute on that... After that I will probably make my own real roleplay finetune or something.
|
||||||
|
|
||||||
|
If anybody wants support of their native language just ask me and tell me what model does the best for that.
|
||||||
|
|
||||||
|
I am very much open for feedback. A single comment can easily change how I will do my next version.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
- **Developed by:** SufficientPrune3897
|
||||||
|
- **License:** apache-2.0
|
||||||
|
- **Finetuned from model:** p-e-w/gemma-3-12b-it-heretic-v2
|
||||||
|
- **Quantized with:** [llama.cpp](https://github.com/ggml-org/llama.cpp)
|
||||||
|
|
||||||
|
This gemma3 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
||||||
|
|
||||||
|
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
||||||
Reference in New Issue
Block a user