初始化项目,由ModelHub XC社区提供模型
Model: SufficientPrune3897/Gemma-3-12B-Character-Creator-V2-GGUF Source: Original Platform
This commit is contained in:
40
.gitattributes
vendored
Normal file
40
.gitattributes
vendored
Normal file
@@ -0,0 +1,40 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
Gemma-3-12B-Character-Creator-V2-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Gemma-3-12B-Character-Creator-V2-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Gemma-3-12B-Character-Creator-V2-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Gemma-3-12B-Character-Creator-V2-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Gemma-3-12B-Character-Creator-V2-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
Gemma-3-12B-Character-Creator-V2-IQ3_M.gguf
Normal file
3
Gemma-3-12B-Character-Creator-V2-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4df926f1fbc0dcda85b4fd07987fb01e9294554884f3052d6e688a4e0ac85fb1
|
||||
size 5655721664
|
||||
3
Gemma-3-12B-Character-Creator-V2-IQ4_NL.gguf
Normal file
3
Gemma-3-12B-Character-Creator-V2-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d441ba52a7ffe9a5ab0342c82d3cedf8890d099674678156c436047741deb502
|
||||
size 6931400384
|
||||
3
Gemma-3-12B-Character-Creator-V2-Q4_K_M.gguf
Normal file
3
Gemma-3-12B-Character-Creator-V2-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1fc689c92fb8effdc0124b226f89d7f8104fe2be698032e3254f57066855b634
|
||||
size 7300777664
|
||||
3
Gemma-3-12B-Character-Creator-V2-Q5_K_M.gguf
Normal file
3
Gemma-3-12B-Character-Creator-V2-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ffcaf27a6e0c86df68fe95a531e1b65283fbe1d6bd17b23d49e1b59acd90ff82
|
||||
size 8445036224
|
||||
3
Gemma-3-12B-Character-Creator-V2-Q8_0.gguf
Normal file
3
Gemma-3-12B-Character-Creator-V2-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f35abb7feb52675284970087c11da741228af24a5b67bb8999ee18a78c660f97
|
||||
size 12510211904
|
||||
69
README.md
Normal file
69
README.md
Normal file
@@ -0,0 +1,69 @@
|
||||
---
|
||||
base_model:
|
||||
- p-e-w/gemma-3-12b-it-heretic-v2
|
||||
tags:
|
||||
- text-generation-inference
|
||||
- transformers
|
||||
- unsloth
|
||||
- gemma3
|
||||
- roleplay
|
||||
- sillytavern
|
||||
- characters
|
||||
- gguf
|
||||
license: apache-2.0
|
||||
language:
|
||||
- en
|
||||
---
|
||||
|
||||
# Gemma-3-12B-Character-Creator-V2 - GGUF Quants
|
||||
|
||||
GGUF quantizations of [SufficientPrune3897/Gemma-3-12B-Character-Creator-V2](https://huggingface.co/SufficientPrune3897/Gemma-3-12B-Character-Creator-V2).
|
||||
|
||||
This is a model made to create characters that can be used in Sillytavern, cai, jai and other such roleplay scenarios. The resulting characters should be about ~2k tokens and follow a prebaked structure.
|
||||
|
||||
Versions:
|
||||
- 8B llama 3.3 based and [GGUFs](https://huggingface.co/SufficientPrune3897/Llama-3.3-8B-Character-Creator-V2-GGUF)
|
||||
- 12B gemma 3 based (this one) and GGUFs
|
||||
- 24B mistral small 3.2 based and GGUFs
|
||||
- (maybe) 27B gemma 3 based and GGUFs
|
||||
|
||||
## How to use it:
|
||||
- Simply tell the model what you want your character to be.
|
||||
- It should know many popular franchises, the bigger the model, the more it knows.
|
||||
- Fully uncensored.
|
||||
- Asking for a different structure than the one the model uses might significantly reduce result quality.
|
||||
- While follow up questions are supported, you will often get better results adjusting your original prompt.
|
||||
- Supports asking for: prompts for pictures of the char, asking for changes and making an intro.
|
||||
|
||||
## Changes [from V1](https://huggingface.co/SufficientPrune3897/gemma-3-27b-Character-Creator)
|
||||
- No longer supports Groups and scenarios
|
||||
- Characters should be much better
|
||||
- It actually follows a structure and doesnt start making shit up after ~1k tokens
|
||||
|
||||
## Available Quants
|
||||
|
||||
| Filename | Quant | Size | Description |
|
||||
|----------|-------|------|-------------|
|
||||
| `Gemma-3-12B-Character-Creator-V2-Q8_0.gguf` | Q8_0 | 12GB | Maximum quality, near-lossless |
|
||||
| `Gemma-3-12B-Character-Creator-V2-Q5_K_M.gguf` | Q5_K_M | 7.9GB | High quality, recommended |
|
||||
| `Gemma-3-12B-Character-Creator-V2-Q4_K_M.gguf` | Q4_K_M | 6.9GB | Good quality, good balance |
|
||||
| `Gemma-3-12B-Character-Creator-V2-IQ4_NL.gguf` | IQ4_NL | 6.5GB | Good quality, slightly smaller than Q4_K_M |
|
||||
| `Gemma-3-12B-Character-Creator-V2-IQ3_M.gguf` | IQ3_M | 5.3GB | Smaller, some quality loss |
|
||||
|
||||
## V3 and beyond:
|
||||
The next version will either reintroduce scenarios, groups or feature reasoning. Probably both. Perhaps even lorebooks, although I'm still unsure how to execute on that... After that I will probably make my own real roleplay finetune or something.
|
||||
|
||||
If anybody wants support of their native language just ask me and tell me what model does the best for that.
|
||||
|
||||
I am very much open for feedback. A single comment can easily change how I will do my next version.
|
||||
|
||||
---
|
||||
|
||||
- **Developed by:** SufficientPrune3897
|
||||
- **License:** apache-2.0
|
||||
- **Finetuned from model:** p-e-w/gemma-3-12b-it-heretic-v2
|
||||
- **Quantized with:** [llama.cpp](https://github.com/ggml-org/llama.cpp)
|
||||
|
||||
This gemma3 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
||||
|
||||
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
||||
Reference in New Issue
Block a user