commit 091c61422c60a7820078755c1c003413a7b10d42 Author: ModelHub XC Date: Sun Apr 26 05:02:07 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: SufficientPrune3897/Gemma-3-12B-Character-Creator-V2-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..bf5515e --- /dev/null +++ b/.gitattributes @@ -0,0 +1,40 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Gemma-3-12B-Character-Creator-V2-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-3-12B-Character-Creator-V2-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-3-12B-Character-Creator-V2-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-3-12B-Character-Creator-V2-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-3-12B-Character-Creator-V2-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Gemma-3-12B-Character-Creator-V2-IQ3_M.gguf b/Gemma-3-12B-Character-Creator-V2-IQ3_M.gguf new file mode 100644 index 0000000..82159e1 --- /dev/null +++ b/Gemma-3-12B-Character-Creator-V2-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4df926f1fbc0dcda85b4fd07987fb01e9294554884f3052d6e688a4e0ac85fb1 +size 5655721664 diff --git a/Gemma-3-12B-Character-Creator-V2-IQ4_NL.gguf b/Gemma-3-12B-Character-Creator-V2-IQ4_NL.gguf new file mode 100644 index 0000000..031ca57 --- /dev/null +++ b/Gemma-3-12B-Character-Creator-V2-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d441ba52a7ffe9a5ab0342c82d3cedf8890d099674678156c436047741deb502 +size 6931400384 diff --git a/Gemma-3-12B-Character-Creator-V2-Q4_K_M.gguf b/Gemma-3-12B-Character-Creator-V2-Q4_K_M.gguf new file mode 100644 index 0000000..b19ce2b --- /dev/null +++ b/Gemma-3-12B-Character-Creator-V2-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1fc689c92fb8effdc0124b226f89d7f8104fe2be698032e3254f57066855b634 +size 7300777664 diff --git a/Gemma-3-12B-Character-Creator-V2-Q5_K_M.gguf b/Gemma-3-12B-Character-Creator-V2-Q5_K_M.gguf new file mode 100644 index 0000000..e169cfe --- /dev/null +++ b/Gemma-3-12B-Character-Creator-V2-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ffcaf27a6e0c86df68fe95a531e1b65283fbe1d6bd17b23d49e1b59acd90ff82 +size 8445036224 diff --git a/Gemma-3-12B-Character-Creator-V2-Q8_0.gguf b/Gemma-3-12B-Character-Creator-V2-Q8_0.gguf new file mode 100644 index 0000000..49ff8e4 --- /dev/null +++ b/Gemma-3-12B-Character-Creator-V2-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f35abb7feb52675284970087c11da741228af24a5b67bb8999ee18a78c660f97 +size 12510211904 diff --git a/README.md b/README.md new file mode 100644 index 0000000..eb0b433 --- /dev/null +++ b/README.md @@ -0,0 +1,69 @@ +--- +base_model: +- p-e-w/gemma-3-12b-it-heretic-v2 +tags: +- text-generation-inference +- transformers +- unsloth +- gemma3 +- roleplay +- sillytavern +- characters +- gguf +license: apache-2.0 +language: +- en +--- + +# Gemma-3-12B-Character-Creator-V2 - GGUF Quants + +GGUF quantizations of [SufficientPrune3897/Gemma-3-12B-Character-Creator-V2](https://huggingface.co/SufficientPrune3897/Gemma-3-12B-Character-Creator-V2). + +This is a model made to create characters that can be used in Sillytavern, cai, jai and other such roleplay scenarios. The resulting characters should be about ~2k tokens and follow a prebaked structure. + +Versions: +- 8B llama 3.3 based and [GGUFs](https://huggingface.co/SufficientPrune3897/Llama-3.3-8B-Character-Creator-V2-GGUF) +- 12B gemma 3 based (this one) and GGUFs +- 24B mistral small 3.2 based and GGUFs +- (maybe) 27B gemma 3 based and GGUFs + +## How to use it: +- Simply tell the model what you want your character to be. +- It should know many popular franchises, the bigger the model, the more it knows. +- Fully uncensored. +- Asking for a different structure than the one the model uses might significantly reduce result quality. +- While follow up questions are supported, you will often get better results adjusting your original prompt. +- Supports asking for: prompts for pictures of the char, asking for changes and making an intro. + +## Changes [from V1](https://huggingface.co/SufficientPrune3897/gemma-3-27b-Character-Creator) +- No longer supports Groups and scenarios +- Characters should be much better +- It actually follows a structure and doesnt start making shit up after ~1k tokens + +## Available Quants + +| Filename | Quant | Size | Description | +|----------|-------|------|-------------| +| `Gemma-3-12B-Character-Creator-V2-Q8_0.gguf` | Q8_0 | 12GB | Maximum quality, near-lossless | +| `Gemma-3-12B-Character-Creator-V2-Q5_K_M.gguf` | Q5_K_M | 7.9GB | High quality, recommended | +| `Gemma-3-12B-Character-Creator-V2-Q4_K_M.gguf` | Q4_K_M | 6.9GB | Good quality, good balance | +| `Gemma-3-12B-Character-Creator-V2-IQ4_NL.gguf` | IQ4_NL | 6.5GB | Good quality, slightly smaller than Q4_K_M | +| `Gemma-3-12B-Character-Creator-V2-IQ3_M.gguf` | IQ3_M | 5.3GB | Smaller, some quality loss | + +## V3 and beyond: +The next version will either reintroduce scenarios, groups or feature reasoning. Probably both. Perhaps even lorebooks, although I'm still unsure how to execute on that... After that I will probably make my own real roleplay finetune or something. + +If anybody wants support of their native language just ask me and tell me what model does the best for that. + +I am very much open for feedback. A single comment can easily change how I will do my next version. + +--- + +- **Developed by:** SufficientPrune3897 +- **License:** apache-2.0 +- **Finetuned from model:** p-e-w/gemma-3-12b-it-heretic-v2 +- **Quantized with:** [llama.cpp](https://github.com/ggml-org/llama.cpp) + +This gemma3 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library. + +[](https://github.com/unslothai/unsloth)