2.8 KiB
2.8 KiB
base_model, library_name, tags, new_version
| base_model | library_name | tags | new_version | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
transformers |
|
RicardoEstep/RPBizkit-v4-12B |
RicardoEstep/RPBizkit-v2-12B
"Experimental Karcher-Mean Mix" using "Mergekit".
Don't ask me how i could merge it with only "16GBs of RAM", all models are mixed equaly and all their data have same importance. I'm not responsible of the use of this.
I did it all for the nookie, so you can take that cookie, and stick it up your...
Models used:
- DreadPoor/Krix-12B-Model_Stock
- SicariusSicariiStuff/Impish_Bloodmoon_12B
- yamatazen/EtherealAurora-12B
- redrix/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-v3
- Retreatcost/KansenSakura-Eclipse-RP-12b
- yamatazen/NeonMaid-12B-v2
- yamatazen/FusionEngine-12B-Lorablated
I couldn't use "yamatazen/EsotericSage-12B" cause it give me problems with "Weights", & "ReadyArt/Safeword-Casual-V1-12B" cause it uses "Gemma-3".
The recommended max context size is "8K (8192)". Some of the models in the mix, used a "fake rope_theta hack" to support "1M" of context size, and this model coppied that configuration. This are not a real numbers, and would NOT give you a "meaningful long‑context behavior".
- Quantized Model, Here RicardoEstep/RPBizkit-v2-12B-GGUF.
YAML Configuration Used:
models:
- model: DreadPoor/Krix-12B-Model_Stock
- model: redrix/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-v3
- model: SicariusSicariiStuff/Impish_Bloodmoon_12B
- model: Retreatcost/KansenSakura-Eclipse-RP-12b
- model: yamatazen/NeonMaid-12B-v2
- model: yamatazen/EtherealAurora-12B
- model: yamatazen/FusionEngine-12B-Lorablated
merge_method: karcher
base_model: DreadPoor/Krix-12B-Model_Stock
dtype: bfloat16
parameters:
normalize: true
karcher_steps: 64 # Extremely Clean, Stable, High‑quality Merge.
tolerance: 1e-7 # Maximum smoothness and Minimal artifacts.
tokenizer:
source: union