59 lines
2.1 KiB
Markdown
59 lines
2.1 KiB
Markdown
|
---
|
|||
|
|
license: other
|
|||
|
|
---
|
|||
|
|
# Join our Discord! https://discord.gg/Nbv9pQ88Xb
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
[BeaverAI](https://huggingface.co/BeaverAI) proudly presents...
|
|||
|
|
|
|||
|
|
# Rocinante 12B v1.1 🚀
|
|||
|
|
|
|||
|
|
#### A versatile workhorse for any adventure!
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
*Finding him so mettlesome, conceived a good omen from his eagerness, believing it a certain presage of his success in the dreadful adventure he was about to achieve.*
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
*He steered his course homeward; and Rocinante, as if he had guessed the knight’s intention, began to move with such alacrity and nimbleness, that his hooves scarcely seemed to touch the ground.*
|
|||
|
|
|
|||
|
|
## Description
|
|||
|
|
|
|||
|
|
If you would like a pure off-the-rails experience, try [Rocinante 12B v1](https://huggingface.co/TheDrummer/Rocinante-12B-v1)
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
Testers have reported:
|
|||
|
|
- Plenty of new and moistier words!
|
|||
|
|
- Richer and distinct prose
|
|||
|
|
- Cranked up creativity
|
|||
|
|
- Engaging and adventure-filled storytelling
|
|||
|
|
|
|||
|
|
## Arsenal (Supported Chat Templates)
|
|||
|
|
- ChatML for RP
|
|||
|
|
- Alpaca for Story / Instruct Adventure
|
|||
|
|
- Mistral for NeMo
|
|||
|
|
- You can mix it up and see which works best for you.
|
|||
|
|
|
|||
|
|
## Sampler Suggestions
|
|||
|
|
- Use DRY
|
|||
|
|
- Suggestion: Temp 0.7 for a chill, familiar ride. Temp 1.2 for a nitro boost!
|
|||
|
|
|
|||
|
|
## Links
|
|||
|
|
- Original: https://huggingface.co/TheDrummer/Rocinante-12B-v1.1
|
|||
|
|
- GGUF: https://huggingface.co/TheDrummer/Rocinante-12B-v1.1-GGUF
|
|||
|
|
- GGUF (iMatrix): WIP
|
|||
|
|
- EXL2 (4bpw): https://huggingface.co/Statuo/Rocinante-v1.1-EXL2-4bpw
|
|||
|
|
- EXL2 (6bpw): https://huggingface.co/Statuo/Rocinante-v1.1-EXL2-6bpw
|
|||
|
|
- EXL2 (8bpw): https://huggingface.co/Statuo/Rocinante-v1.1-EXL2-8bpw
|
|||
|
|
|
|||
|
|
## Credit
|
|||
|
|
|
|||
|
|
Thank you for the compute, Garg!
|
|||
|
|
|
|||
|
|
Thank you for the Della merge, [MarinaraSpaghetti](https://huggingface.co/MarinaraSpaghetti)!
|
|||
|
|
|
|||
|
|
Thank you Statuo for the EXL2 quants!
|
|||
|
|
|
|||
|
|
|