初始化项目,由ModelHub XC社区提供模型
Model: TheBloke/WizardLM-30B-fp16 Source: Original Platform
This commit is contained in:
85
README.md
Normal file
85
README.md
Normal file
@@ -0,0 +1,85 @@
|
||||
---
|
||||
inference: false
|
||||
license: other
|
||||
---
|
||||
|
||||
<!-- header start -->
|
||||
<div style="width: 100%;">
|
||||
<img src="https://i.imgur.com/EBdldam.jpg" alt="TheBlokeAI" style="width: 100%; min-width: 400px; display: block; margin: auto;">
|
||||
</div>
|
||||
<div style="display: flex; justify-content: space-between; width: 100%;">
|
||||
<div style="display: flex; flex-direction: column; align-items: flex-start;">
|
||||
<p><a href="https://discord.gg/Jq4vkcDakD">Chat & support: my new Discord server</a></p>
|
||||
</div>
|
||||
<div style="display: flex; flex-direction: column; align-items: flex-end;">
|
||||
<p><a href="https://www.patreon.com/TheBlokeAI">Want to contribute? TheBloke's Patreon page</a></p>
|
||||
</div>
|
||||
</div>
|
||||
<!-- header end -->
|
||||
|
||||
# WizardLM's WizardLM 30B v1.0 fp16
|
||||
|
||||
These files are pytorch format fp16 model files for [WizardLM's WizardLM 30B v1.0](https://huggingface.co/WizardLM/WizardLM-30B-V1.0).
|
||||
|
||||
It is the result of merging the delta at the above repo with the original Llama 30B model.
|
||||
|
||||
## Repositories available
|
||||
|
||||
* [4-bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/WizardLM-30B-GPTQ)
|
||||
* [4-bit, 5-bit and 8-bit GGML models for CPU(+GPU) inference](https://huggingface.co/TheBloke/WizardLM-30B-GGML)
|
||||
* [Unquantised fp16 model in pytorch format, for GPU inference and for further conversions](https://huggingface.co/TheBloke/WizardLM-30B-fp16)
|
||||
|
||||
## Prompt template
|
||||
|
||||
```
|
||||
A chat between a curious user and an artificial intelligence assistant.
|
||||
The assistant gives helpful, detailed, and polite answers to the user's questions.
|
||||
USER: prompt goes here
|
||||
ASSISTANT:
|
||||
```
|
||||
|
||||
<!-- footer start -->
|
||||
## Discord
|
||||
|
||||
For further support, and discussions on these models and AI in general, join us at:
|
||||
|
||||
[TheBloke AI's Discord server](https://discord.gg/Jq4vkcDakD)
|
||||
|
||||
## Thanks, and how to contribute.
|
||||
|
||||
Thanks to the [chirper.ai](https://chirper.ai) team!
|
||||
|
||||
I've had a lot of people ask if they can contribute. I enjoy providing models and helping people, and would love to be able to spend even more time doing it, as well as expanding into new projects like fine tuning/training.
|
||||
|
||||
If you're able and willing to contribute it will be most gratefully received and will help me to keep providing more models, and to start work on new AI projects.
|
||||
|
||||
Donaters will get priority support on any and all AI/LLM/model questions and requests, access to a private Discord room, plus other benefits.
|
||||
|
||||
* Patreon: https://patreon.com/TheBlokeAI
|
||||
* Ko-Fi: https://ko-fi.com/TheBlokeAI
|
||||
|
||||
**Special thanks to**: Luke from CarbonQuill, Aemon Algiz, Dmitriy Samsonov.
|
||||
|
||||
**Patreon special mentions**: Ajan Kanaga, Kalila, Derek Yates, Sean Connelly, Luke, Nathan LeClaire, Trenton Dambrowitz, Mano Prime, David Flickinger, vamX, Nikolai Manek, senxiiz, Khalefa Al-Ahmad, Illia Dulskyi, trip7s trip, Jonathan Leane, Talal Aujan, Artur Olbinski, Cory Kujawski, Joseph William Delisle, Pyrater, Oscar Rangel, Lone Striker, Luke Pendergrass, Eugene Pentland, Johann-Peter Hartmann.
|
||||
|
||||
Thank you to all my generous patrons and donaters!
|
||||
|
||||
<!-- footer end -->
|
||||
|
||||
# Original model card: WizardLM's WizardLM 30B v1.0
|
||||
|
||||
This is WizardLM-30B V1.0 delta weight.
|
||||
|
||||
Project Repo: https://github.com/nlpxucan/WizardLM
|
||||
|
||||
|
||||
NOTE: The **WizardLM-30B-V1.0** & **WizardLM-13B-V1.0** use different prompt with **Wizard-7B-V1.0** at the beginning of the conversation:
|
||||
|
||||
1. For **WizardLM-30B-V1.0** & **WizardLM-13B-V1.0** , the Prompt should be as following:
|
||||
|
||||
"A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: hello, who are you? ASSISTANT:"
|
||||
|
||||
|
||||
2. For **WizardLM-7B-V1.0** , the Prompt should be as following:
|
||||
|
||||
"{instruction}\n\n### Response:"
|
||||
Reference in New Issue
Block a user