初始化项目,由ModelHub XC社区提供模型
Model: duyntnet/Delexa-Instruct-V0.1-7b-imatrix-GGUF Source: Original Platform
This commit is contained in:
35
README.md
Normal file
35
README.md
Normal file
@@ -0,0 +1,35 @@
|
||||
---
|
||||
license: other
|
||||
language:
|
||||
- en
|
||||
pipeline_tag: text-generation
|
||||
inference: false
|
||||
tags:
|
||||
- transformers
|
||||
- gguf
|
||||
- imatrix
|
||||
- Delexa-Instruct-V0.1-7b
|
||||
---
|
||||
Quantizations of https://huggingface.co/lex-hue/Delexa-Instruct-V0.1-7b
|
||||
|
||||
|
||||
# From original readme
|
||||
|
||||
## Delexa-V0.1-Instruct-7b: Our Newest and Best Model Yet!
|
||||
|
||||
We are excited to announce the release of Delexa-V0.1-Instruct-7b, our newest and best model yet! Delexa-V0.1-Instruct-7b has shown excellent performance on a variety of tasks, and we are confident that it will be a valuable asset to the research community.
|
||||
|
||||
### Eval Results
|
||||
|
||||
Delexa-V0.1-Instruct-7b was evaluated on a dataset of question-answer pairs. The model was given a single question and three different answer choices, and it was tasked with selecting the best answer. Delexa-V0.1-Instruct-7b achieved an average score of 8.27 on this task.
|
||||
|
||||
Here is a table showing the detailed eval results:
|
||||
|
||||
| Model | Turn 1 | Turn 2 | Average |
|
||||
|---|---|---|---|
|
||||
| gpt-4 | 8.95625 | 9.0250 | 8.990625 |
|
||||
| Delexa-V0.1-Instruct-7b | 8.57500 | 7.9500 | 8.268750 |
|
||||
| claude-v1 | 8.15000 | 7.6500 | 7.900000 |
|
||||
| gpt-3.5-turbo | 8.07500 | 7.8125 | 7.943750 |
|
||||
| vicuna-13b-v1.3 | 6.81250 | 5.9625 | 6.387500 |
|
||||
| palm-2-chat-bison-001 | 6.71250 | 6.0875 | 6.400000 |
|
||||
Reference in New Issue
Block a user