初始化项目,由ModelHub XC社区提供模型
Model: DataLinguistic/DataLinguistic-34B-V1.0 Source: Original Platform
This commit is contained in:
124
README.md
Normal file
124
README.md
Normal file
@@ -0,0 +1,124 @@
|
||||
---
|
||||
license: llama2
|
||||
metrics:
|
||||
- code_eval
|
||||
library_name: transformers
|
||||
tags:
|
||||
- code
|
||||
model-index:
|
||||
- name: DataLinguistic-34B-V1.0
|
||||
results:
|
||||
- task:
|
||||
type: text-generation
|
||||
dataset:
|
||||
type: openai_humaneval
|
||||
name: HumanEval
|
||||
metrics:
|
||||
- name: pass@1
|
||||
type: pass@1
|
||||
value: 0.701
|
||||
verified: false
|
||||
|
||||
|
||||
---
|
||||
|
||||
# DataLinguistic-34B-V1.0 Chinese-English Question Answering Model
|
||||
|
||||
## Model Overview
|
||||
|
||||
DataLinguistic-34B-V1.0 is a Chinese-English question answering model fine-tuned from Huggingface's CodeLlama-34b model with 4-bit quantization on DataLinguistic's proprietary datasets.
|
||||
|
||||
## Model Architecture
|
||||
|
||||
DataLinguistic-34B-4bit-V1.0 inherits the encoder-decoder structure from Llama with 34B parameters.
|
||||
|
||||
## Training Datasets
|
||||
|
||||
The model was trained on the following open-source datasets:
|
||||
|
||||
- Data_OpenSet: Chinese-English question-answering dataset curated from junelee/wizard_vicuna_70k
|
||||
- Data_OpenSet2: Chinese-English question-answering dataset curated from garage-bAInd/Open-Platypus
|
||||
- Proprietary Chinese-English question-answering dataset collected internally by DataLinguistic (not open-sourced)
|
||||
|
||||
The data is formatted as:
|
||||
""
|
||||
|
||||
|
||||
\<s>please answer my question in datalynn model and Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\n{instruction}\n\n### Response: {question}\</s>
|
||||
|
||||
|
||||
## Use Cases
|
||||
|
||||
The model can be used for a wide range of Chinese-English question answering and chatbot applications.
|
||||
|
||||
## Model Advantages
|
||||
|
||||
- Based on huge model CodeLlama-34b with 34B parameters
|
||||
- Fine-tuned on large-scale Chinese-English QA datasets for high quality
|
||||
|
||||
## Usage
|
||||
|
||||
1. Install model from Huggingface
|
||||
2. Import and initialize model
|
||||
3. Input question, generate answer
|
||||
|
||||
## Version
|
||||
|
||||
Current version: DataLinguistic-34B-V1.0
|
||||
|
||||
## Author
|
||||
|
||||
Tang Zhengzheng
|
||||
|
||||
## Contributors
|
||||
|
||||
DataLinguistic team
|
||||
|
||||
# DataLinguistic-34B-V1.0 中英文问答模型
|
||||
|
||||
## 模型简介
|
||||
|
||||
DataLinguistic-34B-V1.0是一个基于Huggingface的CodeLlama-34b模型在DataLinguistic自建数据集上微调的中文英文问答模型。
|
||||
|
||||
## 模型结构
|
||||
|
||||
DataLinguistic-34B-V1.0 inherits the encoder-decoder structure from CodeLlama with 34B parameters.
|
||||
|
||||
## 模型训练数据集
|
||||
|
||||
模型使用了以下开源数据集进行了训练:
|
||||
|
||||
- Data_OpenSet: 基于junelee/wizard_vicuna_70k整理的中英文问答数据集
|
||||
- Data_OpenSet2: 基于garage-bAInd/Open-Platypus整理的中英文问答数据集
|
||||
- DataLinguistic内部收集的专属中英文问答数据集(未开源)
|
||||
|
||||
数据集采用如下格式:
|
||||
|
||||
\<s>please answer my question in datalynn model and Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\n{instruction}\n\n### Response: {question}\</s>
|
||||
|
||||
## 应用场景
|
||||
|
||||
该模型可广泛应用于中英文问答、聊天机器人等场景。
|
||||
|
||||
## 模型优势
|
||||
|
||||
- 基于大模型Llama-34b,参数量达34亿
|
||||
- 在大规模中英文问答数据集上进行微调,质量较高
|
||||
|
||||
## 使用步骤
|
||||
|
||||
1. 在Huggingface安装模型
|
||||
2. 导入并初始化模型
|
||||
3. 输入问题,生成回答
|
||||
|
||||
## 版本信息
|
||||
|
||||
当前版本:DataLinguistic-34B-V1.0
|
||||
|
||||
## 作者
|
||||
|
||||
唐正正
|
||||
|
||||
## 贡献者
|
||||
|
||||
DataLinguistic团队
|
||||
Reference in New Issue
Block a user