Unichat-llama3.1-Chinese-8B/.ipynb_checkpoints/README-checkpoint.md

frameworks, license, tasks

frameworks	license	tasks
Pytorch	Apache License 2.0	text-classification llama nlp cn zh fine-tuned vllm

Unichat-llama3-Chinese-8B

介绍

• 中国联通AI创新中心发布llama3.1中文指令微调模型，全参数微调
• 基础模型 Meta-Llama-3.1-8B-Instruct

📊 数据

• 高质量指令数据，覆盖多个领域和行业，为模型训练提供充足的数据支持
• 微调指令数据经过严格的人工筛查，保证优质的指令数据用于模型微调

import transformers
import torch

model_id = "UnicomAI/Unichat-llama3.1-Chinese-8B"

pipeline = transformers.pipeline(
    "text-generation",
    model=model_id,
    model_kwargs={"torch_dtype": torch.bfloat16},
    device_map="auto",
)

messages = [
    {"role": "system", "content": "You are a helpful assistant"},
    {"role": "user", "content": "你是谁?"},
]

outputs = pipeline(
    messages,
    max_new_tokens=1024,
    do_sample=False,
    repetition_penalty=1.1,
)
print(outputs[0]["generated_text"][-1])

资源

更多模型,数据集和训练相关细节请参考:

• Github：Unichat-llama3-Chinese