初始化项目,由ModelHub XC社区提供模型
Model: inswave/AISquare-Instruct-llama2-koen-13b-v0.9.24 Source: Original Platform
This commit is contained in:
40
README.md
Normal file
40
README.md
Normal file
@@ -0,0 +1,40 @@
|
||||
---
|
||||
language:
|
||||
- en
|
||||
pipeline_tag: text-generation
|
||||
license: cc-by-nc-4.0
|
||||
---
|
||||
|
||||
# AISquare-Instruct-llama2-koen-13b-v0.9.24
|
||||
|
||||
## Model Details
|
||||
|
||||
**Developed by**
|
||||
[Inswave Systems](https://www.inswave.com) UI Platform Team
|
||||
|
||||
**Method**
|
||||
Using DPO method and SFT method
|
||||
|
||||
**Hardware**
|
||||
We utilized an A100x4 * 1 for training our model
|
||||
|
||||
**Base Model**
|
||||
[beomi/llama2-koen-13b](https://huggingface.co/beomi/llama-2-koen-13b)
|
||||
|
||||
|
||||
# Implementation Code
|
||||
```python
|
||||
from transformers import AutoModelForCausalLM, AutoTokenizer
|
||||
import torch
|
||||
|
||||
repo = "inswave/AISquare-Instruct-llama2-koen-13b-v0.9.24"
|
||||
model = AutoModelForCausalLM.from_pretrained(
|
||||
repo,
|
||||
return_dict=True,
|
||||
torch_dtype=torch.float16,
|
||||
device_map='auto'
|
||||
)
|
||||
tokenizer = AutoTokenizer.from_pretrained(repo)
|
||||
```
|
||||
|
||||
---
|
||||
Reference in New Issue
Block a user