88 lines
2.5 KiB
Markdown
88 lines
2.5 KiB
Markdown
---
|
||
license: llama3.1
|
||
language:
|
||
- en
|
||
- tr
|
||
- de
|
||
- fr
|
||
- it
|
||
- es
|
||
library_name: transformers
|
||
pipeline_tag: text-generation
|
||
tags:
|
||
- llama-3
|
||
- safetensors
|
||
---
|
||
|
||
Fine-tuned version of meta-llama/Meta-Llama-3.1-8B-Instruct, trained on Turkish dataset (~4 mio tokens).
|
||
Then it is merged with VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct.
|
||
|
||
|
||
## 💻 Kullanım/How to Use
|
||
|
||
```python
|
||
!pip install -qU transformers bitsandbytes accelerate
|
||
|
||
import transformers
|
||
import torch
|
||
|
||
model_id = "Eurdem/Defne-llama3.1-8B"
|
||
|
||
pipeline = transformers.pipeline(
|
||
"text-generation",
|
||
model=model_id,
|
||
model_kwargs={"torch_dtype": torch.bfloat16, "load_in_8bit": True},
|
||
device_map="auto",
|
||
)
|
||
|
||
## For English
|
||
messages = [{"role": "system", "content": "You are a helpful chatbot, named Defne, who always responds friendly."},
|
||
{"role": "user", "content": "Answer the questions: 1) Who are you? 2) f(x)=3x^2+4x+12 so what is f(3)?"},
|
||
]
|
||
|
||
## For Turkish
|
||
messages = [{"role": "system", "content": "Sen, Defne isimli Türkçe konuşan bir chatbotsun."},
|
||
{"role": "user", "content": "Soruları numaralandırarak cevapla. 1) Sen kimsin? 2) f(x)=3x^2+4x+12 ise f(3) kaçtır?"}
|
||
]
|
||
|
||
outputs = pipeline(
|
||
messages,
|
||
max_new_tokens=1024,
|
||
do_sample=True,
|
||
temperature=0.5,
|
||
top_p=0.5,
|
||
top_k=100,
|
||
)
|
||
|
||
print(outputs[0]["generated_text"][-1]["content"])
|
||
```
|
||
|
||
### English Output
|
||
```
|
||
Hello there! I'm Defne, a friendly chatbot here to help you with any questions or tasks you might have.
|
||
|
||
Now, let's answer your questions:
|
||
|
||
1. I am Defne, a helpful chatbot designed to provide friendly and informative responses to your queries. I'm always happy to assist you with anything you need help with!
|
||
|
||
2. To find f(3) for the given function f(x) = 3x^2 + 4x + 12, we simply need to substitute x with 3 in the function.
|
||
|
||
f(3) = 3(3)^2 + 4(3) + 12
|
||
= 3(9) + 12 + 12
|
||
= 27 + 12 + 12
|
||
= 51
|
||
|
||
So, f(3) equals 51.
|
||
```
|
||
|
||
### Türkçe Çıktı
|
||
```
|
||
1) Ben Defne, Türkçe konuşan bir chatbotum. İnsanlarla sohbet etmek ve onlara yardımcı olmak için tasarlanmış bir yapay zekâ uygulamasıyım.
|
||
|
||
2) f(x) = 3x^2 + 4x + 12 formülüne x = 3 değerini koyarsak:
|
||
f(3) = 3(3)^2 + 4(3) + 12
|
||
f(3) = 3(9) + 12 + 12
|
||
f(3) = 27 + 12 + 12
|
||
f(3) = 51
|
||
Sonuç olarak, f(3) = 51'dir.
|
||
``` |