69 lines
2.0 KiB
Markdown
69 lines
2.0 KiB
Markdown
|
---
|
|||
|
|
tags:
|
|||
|
|
- text-generation-inference
|
|||
|
|
- text-generation
|
|||
|
|
- peft
|
|||
|
|
library_name: transformers
|
|||
|
|
base_model:
|
|||
|
|
- meta-llama/Llama-3.2-1B-Instruct
|
|||
|
|
widget:
|
|||
|
|
- messages:
|
|||
|
|
- role: user
|
|||
|
|
content: What is your favorite condiment?
|
|||
|
|
license: cc-by-2.0
|
|||
|
|
pipeline_tag: text-generation
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# Model Trained Using AutoTrain
|
|||
|
|
|
|||
|
|
This model is created from llama3.2 1B Instruct.
|
|||
|
|
email me at: nazmus.sakib.muzahid@gmail.com
|
|||
|
|
|
|||
|
|
# Usage
|
|||
|
|
|
|||
|
|
```python
|
|||
|
|
|
|||
|
|
from transformers import pipeline
|
|||
|
|
import nltk
|
|||
|
|
from nltk.tokenize import sent_tokenize
|
|||
|
|
|
|||
|
|
nltk.download("punkt_tab")
|
|||
|
|
|
|||
|
|
pipe = pipeline("text-generation", max_new_tokens=512, do_sample=False, model="mnsm92/English_To_Bengali_Translation")
|
|||
|
|
|
|||
|
|
def create_messages(ot: str):
|
|||
|
|
messages = [
|
|||
|
|
|
|||
|
|
{
|
|||
|
|
"role": "system",
|
|||
|
|
"content": "Translate English to Bengali. Keep the meaning same"
|
|||
|
|
},
|
|||
|
|
{"role": "user", "content": ot}
|
|||
|
|
]
|
|||
|
|
|
|||
|
|
return messages
|
|||
|
|
|
|||
|
|
text = """
|
|||
|
|
National Citizen Party (NCP) convenor Nahid Islam has said that his party will contest the upcoming 13th Jatiya Sangsad (national parliament) election in alliance with Jamaat-e-Islami and like-minded parties.
|
|||
|
|
|
|||
|
|
However, he emphasised that there is no ideological unity between the NCP and Jamaat or its allies, describing the arrangement instead as an electoral understanding.
|
|||
|
|
|
|||
|
|
Nahid Islam made the remarks at a press conference held at the NCP’s temporary central office in the capital’s Banglamotor area on Sunday night.
|
|||
|
|
|
|||
|
|
Earlier in the afternoon, Jamaat-e-Islami and its like-minded parties had announced at their own press conference that the NCP would be part of their 10-party electoral understanding.
|
|||
|
|
|
|||
|
|
Speaking at the NCP press conference, Nahid Islam outlined the background to the understanding with Jamaat and eight other parties.
|
|||
|
|
"""
|
|||
|
|
|
|||
|
|
|
|||
|
|
sentences = sent_tokenize(text)
|
|||
|
|
sentences = [ create_messages(sent) for sent in sentences]
|
|||
|
|
outputs = pipe(sentences, batch_size=32, truncation=True)
|
|||
|
|
output_texts = ""
|
|||
|
|
for i in outputs:
|
|||
|
|
output_texts += i[0]['generated_text'][-1]['content']
|
|||
|
|
output_texts.replace("assistant\n\n", " ")
|
|||
|
|
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
# Drop a feedback.
|