初始化项目,由ModelHub XC社区提供模型
Model: flax-community/gpt2-medium-persian Source: Original Platform
This commit is contained in:
43
README.md
Normal file
43
README.md
Normal file
@@ -0,0 +1,43 @@
|
||||
---
|
||||
language: fa
|
||||
tags:
|
||||
- text-generation
|
||||
widget:
|
||||
- text: "در یک اتفاق شگفت انگیز، پژوهشگران"
|
||||
- text: "گرفتگی بینی در کودکان و بهخصوص نوزادان باعث میشود"
|
||||
- text: "امیدواریم نوروز امسال سالی"
|
||||
---
|
||||
|
||||
# GPT2 Medium 4 Persian
|
||||
> This is part of the
|
||||
[Flax/Jax Community Week](https://discuss.huggingface.co/t/pretrain-gpt2-from-scratch-in-persian/7560), organized by [HuggingFace](https://huggingface.co/) and TPU usage sponsored by Google.
|
||||
|
||||
|
||||
## Team Members
|
||||
- [Mehrdad Farahani](huggingface.co/m3hrdadfi)
|
||||
- [Saied Alimoradi](https://discuss.huggingface.co/u/saied)
|
||||
- [M. Reza Zerehpoosh](huggingface.co/ironcladgeek)
|
||||
- [Hooman Sedghamiz](https://discuss.huggingface.co/u/hooman650)
|
||||
- [Mazeyar Moeini Feizabadi](https://discuss.huggingface.co/u/mazy1998)
|
||||
|
||||
## Dataset
|
||||
We used [Oscar](https://huggingface.co/datasets/oscar) dataset, which is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus.
|
||||
|
||||
## How To Use
|
||||
You can use this model directly with a pipeline for text generation.
|
||||
|
||||
```python
|
||||
from transformers import pipeline, AutoTokenizer, GPT2LMHeadModel
|
||||
tokenizer = AutoTokenizer.from_pretrained('flax-community/gpt2-medium-persian')
|
||||
model = GPT2LMHeadModel.from_pretrained('flax-community/gpt2-medium-persian')
|
||||
generator = pipeline('text-generation', model, tokenizer=tokenizer, config={'max_length':100})
|
||||
generated_text = generator('در یک اتفاق شگفت انگیز، پژوهشگران')
|
||||
```
|
||||
For using Tensorflow import TFGPT2LMHeadModel instead of GPT2LMHeadModel.
|
||||
## Demo
|
||||
|
||||
... SOON
|
||||
|
||||
## Evaluation
|
||||
|
||||
... SOON
|
||||
Reference in New Issue
Block a user