andreipb/gpt2-poetry-model-crpo
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
main
gpt2-poetry-model-crpo/README.md
ModelHub XC 3be7f5fe92 初始化项目，由ModelHub XC社区提供模型 
Model: andreipb/gpt2-poetry-model-crpo
Source: Original Platform
2026-09-05 02:18:17 +08:00

1.3 KiB
Raw Permalink Blame History

license, language, pipeline_tag, library_name, widget
license language pipeline_tag library_name widget
mit
en
text-generation transformers
text example_title
<start>The sea at night, Example 1
text example_title
<start>So fast he pulled his sword along Example 2
text example_title
<start>Now that the trees have Example 3

gpt2-poetry-model-crpo

This model is based on the smallest gpt2 model (137 M parameters) fine-tuned on the Gutenberg Poetry Corpus (142 MB of text) for 3 epochs.

The model generates lines of poetry, in English, each of them starting with the <start> tag, which can be removed through post-processing.

This model was trained by Teo Ferrari as part of his Bachelor thesis at HEIG-VD, supervised by Andrei Popescu-Belis. The model is described in "GPoeT: a Language Model Trained for Rhyme Generation on Synthetic Data" and is used in the CR-PO system for interactive poem generation, along with several other models for specific topics or emotions.