初始化项目,由ModelHub XC社区提供模型
Model: Joshua-Sun-CompSci/GPT-2_academic_style_tune Source: Original Platform
This commit is contained in:
49
README.md
Normal file
49
README.md
Normal file
@@ -0,0 +1,49 @@
|
||||
---
|
||||
license: mit
|
||||
language:
|
||||
- en
|
||||
base_model:
|
||||
- gpt2
|
||||
pipeline_tag: text-generation
|
||||
tags:
|
||||
- academic-writing
|
||||
- gpt2
|
||||
- fine-tuning
|
||||
- arxiv
|
||||
- llm
|
||||
- uc-davis
|
||||
---
|
||||
|
||||
# GPT-2 Fine-Tuned for Academic Style Writing
|
||||
|
||||
This model is a fine-tuned version of GPT-2 (124M), trained on 500,000 academic abstracts from the arXiv dataset. It was developed as part of the ECS 271 final project at UC Davis.
|
||||
|
||||
## Intended Use
|
||||
|
||||
Designed to generate text with academic tone and structure for use in educational and research-oriented applications such as writing assistants or tutors.
|
||||
|
||||
## Training Details
|
||||
|
||||
- Base model: `gpt2`
|
||||
- Method: Full-parameter fine-tuning
|
||||
- Dataset: 500K arXiv abstracts
|
||||
- Epochs: 1.2
|
||||
- GPU: RTX 5070 Ti (~2 hours)
|
||||
|
||||
## Limitations
|
||||
|
||||
- May hallucinate facts
|
||||
- Not citation-aware
|
||||
- English-only
|
||||
- No factual grounding
|
||||
|
||||
## Example
|
||||
|
||||
**Prompt:**
|
||||
"Transformer models have impacted the field of education by..."
|
||||
|
||||
**Output:**
|
||||
"Transformer models have impacted the field of education by enabling new forms of intelligent tutoring systems and automatic curriculum generation. Their ability to understand context has allowed for more personalized and scalable academic tools."
|
||||
|
||||
## More Info
|
||||
Main Project: [Github](https://github.com/Joshua-Sun-CompSci/academic-style-llms)
|
||||
Reference in New Issue
Block a user