初始化项目,由ModelHub XC社区提供模型
Model: gair-prox/web-chunk-refining-lm Source: Original Platform
This commit is contained in:
38
README.md
Normal file
38
README.md
Normal file
@@ -0,0 +1,38 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
datasets:
|
||||
- gair-prox/RedPajama-pro
|
||||
language:
|
||||
- en
|
||||
base_model:
|
||||
- gair-prox/RedPJ-ProX-0.3B
|
||||
pipeline_tag: text-generation
|
||||
library_name: transformers
|
||||
tags:
|
||||
- llama
|
||||
- code
|
||||
---
|
||||
|
||||
# Web-chunk-refining-lm
|
||||
|
||||
<p align="center">
|
||||
<img src="prox-teaser.png">
|
||||
</p>
|
||||
|
||||
[ArXiv](http://arxiv.org/abs/2409.17115) | [Code](https://github.com/GAIR-NLP/program-every-example)
|
||||
|
||||
**Web-chunk-refining-lm** is an adapted [0.3B-ProX](https://huggingface.co/gair-prox/RedPJ-ProX-0.3B) model, fine-tuned for chunk level refining via program generation.
|
||||
|
||||
<p align="center">
|
||||
<img src="func_design.png">
|
||||
</p>
|
||||
|
||||
### Citation
|
||||
```
|
||||
@article{zhou2024programming,
|
||||
title={Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale},
|
||||
author={Zhou, Fan and Wang, Zengzhi and Liu, Qian and Li, Junlong and Liu, Pengfei},
|
||||
journal={arXiv preprint arXiv:2409.17115},
|
||||
year={2024}
|
||||
}
|
||||
```
|
||||
Reference in New Issue
Block a user