web-chunk-refining-lm/README.md

license, datasets, language, base_model, pipeline_tag, library_name, tags

license	datasets	language	base_model	pipeline_tag	library_name	tags
apache-2.0	gair-prox/RedPajama-pro	en	gair-prox/RedPJ-ProX-0.3B	text-generation	transformers	llama code

Web-chunk-refining-lm

ArXiv | Code

Web-chunk-refining-lm is an adapted 0.3B-ProX model, fine-tuned for chunk level refining via program generation.

Citation

@article{zhou2024programming,
  title={Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale},
  author={Zhou, Fan and Wang, Zengzhi and Liu, Qian and Li, Junlong and Liu, Pengfei},
  journal={arXiv preprint arXiv:2409.17115},
  year={2024}
}