gair-prox_-_web-doc-refining-lm-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

web-doc-refining-lm - GGUF

• Model creator: https://huggingface.co/gair-prox/
• Original model: https://huggingface.co/gair-prox/web-doc-refining-lm/

Original model description:

license: apache-2.0 datasets:

• gair-prox/RedPajama-pro language:
• en base_model:
• gair-prox/RedPJ-ProX-0.3B pipeline_tag: text-generation library_name: transformers tags:
• llama
• code

---

Web-doc-refining-lm

<p align="center"> <img src="prox-teaser.png"> </p>

ArXiv | Code

Web-doc-refining-lm is an adapted 0.3B-ProX model, fine-tuned for document level refining via program generation.

<p align="center"> <img src="func_design.png"> </p>

Citation

@article{zhou2024programming,
  title={Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale},
  author={Zhou, Fan and Wang, Zengzhi and Liu, Qian and Li, Junlong and Liu, Pengfei},
  journal={arXiv preprint arXiv:2409.17115},
  year={2024}
}