FW-ProX-1.7B-GGUF

QuantFactory/FW-ProX-1.7B-GGUF

This is quantized version of gair-prox/FW-ProX-1.7B created using llama.cpp

Original Model Card

FW-ProX-1.7B

<p align="center"> <img src="prox-teaser.png"> </p>

ArXiv | Models | Data | Code

FW-ProX-1.7B is a small language model. It was and trained on the FineWeb-pro for 50B tokens.

Evaluations

ProX models are evaluated over 10 language model benchmarks in zero-shot setting.

Citation

@article{zhou2024programming,
  title={Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale},
  author={Zhou, Fan and Wang, Zengzhi and Liu, Qian and Li, Junlong and Liu, Pengfei},
  journal={arXiv preprint arXiv:2409.17115},
  year={2024}
}