saroyehun

Llama3-8B-Instruct-mntp-patent

saroyehun/Llama3-8B-Instruct-mntp-patent

Llama3-8B-Instruct-mntp-patent is a machine learning model from saroyehun. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.

This repository contains the LoRA adapter weights from the fine-tuning of the Llama 3 (8B) model on patent documents using masked next token prediction (MNTP). MNTP is the first step in the adaptation of the base mode…