Downloads · 30 days
5
3% of all-time downloads
saroyehun/Llama3-8B-Instruct-mntp-unsup-simcse-patent
Llama3-8B-Instruct-mntp-unsup-simcse-patent is a machine learning model from saroyehun. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
This repository contains the LoRA adapter weights from the fine-tuning of the Llama 3 (8B) model on patent documents. It is optimized for generating embeddings from patent texts. These embeddings are useful for tasks…
Downloads · 30 days
5
3% of all-time downloads
All-time downloads
163
Public
Repo size
336 MB
Likes
0
Public
Click a slice to open those files.
.safetensors168 MB · 95%
From the Hugging Face model README
This repository contains the LoRA adapter weights from the fine-tuning of the Llama 3 (8B) model on patent documents. It is optimized for generating embeddings from patent texts. These embeddings are useful for tasks such as classification, clustering, and retrieval. The model leverages domain-specific training, using the second step of the llm2Vec approach (unsupervised contrastive learning), to capture the language of patents, offering high-quality representations for patent analysis.