Downloads · 30 days
0
ntropy-labeler-llama-lora-7b
ntropydev/ntropy-labeler-llama-lora-7b
ntropy-labeler-llama-lora-7b is a machine learning model from ntropydev. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This repo contains a low-rank adapter for LLaMA-7b finetuned on Ntropy proprietary dataset (consumer financial transactions).
Access
Public
Updated Jun 1, 2023
Repo size
67.7 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin67.2 MB · 99%
At a glance
- License
- mit
- Access
- Public
- Created
- May 30, 2023
- Updated
- Jun 1, 2023
- SHA
- f48aa8ea
Model card
From the Hugging Face model README
This repo contains a low-rank adapter for LLaMA-7b finetuned on Ntropy proprietary dataset (consumer financial transactions).
This version of the weights was trained with the following hyperparameters:
- Base Model: decapoda-research/llama-7b-hf
- Epochs: 10 (load from best epoch)
- Batch size: 32
- Cutoff length: 1024
- Learning rate: 3e-4
- Lora r: 16
- Lora target modules: q_proj, k_proj, v_proj, o_proj
Instructions for running it can be found at https://github.com/ntropy-network/enrichment_models/blob/main/notebooks/llama.ipynb
- License
- mit
- Created
- May 30, 2023
- Updated
- Jun 1, 2023