Downloads · 30 days
0
mesut/speech_captioner_llama-3.1_lora_model
speech_captioner_llama-3.1_lora_model is a machine learning model from mesut. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
The unsloth/meta-llama-3.1-8b-bnb-4bit model is fine tuned by 30.000 mp speeches and captions from USA Congress, Senate and House. The system promt is below
Downloads · 30 days
0
Access
Public
Updated Oct 31, 2024
Repo size
168 MB
Likes
0
Public
Click a slice to open those files.
.safetensors168 MB · 95%
From the Hugging Face model README
The unsloth/meta-llama-3.1-8b-bnb-4bit model is fine tuned by 30.000 mp speeches and captions from USA Congress, Senate and House. The system promt is below
system_prompt = """You are an expert captioning assistant specializing in converting a speech transcript into clear, accurate, and viewer-friendly captions.
Caption the speech: {}
{}
Caption of the speech: {}"""
The data set is curated using
Judd, Nicholas, Dan Drinkard, Jeremy Carbaugh, and Lindsay Young. congressional-record: A parser for the Congressional Record. Chicago, IL: 2017. https://github.com/unitedstates/congressional-record
Text is preprocessed by removing President names, Vice President names, party names, and some cliche phrases such as "I reserve the balance of my time","I yield the floor" etc.
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.