Downloads · 30 days
0
sec-mistral-instruct-v2-qlora
arcee-ai/sec-mistral-instruct-v2-qlora
sec-mistral-instruct-v2-qlora is a machine learning model from arcee-ai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
Access
Public
Updated Apr 4, 2024
Repo size
168 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors168 MB · 99%
At a glance
- Library
- transformers
- Access
- Public
- Created
- Apr 4, 2024
- Updated
- Apr 4, 2024
- SHA
- 6a9de205
Model card
From the Hugging Face model README
Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->Model Details
Model Description
<!-- Provide a longer summary of what this model is. -->This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- Developed by: arcee.ai
- Finetuned from model: mistralai/Mistral-7B-Instruct-v0.2
Uses
<!-- This has continually trained with the SEC data -->Direct Use
<!-- Since we used the instruct version of the Mistral we can use this directly. -->Training Details
Training Data
<!-- We used https://huggingface.co/datasets/arcee-ai/sec-data-full which consists of 2.5B tokens -->Training Procedure
<!-- We used the CPT method in the hugging face alignment book -->Preprocessing
Tokenized and packed into 4096 chunks with the SFT trainer
Training Hyperparameters
- Training regime: Used SFT trainer <!-- bf16 mixed precision -->
- Library
- transformers
- Created
- Apr 4, 2024
- Updated
- Apr 4, 2024