Downloads · 30 days
13
16% of all-time downloads
RetrospexLLaMA3
AronXiang/RetrospexLLaMA3
RetrospexLLaMA3 is a machine learning model from AronXiang. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.
This model is trained by lora for Retrospex based on AgentInstruct and ShareGPT datasets. The base model is Llama-3-8B-Instruct.
All-time downloads
80
Public
Parameters
8B
32.1 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors32.1 GB · 100%
At a glance
- License
- llama3
- Model type
- llama
- Access
- Public
- Created
- Oct 13, 2024
- Updated
- Oct 14, 2024
- SHA
- 76344530
Base models
Model card
From the Hugging Face model README
Model Card for Model ID
This model is trained by lora for Retrospex based on AgentInstruct and ShareGPT datasets. The base model is Llama-3-8B-Instruct.
Model Details
Model Description
- Developed by: Convai NJU
- Shared by [optional]: Convai NJU
- Model type: Llama model
- Language(s) (NLP): en
- License: llama3
- Finetuned from model [optional]: Llama-3-8B-Instruct
Model Sources
- Repository: https://github.com/Yufei-Xiang/Retrospex.git
Training Details
Training Data
AgentInstruct: https://huggingface.co/datasets/THUDM/AgentInstruct
ShareGPT: https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered
Training Hyperparameters
- fp16: True
- lr: 2e-5
- batch size: 8
- lora r: 16
- lora alpha: 64
- Type
- llama
- License
- llama3
- Languages
- en
- Created
- Oct 13, 2024
- Updated
- Oct 14, 2024