Downloads · 30 days
0
llama3_ruozhiba_8b
postitive666/llama3_ruozhiba_8b
llama3_ruozhiba_8b is a machine learning model from postitive666. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for adapter-transformers. The card lists the license as apache-2.0.
--- license: apache-2.0 --- Model Architecture Llama 3 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learni…
Access
Public
Updated Apr 19, 2024
Parameters
8B
16.1 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Library
- adapter-transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Apr 19, 2024
- Updated
- Apr 19, 2024
- SHA
- 5c1e0c58
Datasets
Model card
From the Hugging Face model README
license: apache-2.0 --- Model Architecture Llama 3 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for helpfulness and safety.
Training Data Params Context length GQA Token count Knowledge cutoff Llama 3 A new mix of publicly available online data. 8B 8k Yes 15T+ March, 2023 70B 8k Yes December, 2023 Llama 3 family of models. Token counts refer to pretraining data only. Both the 8 and 70B versions use Grouped-Query Attention (GQA) for improved inference scalability. --- sft 1700 llama3 test, 25 EPOCH
- Library
- adapter-transformers
- Type
- llama
- License
- apache-2.0
- Created
- Apr 19, 2024
- Updated
- Apr 19, 2024