Downloads · 30 days
16
28% of all-time downloads
Llama-3.1-11b-pretrained
athirdpath/Llama-3.1-11b-pretrained
Llama-3.1-11b-pretrained is a machine learning model from athirdpath. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.1.
All-time downloads
58
Public
Parameters
10.9B
21.7 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors21.7 GB · 100%
At a glance
- License
- llama3.1
- Model type
- llama
- Access
- Public
- Created
- Aug 5, 2024
- Updated
- Aug 6, 2024
- SHA
- 497550ed
Model card
From the Hugging Face model README
Merged as below:
slices:
-
sources:
-
- model: athirdpath/Llama-3.1-Instruct_NSFW-pretrained_e1-plus_reddit
- layer_range: [0, 23]
-
sources:
-
- model: athirdpath/Llama-3.1-Techne-RP-8b-v1
- layer_range: [9, 31]
merge_method: passthrough
dtype: float16
tokenizer_source: athirdpath/Llama-3.1-Techne-RP-8b-v1
Then pretrained for 1 epoch on the Iambe dataset as an 11b model
- Type
- llama
- License
- llama3.1
- Created
- Aug 5, 2024
- Updated
- Aug 6, 2024