Downloads · 30 days
18
34% of all-time downloads
llama3-32kpa-focus-emb-init
codingninja/llama3-32kpa-focus-emb-init
llama3-32kpa-focus-emb-init is a text generation model from codingninja. Use it when you need the model to write or continue text. It is set up for transformers.
Some weights of LlamaForCausalLM were not initialized from the model checkpoint at ./llama3-pa/llama3-32kpa-emb-init-weight-tied and are newly initialized: ['lmhead.weight']
All-time downloads
53
Public
Parameters
7.2B
33.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors29 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Jul 12, 2024
- Updated
- Jul 12, 2024
- SHA
- b8c0b528
Try a prompt
Model card
From the Hugging Face model README
Input, output embedding weights are possibly not tied -
Some weights of LlamaForCausalLM were not initialized from the model checkpoint at ./llama3-pa/llama3-32kpa-emb-init-weight-tied and are newly initialized: ['lm_head.weight']
used -
source_model.lm_head.weight.data = source_model.model.embed_tokens.weight.data
source_model.lm_head.weight = source_model.model.embed_tokens.weight
source_model.tie_weights()
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Jul 12, 2024
- Updated
- Jul 12, 2024