Downloads · 30 days
2K
3% of all-time downloads
llama-2-tiny-3layers-random
yujiepan/llama-2-tiny-3layers-random
llama-2-tiny-3layers-random is a text generation model from yujiepan. Use it when you need the model to write or continue text. It is set up for transformers.
This model is randomly initialized, using the config from meta-llama/Llama-2-7b-chat-hf but with the following modifications:
All-time downloads
60.8K
Public
Parameters
515K
5.9 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin2.1 MB · 36%
Parameter types
How the weights are stored.
F16515K · 100%
Try a prompt
Model card
From the Hugging Face model README
yujiepan/llama-2-tiny-3layers-random
This model is randomly initialized, using the config from meta-llama/Llama-2-7b-chat-hf but with the following modifications:
{
"hidden_size": 8,
"intermediate_size": 32,
"num_attention_heads": 2,
"num_hidden_layers": 3,
"num_key_value_heads": 2,
}
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Aug 31, 2023
- Updated
- Apr 19, 2024