Downloads · 30 days
13
4% of all-time downloads
lamm_13b_lora32_186k
openlamm/lamm_13b_lora32_186k
lamm_13b_lora32_186k is a text generation model from openlamm. Use it when you need the model to write or continue text. It is set up for transformers.
Repo: - https://github.com/OpenLAMM/LAMM - Commit ID: 6b98b26b3340378bb5bed330cca86305759d8d22
All-time downloads
320
Public
Repo size
231 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt115 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Jun 10, 2023
- Updated
- Jul 28, 2023
- SHA
- 09d38f8b
Try a prompt
Datasets
Model card
From the Hugging Face model README
Repo:
- https://github.com/OpenLAMM/LAMM
- Commit ID: 6b98b26b3340378bb5bed330cca86305759d8d22
Model Config:
- LLM: Vicuna_13b_v0
- Vision Encoder: CLIP ViT-L-14
- lora_r: 32
- lora_alpha: 32
- lora_dropout: 0.1
- lora_target_modules: ['q_proj', 'k_proj', 'v_proj', 'o_proj']
Train Config:
- Epochs: 2
- train_batch_size: 64
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Languages
- en
- Created
- Jun 10, 2023
- Updated
- Jul 28, 2023