Downloads · 30 days
15
27% of all-time downloads
rombos_Llama-3-13B-Instruct
rombodawg/rombos_Llama-3-13B-Instruct
rombos_Llama-3-13B-Instruct is a text generation model from rombodawg. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This is the first version of upscaling llama-3. Version 2 is now out and does not have any of the issues that this version has. Please use version 2 instead. Linked bellow:
All-time downloads
55
Public
Parameters
13.3B
26.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors26.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Oct 6, 2024
- Updated
- Oct 6, 2024
- SHA
- 3079aaa5
Try a prompt
Model card
From the Hugging Face model README
This is the first version of upscaling llama-3. Version 2 is now out and does not have any of the issues that this version has. Please use version 2 instead. Linked bellow:
Llama-3-13B-Instruct
Thank you to Meta for the weights for Meta-Llama-3-8B-Instruct
This is an upscaling of the Meta-Llama-3-8B-Instruct Ai using techniques created for Mistral-Evolved-11b-v0.1. This Ai model has been upscaled from 8b parameters to 13b parameters without any continuous pretraining or fine-tuning.
From testing, the model seems to function perfectly at fp16, but has some issues at 4-bit quantization using bitsandbytes.
The model that was used to create this one is linked below:
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Created
- Oct 6, 2024
- Updated
- Oct 6, 2024