Downloads · 30 days
14
3% of all-time downloads
Llama-3-13B-AWQ
solidrust/Llama-3-13B-AWQ
Llama-3-13B-AWQ is a text generation model from solidrust. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
- Model creator: Replete-AI - Original model: Llama-3-13B
All-time downloads
447
Public
Parameters
13.3B
8.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8.4 GB · 100%
Parameter types
How the weights are stored.
I3212.2B · 92%
Try a prompt
Base models
Model card
From the Hugging Face model README
Replete-AI/Llama-3-13B AWQ
- Model creator: Replete-AI
- Original model: Llama-3-13B
Model Summary
This is the first version of upscaling llama-3. Version 2 is now out and does not have any of the issues that this version has. Please use version 2 instead. Linked bellow:
Llama-3-13B
Thank you to Meta for the weights for Meta-Llama-3-8B
This is an upscaling of the Llama-3-8B Ai using techniques created for Mistral-Evolved-11b-v0.1. This Ai model has been upscaled from 8b parameters to 13b parameters without any continuous pretraining or fine-tuning.
From testing, the model seems to function perfectly at fp16, but has some issues at 4-bit quantization using bitsandbytes.
The model that was used to create this one is linked below:
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Created
- Apr 19, 2024
- Updated
- Sep 3, 2024