Downloads · 30 days
9
3% of all-time downloads
Llasa-3b-GPTQ-8bit
AgeOfAlgorithms/Llasa-3b-GPTQ-8bit
Llasa-3b-GPTQ-8bit is a text generation model from AgeOfAlgorithms. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-4.0.
This is a 8bit GPTQ quantization of Llasa-3B by the HKUSTAudio team. I tested using a script written by GitHub user nivibilla, linked below. For some reason, I was not able to run it on my RTX 3090, while quantized Ll…
All-time downloads
282
Public
Parameters
3.4B
4.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.1 GB · 99%
Parameter types
How the weights are stored.
I322.8B · 83%
Try a prompt
Base models
Model card
From the Hugging Face model README
Model Description
This is a 8bit GPTQ quantization of Llasa-3B by the HKUSTAudio team. I tested using a script written by GitHub user nivibilla, linked below. For some reason, I was not able to run it on my RTX 3090, while quantized Llasa-1B worked fine. Please let me know if you can get it working.
Model Sources
<!-- Provide the basic links for the model. -->- Repository: HKUSTAudio/Llasa-3B
- Paper: LLaSA: Scaling Train-Time and Inference-Time Compute for LLaMA-based Speech Synthesis (Coming soon)
- Test Script: https://github.com/slives-lab/local-llasa-tts_voice/blob/main/llasa_vllm_longtext_inference.ipynb
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- cc-by-4.0
- Created
- Jan 30, 2025
- Updated
- Jan 31, 2025