Downloads · 30 days
11
5% of all-time downloads
Llasa-1b-GPTQ-8bit
AgeOfAlgorithms/Llasa-1b-GPTQ-8bit
Llasa-1b-GPTQ-8bit is a text generation model from AgeOfAlgorithms. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-4.0.
This is a 8bit GPTQ quantization of Llasa-1B by the HKUSTAudio team. I tested using a script written by GitHub user nivibilla, linked below. The tests were successful, and this quantized model produced very decent res…
All-time downloads
211
Public
Parameters
1.4B
1.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.8 GB · 98%
Parameter types
How the weights are stored.
I32973M · 71%
Try a prompt
Base models
Model card
From the Hugging Face model README
Model Description
This is a 8bit GPTQ quantization of Llasa-1B by the HKUSTAudio team. I tested using a script written by GitHub user nivibilla, linked below. The tests were successful, and this quantized model produced very decent results.
Model Sources
<!-- Provide the basic links for the model. -->- Repository: HKUSTAudio/Llasa-1B
- Paper: LLaSA: Scaling Train-Time and Inference-Time Compute for LLaMA-based Speech Synthesis (Coming soon)
- Test Script: https://github.com/slives-lab/local-llasa-tts_voice/blob/main/llasa_vllm_longtext_inference.ipynb
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- cc-by-4.0
- Created
- Jan 30, 2025
- Updated
- Jan 31, 2025