Downloads · 30 days
8
3% of all-time downloads
TinyLlama-1.1B-Chat-v1.0-GPTQ-4bit-sharded
ModelCloud/TinyLlama-1.1B-Chat-v1.0-GPTQ-4bit-sharded
TinyLlama-1.1B-Chat-v1.0-GPTQ-4bit-sharded is a text generation model from ModelCloud. Use it when you need the model to write or continue text. It is set up for transformers.
- bits: 4, - groupsize: 128, - descact: true, - staticgroups: false, - sym: true, - lmhead: false, - damppercent: 0.01, - truesequential: true, - modelnameorpath: , - modelfilebasename: model, - quantmethod: gptq, - c…
All-time downloads
264
Public
Parameters
1.1B
768 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors767 MB · 100%
Parameter types
How the weights are stored.
I32969M · 88%
Try a prompt
Model card
From the Hugging Face model README
- bits: 4,
- group_size: 128,
- desc_act: true,
- static_groups: false,
- sym: true,
- lm_head: false,
- damp_percent: 0.01,
- true_sequential: true,
- model_name_or_path: ,
- model_file_base_name: model,
- quant_method: gptq,
- checkpoint_format: gptq,
- meta:
- quantizer: gptqmodel:0.9.9-dev0
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Jul 23, 2024
- Updated
- Jul 23, 2024