Downloads · 30 days
130
4% of all-time downloads
jackfram_llama-68m-GPTQ
TheBlokeAI/jackfram_llama-68m-GPTQ
jackfram_llama-68m-GPTQ is a text generation model from TheBlokeAI. Use it when you need the model to write or continue text. It is set up for transformers.
A 4-bit, 128g, actorder=True GPTQ quantisation of JackFram/llama-68m, a 68 million parameter Llama1 model; created on request for software testing.
All-time downloads
3K
Public
Parameters
68.1M
110 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors109 MB · 100%
Parameter types
How the weights are stored.
F1649.2M · 72%
Try a prompt
Spaces
Model card
From the Hugging Face model README
A 4-bit, 128g, act_order=True GPTQ quantisation of JackFram/llama-68m, a 68 million parameter Llama1 model; created on request for software testing.
Not for normal usage!
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Sep 21, 2023
- Updated
- Sep 21, 2023