Downloads · 30 days
23
40% of all-time downloads
fxmarty_-_tiny-random-GemmaForCausalLM-4bits
RichardErkhov/fxmarty_-_tiny-random-GemmaForCausalLM-4bits
fxmarty_-_tiny-random-GemmaForCausalLM-4bits is a text generation model from RichardErkhov. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
57
Public
Parameters
8.2M
38.1 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json17.5 MB · 46%
Parameter types
How the weights are stored.
F168.2M · 100%
Try a prompt
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
tiny-random-GemmaForCausalLM - bnb 4bits
- Model creator: https://huggingface.co/fxmarty/
- Original model: https://huggingface.co/fxmarty/tiny-random-GemmaForCausalLM/
Original model description:
license: mit
This one with a custom config.head_dim as allowed by the architecture (see 7b model).
- Task
- Text Generation
- Library
- transformers
- Type
- gemma
- Created
- May 3, 2024
- Updated
- May 3, 2024