Downloads · 30 days
25
20% of all-time downloads
GritLM-7B-GGUF-quantized
mswaringen/GritLM-7B-GGUF-quantized
GritLM-7B-GGUF-quantized is a text generation model from mswaringen. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
GGUF quants for https://huggingface.co/GritLM/GritLM-7B
All-time downloads
122
Public
Repo size
12.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf12.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Access
- Public
- Created
- Mar 28, 2024
- Updated
- Mar 28, 2024
- SHA
- c3a8affb
Try a prompt
Model card
From the Hugging Face model README
GGUF quants for https://huggingface.co/GritLM/GritLM-7B
GritLM is a generative representational instruction tuned language model. It unifies text representation (embedding) and text generation into a single model achieving state-of-the-art performance on both types of tasks.
| Layers | Context | Template (Text Representation) | Template (Text Generation) |
|---|---|---|---|
| <pre>32</pre> | <pre>32768</pre> | <pre><s><|user|><br>{instruction}<br><|embed|><br>{sample}</pre> | <pre><s><|user|><br>{prompt}<br><|assistant|><br>{response}</pre> |
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Created
- Mar 28, 2024
- Updated
- Mar 28, 2024