Downloads · 30 days
86
3% of all-time downloads
CausalLM-34b-beta-iMat.GGUF
dranger003/CausalLM-34b-beta-iMat.GGUF
CausalLM-34b-beta-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as gpl-3.0.
GGUF importance matrix (imatrix) quants for https://huggingface.co/CausalLM/34b-beta The importance matrix was trained for 40K tokens (80 batches of 512 tokens) using random data.
All-time downloads
3.1K
Public
Repo size
88.3 GB
Likes
7
Public
Repo makeup
Click a slice to open those files.
.gguf53.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- gpl-3.0
- Access
- Public
- Created
- Feb 15, 2024
- Updated
- Feb 18, 2024
- SHA
- 7bd97ee8
Try a prompt
Model card
From the Hugging Face model README
GGUF importance matrix (imatrix) quants for https://huggingface.co/CausalLM/34b-beta
The importance matrix was trained for 40K tokens (80 batches of 512 tokens) using random data.
From the model author:
Please do not use wikitext for quantization calibration because all wikitext have been re-aligned on synthetic dataset, and its distribution differs significantly from the original wikitext.
| Layers | Context | Template |
|---|---|---|
| <pre>60</pre> | <pre>200000</pre> | <pre><|im_start|>system<br>{instructions}<|im_end|><br><|im_start|>user<br>{prompt}<|im_end|><br><|im_start|>assistant<br>{response}</pre> |
- Task
- Text Generation
- Library
- gguf
- License
- gpl-3.0
- Created
- Feb 15, 2024
- Updated
- Feb 18, 2024