Downloads · 30 days
14
7% of all-time downloads
35b-beta-long-3.75bpw-exl2
txin/35b-beta-long-3.75bpw-exl2
35b-beta-long-3.75bpw-exl2 is a text generation model from txin. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
- 3.75bpw test quant of CausalLM/35b-beta-long, which is in itself a finetune of CohereForAI/c4ai-command-r-v01 (hence the corrected licensing). - Theoretically should fit within 24GB of VRAM for inference.
All-time downloads
215
Public
Repo size
22.3 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors22.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- cohere
- Access
- Public
- Created
- May 6, 2024
- Updated
- May 6, 2024
- SHA
- 1c1d00e9
Try a prompt
Model card
From the Hugging Face model README
Notes
- 3.75bpw test quant of CausalLM/35b-beta-long, which is in itself a finetune of CohereForAI/c4ai-command-r-v01 (hence the corrected licensing).
- Theoretically should fit within 24GB of VRAM for inference.
TBA
Tokenizer is different from cohere - and chat template is ChatML - fully fine-tuned at 128K+
No loras, no quants, no tricks, 30M+ sft data.
Pressure Testing from: https://github.com/LeonEricsson/llmcontext
- Task
- Text Generation
- Library
- transformers
- Type
- cohere
- License
- cc-by-nc-4.0
- Languages
- en, zh, ja, de
- Created
- May 6, 2024
- Updated
- May 6, 2024