Downloads · 30 days
8
4% of all-time downloads
miquliz-120b-v2.0-FP8-Dynamic
Svak/miquliz-120b-v2.0-FP8-Dynamic
miquliz-120b-v2.0-FP8-Dynamic is a text generation model from Svak. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
All-time downloads
203
Public
Parameters
120B
121 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors121 GB · 100%
Parameter types
How the weights are stored.
F8_E4M3120B · 100%
Try a prompt
Model card
From the Hugging Face model README
Miquliz-120b-v2.0-FP8-dynamic
This quant was made for infermatic.ai
Dynamic FP8 quant of Miquliz 120B v2.0 made with AutoFP8.
Model Details
- Max Context: 32768 tokens
- Layers: 140
Prompt template: Mistral
<s>[INST] {prompt} [/INST]
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Created
- Jul 31, 2024
- Updated
- Aug 27, 2024