Downloads · 30 days
17
4% of all-time downloads
Miquliz-120b-v2.0-FP8-dynamic
Infermatic/Miquliz-120b-v2.0-FP8-dynamic
Miquliz-120b-v2.0-FP8-dynamic is a text generation model from Infermatic. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
All-time downloads
402
Public
Parameters
120B
121 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors121 GB · 100%
Parameter types
How the weights are stored.
F8_E4M3120B · 100%
Try a prompt
Model card
From the Hugging Face model README
Miquliz-120b-v2.0-FP8-dynamic
This quant was made for infermatic.ai
Dynamic FP8 quant of Miquliz 120B v2.0 made with AutoFP8.
Model Details
- Max Context: 32768 tokens
- Layers: 140
Prompt template: Mistral
<s>[INST] {prompt} [/INST]
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Created
- Jul 31, 2024
- Updated
- Aug 6, 2024