Downloads · 30 days
10
29% of all-time downloads
L3.1-70B-Hanami-x1-FP8-Dynamic
Infermatic/L3.1-70B-Hanami-x1-FP8-Dynamic
L3.1-70B-Hanami-x1-FP8-Dynamic is a machine learning model from Infermatic. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
All-time downloads
34
Public
Parameters
70.6B
72.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors72.7 GB · 100%
Parameter types
How the weights are stored.
F8_E4M368.5B · 97%
Model card
From the Hugging Face model README
Llama-3.1-70B-Hanami-x1
This quant was made for and by infermatic.ai
Dynamic FP8 quant of L3.1 70B Hanami x1 made with AutoFP8.
- Used and hosted under Sao's authorization
Copy of the official card:
This is an experiment over Euryale v2.2, which I think worked out nicely.
Feels different from it, in a good way. I prefer it over 2.2, and 2.1 from testing.
As usual, the Euryale v2.1 & 2.2 Settings work on it.
min_p of at minimum 0.1 is recommended for Llama 3 types.
I like it, so try it out?
- Type
- llama
- License
- cc-by-nc-4.0
- Languages
- en
- Created
- Sep 18, 2024
- Updated
- Sep 18, 2024