Downloads · 30 days
16
40% of all-time downloads
Llama-3-Lumimaid-70B-v0.1-Instruct-FP8-Dynamic
Infermatic/Llama-3-Lumimaid-70B-v0.1-Instruct-FP8-Dynamic
Llama-3-Lumimaid-70B-v0.1-Instruct-FP8-Dynamic is a machine learning model from Infermatic. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
All-time downloads
40
Public
Parameters
70.6B
72.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors72.7 GB · 100%
Parameter types
How the weights are stored.
F8_E4M368.5B · 97%
Model card
From the Hugging Face model README
This quant was made for infermatic.ai
Dynamic FP8 quant of Llama-3-Lumimaid-70B-v0.1 made with AutoFP8.
Lumimaid 0.1
<center><div style="width: 100%;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/630dfb008df86f1e5becadc3/d3QMaxy3peFTpSlWdWF-k.png" style="display: block; margin: auto;"> </div></center>This model uses the Llama3 prompting format
Llama3 trained on our RP datasets, we tried to have a balance between the ERP and the RP, not too horny, but just enough.
We also added some non-RP dataset, making the model less dumb overall. It should look like a 40%/60% ratio for Non-RP/RP+ERP data.
This model includes the new Luminae dataset from Ikari.
Credits:
- Undi
- IkariDev
Prompt template: Llama3
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
{output}<|eot_id|>
- Type
- llama
- License
- cc-by-nc-4.0
- Created
- Aug 13, 2024
- Updated
- Aug 13, 2024