Downloads · 30 days
9
4% of all-time downloads
Jellon/Llama-3.1-Saoirse-70B-exl2-3bpw
Llama-3.1-Saoirse-70B-exl2-3bpw is a text generation model from Jellon. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.1.
3bpw exl2 quant of: https://huggingface.co/nbeerbower/Llama-3.1-Saoirse-70B
Downloads · 30 days
9
4% of all-time downloads
All-time downloads
224
Public
Repo size
28.6 GB
Likes
1
Public
Click a slice to open those files.
.safetensors28.6 GB · 100%
From the Hugging Face model README
3bpw exl2 quant of: https://huggingface.co/nbeerbower/Llama-3.1-Saoirse-70B

This is a merge of pre-trained language models created using mergekit.
This model was merged using the Model Stock merge method using mlabonne/Hermes-3-Llama-3.1-70B-lorablated as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: nbeerbower/Llama-3.1-Nemotron-lorablated-70B
- model: flammenai/Mahou-1.5-llama3.1-70B
- model: nbeerbower/Llama3.1-Gutenberg-Doppel-70B
- model: flammenai/Llama3.1-Flammades-70B
- model: rombodawg/Rombos-LLM-V2.6-Nemotron-70b
merge_method: model_stock
base_model: mlabonne/Hermes-3-Llama-3.1-70B-lorablated
dtype: bfloat16