Downloads · 30 days
115
2% of all-time downloads
grimjim/Llama-3-Luminurse-v0.2-OAS-8B-GGUF
Llama-3-Luminurse-v0.2-OAS-8B-GGUF is a text generation model from grimjim. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
This repo contains GGUF quants of Llama-3-Luminurse-v0.2-OAS-8B. For suggested sampler settings, refer to the model card of the original repo.
Downloads · 30 days
115
2% of all-time downloads
All-time downloads
4.7K
Public
Repo size
25.8 GB
Likes
2
Public
Click a slice to open those files.
.gguf25.8 GB · 100%
From the Hugging Face model README
This repo contains GGUF quants of Llama-3-Luminurse-v0.2-OAS-8B. For suggested sampler settings, refer to the model card of the original repo.
This model is a merge of pre-trained language models created using mergekit.
Luminurse is a merge based on Lumimaid, enhanced with a biomedical model, with a dash of TheSpice thrown in to improve formatting of text generation.
Built with Meta Llama 3.
The combined restrictions of both the cc-by-nc-4.0 and llama3 licenses apply to this model and its derivatives. If one restricts where the other does not, then the restriction applies.
This model was merged using the task arithmetic merge method using NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
base_model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
slices:
- sources:
- model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
layer_range: [0,32]
- model: grimjim/llama-3-aaditya-OpenBioLLM-8B
layer_range: [0,32]
parameters:
weight: 0.2
- model: cgato/L3-TheSpice-8b-v0.8.3
layer_range: [0,32]
parameters:
weight: 0.04
merge_method: task_arithmetic
dtype: bfloat16