astramix_l2_7b

Introduction

Astramix is a merge of various Llama-2-7b finetune models, using ties-merge method, thanks for Chargoddard. Subsequently, lora merge script was used, created by zarakiquemparte (link to the Hugging Face profile).

Approximate rating for this model, noticed in short-time use:

• Great roleplay capabilities, limited only by model parameters.
• Poor quality reasoning, because of the model limitations.
• Almost censorship absence (yet some parts can be generated in the output).

Feel free to test the model.

Following base model used for merge: Llama-2-7B-fp16

List of models used for merge:

• Nous-Hermes-llama-2-7b
• airoboros-l2-7b-2.1
• orca_mini_v3_7b
• Platypus2-7B
• Tulpar-7b-v0

Then, two LoRAs was merged into basemix model, using script specified above:

• limarp-llama2-v2 (Licensed under AGPLv3)
• airoboros-lmoe-7b-2.1 (Utilizing creative version)

Here is quantized versions of the model:

• GGUF fp16 and Q5_K_M
• GPTQ 4bit 128g

I suggest using Alpaca instruct format:

### Instruction:
(your instruct prompt is here)
### Response:

Limitations and risks

Llama2 and its derivatives (finetunes) is licensed under LLama 2 Community License, various finetunes or (Q)LoRAs has appropriate licenses depending on used datasets in finetuning or training Low-Rank Adaptations. This mix can generate heavily biased output, which aren't suitable for minors or common audience due to using limarp in the merge.