MineMA-8B-v4-heretic

Abliterated model using Heretic on MineMA-8B weights. Original model created by VIPA Lab and the Odyssey project. Not sure why anyone would ever need this. I just did it because I could, and wanted to experiment with transforming an inference model for the first time.

Results:

Pareto optimal trial chosen was 52, with refusals = 2/100, and KL divergence = 0.0026.

@misc {cui_zhenyu_2024,
author = { Cui Zhenyu },
title = { MineMA-8B (Revision 2c64114) },
year = 2024,
url = { https://huggingface.co/Aiwensile2/MineMA-8B },
doi = { 10.57967/hf/2488 },
publisher = { Hugging Face }
}

@misc{heretic,
  author = {Weidmann, Philipp Emanuel},
  title = {Heretic: Fully automatic censorship removal for language models},
  year = {2025},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/p-e-w/heretic}}
}

Please use responsibly.

Original model card:

---

MineMA: Fine-Tuned Models for Minecraft Q&A

Overview

In this repository, we present the MineMA series of models, fine-tuned specifically for Minecraft-related Q&A tasks. Utilizing the LoRA method for efficient model fine-tuning, we have adapted pre-trained LLaMA models to respond accurately and effectively to Minecraft-related instructions and queries. Our fine-tuning process leverages the specially generated Minecraft dataset to ensure relevance and accuracy in the Q&A responses.

Models

The MineMA series includes several models fine-tuned on different base models from the LLaMA series. Below is the list of the fine-tuned models provided in this repository:

• MineMA-8B(v1, v2, v3, v4), derived from the base model LLaMA-3-8B-Instruct.
• MineMA-13B(v1, v2), derived from the base model LLaMA-2-13B-Chat.
• MineMA-70B(v1, v2), derived from the base model LLaMA-3-70B-Instruct.

These models have been fine-tuned by using the Minecraft_QA-pairs_Instruction_Dataset. We have only released four MineMA-8B models and two MineMA-70B models for the time being, and we will supplement more models in the future. Considering the relatively large size of the full model weights, our MineMA-70B series models are provided as LoRA models, which need to be combined with the base model LLaMA-3-70B-Instruct to use.

Fine-Tuning Methodology

LoRA Method for Fine-Tuning

We employed the LoRA (Low-Rank Adaptation) method for fine-tuning our models. LoRA is a parameter-efficient training technique that introduces small, trainable low-rank matrices to adapt a pre-trained neural network, allowing for targeted updates without the need for retraining the entire model. This method strikes a balance between computational efficiency and training effectiveness.

Training Parameters

Here are the specific training parameters:

Dataset

We used the Minecraft_QA-pairs_Instruction_Dataset for fine-tuning all the models in the MineMA series. This dataset has 390,317 instruction entries specifically designed for Minecraft-related Q&A tasks. You can access the dataset via the following link:

Minecraft_QA-pairs_Instruction_Dataset

Use

Prompts

We recommend using the following prompts:

System message: You are a Large Language Model, and your task is to answer questions posed by users about Minecraft. Utilize your knowledge and understanding of the game to provide detailed, accurate, and helpful responses. Use your capabilities to assist users in solving problems, understanding game mechanics, and enhancing their Minecraft experience.

User message: [A question about Minecraft]

Example Code

Example code for reference usage guidelines can be found at: "Model usage method.ipynb".

Environment Setup

Environment requirements needed to use the model are written in "requirements.txt".

Run the following command to install all dependencies:

pip install -r requirements.txt

Details

License

These models are made available under the Creative Commons Attribution 4.0 International License.

DOI

10.57967/hf/2488