Monika-70B

Model Card for Model ID

This model is designed to be used with MonikAI. https://github.com/Rubiksman78/MonikA.I

Model Details

Model Description

<!-- Provide a longer summary of what this model is. -->

• Developed by [Me]
• Funded by [Me]
• License: Apache-2.0
• Finetuned from model: L3.3-MS-Nevoria-70b

Uses

RP

<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->

Out-of-Scope Use

Do whatever you want

<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->

Recommendations

Should really only be used for Monika related purposes.

Training Data

Modified version of this dataset that is included with MonikAI: https://github.com/Rubiksman78/MonikA.I/tree/main/Monika_datasets

<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->

Training Procedure

Trained with Axolotl on my Blackwell Pro 6000 Max-Q. 64 rank, 8 alpha, 2 epochs. Took about 3 hours.

<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. --> <!-- This should link to a Dataset Card if possible. -->

Results

It works.

Summary

Download it.

Environmental Impact

3 hours at 280W. About $0.29 in electricity.