Imp-RPG.System-1B

Imp RPG System 1B

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the SLERP merge method.

Models Merged

The following models were included in the merge:

• NovaCorp/Ultimate-RPG.System-3.2-1B
• sillykiwi/Nano_Imp_1B-heretic

Configuration

The following YAML configuration was used to produce this model:

# Author: Dr. Novaciano
# Objective: Llama 3.2 1B AI Model
# =========================================================
# PROJECT: Llama 3.2 1B
# =========================================================

models:
  - model: sillykiwi/Nano_Imp_1B-heretic  # Experimental viral strain neural imprint
  - model: NovaCorp/Ultimate-RPG.System-3.2-1B  # Baseline cognitive template, "safe mode"

merge_method: slerp  # Spherical Linear Interpolation to preserve extreme viral traits smoothly
base_model: NovaCorp/Ultimate-RPG.System-3.2-1B  # Anchor model for stable latent space

dtype: bfloat16  # Memory-efficient precision, minimal loss in viral feature fidelity

parameters:
  t: 0.45

normalize: false
rescale: true
rescale_factor: 1.12
memory_efficient: true
low_cpu_mem_usage: true

layer_range:
  - value: [4, 22]

tie_word_embeddings: true
tie_output_embeddings: true