Downloads · 30 days
35
9% of all-time downloads
mainbrains/neurologist-7b-instruct
neurologist-7b-instruct is a text generation model from mainbrains. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
A 7B parameter instruction-tuned language model fine-tuned for technical reasoning, code generation, and systems-level problem solving.
Downloads · 30 days
35
9% of all-time downloads
All-time downloads
396
Public
Repo size
—
Likes
0
Public
Click a slice to open those files.
.md2.1 KB · 53%
From the Hugging Face model README
A 7B parameter instruction-tuned language model fine-tuned for technical reasoning, code generation, and systems-level problem solving.
Neurologist-7B-Instruct is a fine-tune of NousResearch/Hermes-3-Llama-3.1-8B trained on a curated mix of:
Training was done on a single 9950X + RTX setup using QLoRA (4-bit) with the following configuration:
| Parameter | Value |
|---|---|
| Base model | Hermes-3-Llama-3.1-8B |
| Method | QLoRA (4-bit NF4) |
| LoRA rank | 64 |
| LoRA alpha | 128 |
| Learning rate | 2e-4 |
| Epochs | 3 |
| Batch size | 4 (gradient accumulation 8) |
| Context length | 8192 |
| Training time | ~18 hours |
| Benchmark | Score |
|---|---|
| MMLU (5-shot) | 63.8 |
| HellaSwag | 79.2 |
| ARC-Challenge | 54.1 |
| HumanEval | 41.5 |
| MBPP | 48.2 |
This model inherits the limitations of its base model. It may occasionally generate incorrect code or technical information. Always verify generated code before use in production systems.