Downloads · 30 days
451
11% of all-time downloads
NeuralReyna-Mini-1.8B-v0.3-GGUF
afrideva/NeuralReyna-Mini-1.8B-v0.3-GGUF
NeuralReyna-Mini-1.8B-v0.3-GGUF is a text generation model from afrideva. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Quantized GGUF model files for NeuralReyna-Mini-1.8B-v0.3 from M4-ai
All-time downloads
4.3K
Public
Repo size
11.7 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf11.7 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Mar 25, 2024
- Updated
- Mar 25, 2024
- SHA
- bf327c71
Try a prompt
Base models
Model card
From the Hugging Face model README
M4-ai/NeuralReyna-Mini-1.8B-v0.3-GGUF
Quantized GGUF model files for NeuralReyna-Mini-1.8B-v0.3 from M4-ai
| Name | Quant method | Size |
|---|---|---|
| neuralreyna-mini-1.8b-v0.3.fp16.gguf | fp16 | 3.68 GB |
| neuralreyna-mini-1.8b-v0.3.q2_k.gguf | q2_k | 846.57 MB |
| neuralreyna-mini-1.8b-v0.3.q3_k_m.gguf | q3_k_m | 1.02 GB |
| neuralreyna-mini-1.8b-v0.3.q4_k_m.gguf | q4_k_m | 1.22 GB |
| neuralreyna-mini-1.8b-v0.3.q5_k_m.gguf | q5_k_m | 1.38 GB |
| neuralreyna-mini-1.8b-v0.3.q6_k.gguf | q6_k | 1.58 GB |
| neuralreyna-mini-1.8b-v0.3.q8_0.gguf | q8_0 | 1.96 GB |
Original Model Card:
NeuralReyna-Mini-1.8B-v0.3
Description
Taken aloobun/Reyna-Mini-1.8B-v0.2 and further fine-tuned it using DPO using the argilla/OpenHermes2.5-dpo-binarized-alpha.
This model has capabilities in coding, math, science, roleplay, and function calling.
This model was trained on OpenAI's ChatML prompt format.
Evaluation
Coming soon
Contributions
Thanks to @aloobun and @Locutusque for their contributions to this model.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 41.77 |
| AI2 Reasoning Challenge (25-Shot) | 35.58 |
| HellaSwag (10-Shot) | 61.13 |
| MMLU (5-Shot) | 44.22 |
| TruthfulQA (0-shot) | 41.99 |
| Winogrande (5-shot) | 60.93 |
| GSM8k (5-shot) | 6.75 |
- Task
- Text Generation
- License
- apache-2.0
- Languages
- en
- Created
- Mar 25, 2024
- Updated
- Mar 25, 2024