Downloads · 30 days
3
17% of all-time downloads
teilomillet_-_MiniMerlin-3b-v0.1-4bits
RichardErkhov/teilomillet_-_MiniMerlin-3b-v0.1-4bits
teilomillet_-_MiniMerlin-3b-v0.1-4bits is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
18
Public
Parameters
3.1B
2.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.1 GB · 100%
Parameter types
How the weights are stored.
U82.7B · 89%
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
MiniMerlin-3b-v0.1 - bnb 4bits
- Model creator: https://huggingface.co/teilomillet/
- Original model: https://huggingface.co/teilomillet/MiniMerlin-3b-v0.1/
Original model description:
license: apache-2.0 language:
- fr pipeline_tag: text-generation
-
FT : @teilomillet
-
Instruction tune using QLoRA on a french dataset for 1 epoch. The aim was to test and try the dataset. Implementing a customization via a dataset and fine-tuning on it. The way to respond is also important to see if it's taken from the dataset and add to the customization.
This is the first of a long serie of multiple models. Aimed to be minuscule as possible.
- Batch : 6
- Gradient step : 1
- Epoch : 1
- Lr : 0.0002
- Type
- llama
- Created
- Oct 26, 2024
- Updated
- Oct 26, 2024