Downloads · 30 days
3
8% of all-time downloads
RichardErkhov/yam-peleg_-_Experiment26-7B-4bits
yam-peleg_-_Experiment26-7B-4bits is a text generation model from RichardErkhov. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
3
8% of all-time downloads
All-time downloads
39
Public
Parameters
7.4B
4.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors4.5 GB · 100%
How the weights are stored.
U87B · 95%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Experiment26-7B - bnb 4bits
license: apache-2.0 language:
Experiment26-7B
An experiment for testing and refining a specific training and evaluation pipeline research framework.
This experiment aims to identify potential optimizations, focusing on data engineering, architecture efficiency, and evaluation performance.
The goal is to evaluate the effectiveness of a new training / evaluation pipeline for LLMs.
The experiment will explore adjustments in data preprocessing, model training algorithms, and evaluation metrics to test methods for improvement.
More details in the future experiments.