Llama-3.2-1B-Instruct-RLHF-v0.1

ericflo/Llama-3.2-1B-Instruct-RLHF-v0.1

Llama-3.2-1B-Instruct-RLHF-v0.1 is a text generation model from ericflo. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Below is a side-by-side comparison of the two result sets. For each task, the higher value (i.e., “better” on that metric) is highlighted in bold:

Downloads · 30 days

201

15% of all-time downloads

All-time downloads

1.4K

Public

Parameters

1.2B

13.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf10.6 GB · 81%

At a glance

Task: Text Generation
Library: transformers
License: apache-2.0
Model type: llama
Access: Public
Created: Dec 23, 2024
Updated: Dec 23, 2024
SHA: d25b955e

Try a prompt

Base models

meta-llama/Llama-3.2-1B-Instruct

Datasets

OpenRLHF/prompt-collection-v0.1

Model card

From the Hugging Face model README

This model's benchmark results

Tasks	Version	Filter	n-shot	Metric		Value		Stderr
tinyBenchmarks	N/A
- tinyArc	0	none	25	acc_norm	↑	0.4253	±	N/A
- tinyGSM8k	0	flexible-extract	5	exact_match	↑	0.3768	±	N/A
		strict-match	5	exact_match	↑	0.3768	±	N/A
- tinyHellaswag	0	none	10	acc_norm	↑	0.5379	±	N/A
- tinyMMLU	0	none	0	acc_norm	↑	0.4483	±	N/A
- tinyTruthfulQA	0	none	0	acc	↑	0.4217	±	N/A
- tinyWinogrande	0	none	5	acc_norm	↑	0.5366	±	N/A

Original `meta-llama/Llama-3.2-1B-Instruct` benchmark results

Tasks	Version	Filter	n-shot	Metric		Value		Stderr
tinyBenchmarks	N/A
- tinyArc	0	none	25	acc_norm	↑	0.4145	±	N/A
- tinyGSM8k	0	flexible-extract	5	exact_match	↑	0.3412	±	N/A
		strict-match	5	exact_match	↑	0.3412	±	N/A
- tinyHellaswag	0	none	10	acc_norm	↑	0.5335	±	N/A
- tinyMMLU	0	none	0	acc_norm	↑	0.4298	±	N/A
- tinyTruthfulQA	0	none	0	acc	↑	0.4288	±	N/A
- tinyWinogrande	0	none	5	acc_norm	↑	0.5366	±	N/A

Below is a side-by-side comparison of the two result sets. For each task, the higher value (i.e., “better” on that metric) is highlighted in bold:

Task	this	orig	Better?
tinyArc (acc_norm)	0.4253	0.4145	v1 higher
tinyGSM8k (exact_match)	0.3768	0.3412	v1 higher
tinyHellaswag (acc_norm)	0.5379	0.5335	v1 higher
tinyMMLU (acc_norm)	0.4483	0.4298	v1 higher
tinyTruthfulQA (acc)	0.4217	0.4288	v2 higher
tinyWinogrande (acc_norm)	0.5366	0.5366	tie

Observations

Ours outperforms the original on four tasks (tinyArc, tinyGSM8k, tinyHellaswag, tinyMMLU).
The original outperforms ours on one task (tinyTruthfulQA).
One task is a tie (tinyWinogrande).

Given these comparisons, our results are stronger overall because it has higher scores on the majority of tasks. The only exception is on tinyTruthfulQA, where the original scores slightly better, and on tinyWinogrande, both versions tie.

Task: Text Generation
Library: transformers
Type: llama
License: apache-2.0
Created: Dec 23, 2024
Updated: Dec 23, 2024