Downloads · 30 days
13
27% of all-time downloads
RichardErkhov/alonzogarbanzo_-_Bloom-1b7-glue-mrpc-IT-baseline-4bits
alonzogarbanzo_-_Bloom-1b7-glue-mrpc-IT-baseline-4bits is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
13
27% of all-time downloads
All-time downloads
49
Public
Parameters
1.7B
1.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1.7 GB · 99%
How the weights are stored.
U81.2B · 69%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Bloom-1b7-glue-mrpc-IT-baseline - bnb 4bits
license: bigscience-bloom-rail-1.0 base_model: bigscience/bloom-1b7 tags:
This model is a fine-tuned version of bigscience/bloom-1b7 on an unknown dataset.
More information needed
More information needed
Instruction Tuned on the glue-mrpc task here: https://huggingface.co/datasets/adambjorn/UnrelatedForgettingOverhead/viewer/glue-mrpc
Given a set of prompts:
prompts = [
"Determine if the following sentences are equivalent: Sentence 1: {sentence1} Sentence 2: {sentence2}. Answer: ",
"Are these sentences saying the same thing? First: {sentence1} Second: {sentence2}. Response: ",
"Check sentence equivalence: \"{sentence1}\" versus \"{sentence2}\". Result: ",
]
Concatenate the prompts, the two sentences and the label as so:
input_text = prompt.format(sentence1=sentence1, sentence2=sentence2)
input_text += " " + responses[label]
The following hyperparameters were used during training:
Final results: {'loss': 0.0949, 'grad_norm': 5.0146379470825195, 'learning_rate': 6.000000000000001e-07, 'epoch': 10.0}
Average results: {'train_runtime': 363.2148, 'train_samples_per_second': 5.506, 'train_steps_per_second': 1.377, 'train_loss': 0.4939311617612839, 'epoch': 10.0}