Marx-3B

acrastt/Marx-3B

Marx-3B is a text generation model from acrastt. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

<a href="https://www.buymeacoffee.com/acrastt" target="blank"<img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" </a

Downloads · 30 days

131

0% of all-time downloads

All-time downloads

71.4K

Public

Parameters

3.4B

13.7 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin6.9 GB · 50%

Parameter types

How the weights are stored.

F163.4B · 100%

Try a prompt

Datasets

totally-not-an-llm/everything-sharegptformat-morecleaned

Spaces

28 linked

Model card

From the Hugging Face model README

This is OpenLLaMA 3B V2 finetuned on EverythingLM Data(ShareGPT format more cleaned) for 1 epochs.

Prompt template:

### HUMAN:
{prompt}

### RESPONSE:
<leave a newline for the model to answer>

GGML quants available here.</br> GPTQ quants available here.

Note: Don't expect this model to be good, I was just starting out to finetune. So don't roast me please!

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	41.71
ARC (25-shot)	43.17
HellaSwag (10-shot)	72.68
MMLU (5-shot)	28.46
TruthfulQA (0-shot)	39.09
Winogrande (5-shot)	65.59
GSM8K (5-shot)	1.29

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	41.71
AI2 Reasoning Challenge (25-Shot)	43.17
HellaSwag (10-Shot)	72.68
MMLU (5-Shot)	28.46
TruthfulQA (0-shot)	39.09
Winogrande (5-shot)	65.59
GSM8k (5-shot)	1.29

Task: Text Generation
Library: transformers
Type: llama
License: apache-2.0
Languages: en
Created: Aug 15, 2023
Updated: Feb 3, 2024