Downloads · 30 days
33
1% of all-time downloads
pszemraj/jamba-H1024_L12-v0.07-fineweb-1M-med
jamba-H1024_L12-v0.07-fineweb-1M-med is a text generation model from pszemraj. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
<a href="https://colab.research.google.com/gist/pszemraj/a7aa793feb394580a962641ed92310bb/test-jamba-h1024-v0-07.ipynb" <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/ </a
Downloads · 30 days
33
1% of all-time downloads
All-time downloads
3.3K
Public
Parameters
888M
1.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1.8 GB · 100%
How the weights are stored.
BF16887M · 100%
From the Hugging Face model README
mid-training checkpoint
for this checkpoint
hf (pretrained=pszemraj/jamba-H1024_L12-v0.07-fineweb-1M-med,trust_remote_code=True,dtype=float), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: 8
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | |
|---|---|---|---|---|---|---|---|
| winogrande | 1 | none | 0 | acc | 0.4972 | ± | 0.0141 |
| piqa | 1 | none | 0 | acc | 0.6072 | ± | 0.0114 |
| none | 0 | acc_norm | 0.6034 | ± | 0.0114 | ||
| openbookqa | 1 | none | 0 | acc | 0.1660 | ± | 0.0167 |
| none | 0 | acc_norm | 0.2800 | ± | 0.0201 | ||
| lambada_openai | 1 | none | 0 | perplexity | 157.6757 | ± | 6.8536 |
| none | 0 | acc | 0.2127 | ± | 0.0057 | ||
| boolq | 2 | none | 0 | acc | 0.6235 | ± | 0.0085 |
| arc_easy | 1 | none | 0 | acc | 0.3944 | ± | 0.0100 |
| none | 0 | acc_norm | 0.3531 | ± | 0.0098 |