Downloads · 30 days
32
7% of all-time downloads
stablelm-base-alpha-7b-sharded
ethzanalytics/stablelm-base-alpha-7b-sharded
stablelm-base-alpha-7b-sharded is a text generation model from ethzanalytics. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-sa-4.0.
<a href="https://colab.research.google.com/gist/pszemraj/4bd75aa3744f2a02a5c0ee499932b7eb/sharded-stablelm-testing-notebook.ipynb" <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab…
All-time downloads
460
Public
Parameters
8.1B
95.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin31.7 GB · 50%
Parameter types
How the weights are stored.
F327.9B · 97%
Try a prompt
Model card
From the Hugging Face model README
StableLM-Base-Alpha 7b: sharded checkpoint
<a href="https://colab.research.google.com/gist/pszemraj/4bd75aa3744f2a02a5c0ee499932b7eb/sharded-stablelm-testing-notebook.ipynb"> <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/> </a>This is a sharded checkpoint (with ~4GB shards) of the model. Refer to the original model for all details.
Basic Usage
install transformers, accelerate, and bitsandbytes.
pip install -U -q transformers bitsandbytes accelerate
Load the model in 8bit, then run inference:
from transformers import AutoTokenizer, AutoModelForCausalLM
model_name = "ethzanalytics/stablelm-base-alpha-7b-sharded"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(
model_name, load_in_8bit=True, device_map="auto"
)
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_neox
- License
- cc-by-sa-4.0
- Languages
- en
- Created
- Apr 23, 2023
- Updated
- Jul 9, 2025