Downloads · 30 days
37
7% of all-time downloads
stablelm-base-alpha-3b-sharded
ethzanalytics/stablelm-base-alpha-3b-sharded
stablelm-base-alpha-3b-sharded is a text generation model from ethzanalytics. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-sa-4.0.
<a href="https://colab.research.google.com/gist/pszemraj/4bd75aa3744f2a02a5c0ee499932b7eb/sharded-stablelm-testing-notebook.ipynb" <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab…
All-time downloads
565
Public
Repo size
29.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin14.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-sa-4.0
- Model type
- gpt_neox
- Access
- Public
- Created
- Apr 22, 2023
- Updated
- Apr 27, 2023
- SHA
- 34c2d551
Try a prompt
Model card
From the Hugging Face model README
StableLM-Base-Alpha: sharded checkpoint
<a href="https://colab.research.google.com/gist/pszemraj/4bd75aa3744f2a02a5c0ee499932b7eb/sharded-stablelm-testing-notebook.ipynb"> <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/> </a>This is a sharded checkpoint (with ~2GB shards) of the model. Refer to the original model for all details.
Basic Usage
install transformers, accelerate, and bitsandbytes.
pip install -U -q transformers bitsandbytes accelerate
Load the model in 8bit, then run inference:
from transformers import AutoTokenizer, AutoModelForCausalLM
model_name = "ethzanalytics/stablelm-base-alpha-3b-sharded"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name, load_in_8bit=True)
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_neox
- License
- cc-by-sa-4.0
- Languages
- en
- Created
- Apr 22, 2023
- Updated
- Apr 27, 2023