Downloads · 30 days
76
9% of all-time downloads
stablelm-ggml
rustformers/stablelm-ggml
stablelm-ggml is a text generation model from rustformers. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-sa-4.0.
StableLM-Base-Alpha is a suite of 3B and 7B parameter decoder-only language models pre-trained on a diverse collection of English and Code datasets with a sequence length of 4096 to push beyond the context window limi…
All-time downloads
837
Public
Repo size
150 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.bin107 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-sa-4.0
- Access
- Public
- Created
- May 29, 2023
- Updated
- Jun 9, 2023
- SHA
- 016a9a89
Try a prompt
Model card
From the Hugging Face model README
GGML converted version of StabilityAI's StableLM models
Description
StableLM-Base-Alpha is a suite of 3B and 7B parameter decoder-only language models pre-trained on a diverse collection of English and Code datasets with a sequence length of 4096 to push beyond the context window limitations of existing open-source language models.
Converted Models
Usage
Python via llm-rs:
Installation
Via pip: pip install llm-rs
Run inference
from llm_rs import AutoModel
#Load the model, define any model you like from the list above as the `model_file`
model = AutoModel.from_pretrained("rustformers/stablelm-ggml",model_file="stablelm-base-alpha-3b-q4_0-ggjt.bin")
#Generate
print(model.generate("The meaning of life is"))
Rust via Rustformers/llm:
Installation
git clone --recurse-submodules https://github.com/rustformers/llm.git
cd llm
cargo build --release
Run inference
cargo run --release -- gptneox infer -m path/to/model.bin -p "Tell me how cool the Rust programming language is:"
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-sa-4.0
- Languages
- en
- Created
- May 29, 2023
- Updated
- Jun 9, 2023