Downloads · 30 days
20
0% of all-time downloads
heavytail/kullm-mistral-S
kullm-mistral-S is a text generation model from heavytail. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- base model: mistralai/Mistral-7B-Instruct-v0.2
Downloads · 30 days
20
0% of all-time downloads
All-time downloads
32.9K
Public
Parameters
7.2B
14.5 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors14.5 GB · 100%
From the Hugging Face model README
from transformers import (
AutoModelForCausalLM,
AutoTokenizer
)
import torch
repo = "heavytail/kullm-mistral-S"
model = AutoModelForCausalLM.from_pretrained(
repo,
torch_dtype=torch.float16,
device_map='auto'
)
tokenizer = AutoTokenizer.from_pretrained(repo)
Initial upload: 2024/01/28 21:00