Downloads · 30 days
20
25% of all-time downloads
heavytail/kullm-mistral
kullm-mistral is a text generation model from heavytail. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- base model: mistralai/Mistral-7B-Instruct-v0.2
Downloads · 30 days
20
25% of all-time downloads
All-time downloads
79
Public
Parameters
7.2B
14.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors14.5 GB · 100%
From the Hugging Face model README
from transformers import (
AutoModelForCausalLM,
AutoTokenizer
)
import torch
repo = "heavytail/kullm-mistral"
model = AutoModelForCausalLM.from_pretrained(
repo,
torch_dtype=torch.float16,
device_map='auto'
)
tokenizer = AutoTokenizer.from_pretrained(repo)
Initial upload: 2024/01/28 20:30