Downloads · 30 days
8
15% of all-time downloads
nhotin/vistral7B-legalbizai-q8-gguf
vistral7B-legalbizai-q8-gguf is a text generation model from nhotin. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
- Model Name: Vistral-7B-LegalBizAI - Version: 1.0 - Model Type: Causal Language Model - Architecture: Transformer-based model with 7 billion parameters - Quantization: 8-bit quantized for efficiency
Downloads · 30 days
8
15% of all-time downloads
All-time downloads
53
Public
Parameters
7.3B
7.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors7.6 GB · 100%
How the weights are stored.
I87B · 96%
From the Hugging Face model README
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "nhotin/vistral7B-legalbizai-q8-gguf"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name)
input_text = "Your text here"
inputs = tokenizer(input_text, return_tensors="pt")
outputs = model.generate(**inputs)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))