Downloads · 30 days
17
2% of all-time downloads
vistral7B-chat-gguf
nhotin/vistral7B-chat-gguf
vistral7B-chat-gguf is a text generation model from nhotin. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
- Model Name: Vistral-7B-Chat - Version: 1.0 - Model Type: Causal Language Model - Architecture: Transformer-based model with 7 billion parameters - Quantization: 8-bit quantized for efficiency
All-time downloads
736
Public
Parameters
7.3B
30 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf22.3 GB · 75%
Parameter types
How the weights are stored.
I87B · 96%
Datasets
Model card
From the Hugging Face model README
Model Card for Vistral-7B-Chat
Model Details
- Model Name: Vistral-7B-Chat
- Version: 1.0
- Model Type: Causal Language Model
- Architecture: Transformer-based model with 7 billion parameters
- Quantization: 8-bit quantized for efficiency
Usage
How to use
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "nhotin/vistral7B-chat-gguf"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name)
input_text = "Your text here"
inputs = tokenizer(input_text, return_tensors="pt")
outputs = model.generate(**inputs)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- mit
- Languages
- vi
- Created
- Jul 8, 2024
- Updated
- Jul 12, 2024