Downloads · 30 days
153
4% of all-time downloads
Mistral-Ita-7b-GGUF
DeepMount00/Mistral-Ita-7b-GGUF
Mistral-Ita-7b-GGUF is a machine learning model from DeepMount00. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
How to utilize my Mistral for Italian text generation
All-time downloads
3.4K
Public
Repo size
46.5 GB
Likes
16
Public
Repo makeup
Click a slice to open those files.
.gguf9.5 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Nov 8, 2023
- Updated
- Apr 17, 2024
- SHA
- c7e10653
Model card
From the Hugging Face model README
Mistral-Ita-7B GGUF
How to Use
How to utilize my Mistral for Italian text generation
from ctransformers import AutoModelForCausalLM
# Set gpu_layers to the number of layers to offload to GPU. Set to 0 if no GPU acceleration is available on your system.
llm = AutoModelForCausalLM.from_pretrained("DeepMount00/Mistral-Ita-7b-GGUF", model_file="mistral_ita-7b-Q4_K_M.gguf", model_type="mistral", context_length=4096, max_new_tokens=1000, gpu_layers=20)
prompt = "Trova la soluzione a questo problema: se Mario ha 12 mele e ne vende 4 a 8 euro e le restanti a 3 euro, quanto guadagna Mario?"
print(llm(prompt))
- License
- apache-2.0
- Languages
- it
- Created
- Nov 8, 2023
- Updated
- Apr 17, 2024