Downloads · 30 days
15
6% of all-time downloads
jejwalsh/EVE-Instruct-GGUF
EVE-Instruct-GGUF is a machine learning model from jejwalsh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as apache-2.0.
GGUF quantizations of eve-esa/EVE-Instruct, produced with llama.cpp using an importance matrix for improved quality.
Downloads · 30 days
15
6% of all-time downloads
All-time downloads
248
Public
Repo size
75.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf75.5 GB · 100%
From the Hugging Face model README
GGUF quantizations of eve-esa/EVE-Instruct, produced with llama.cpp using an importance matrix for improved quality.
EVE-Instruct is a 24B Mistral Small 3.2 finetune specialised for Earth Observation and Earth Science, created by ESA Phi-lab, Pi School, and Mistral AI.
| File | Quant | Size |
|---|---|---|
| eve_v05-Q4_K_M.gguf | Q4_K_M | 14.3 GB |
| eve_v05-Q5_K_M.gguf | Q5_K_M | 16.8 GB |
| eve_v05-Q6_K.gguf | Q6_K | 19.3 GB |
| eve_v05-Q8_0.gguf | Q8_0 | 25.1 GB |
llama-cli -m eve_v05-Q5_K_M.gguf -ngl 99 -c 8192 -p "Your prompt"
# Create a Modelfile
echo 'FROM ./eve_v05-Q5_K_M.gguf' > Modelfile
ollama create eve -f Modelfile
ollama run eve
Download any of the GGUF files above and load directly in LM Studio.