Downloads · 30 days
35
3% of all-time downloads
Instella-3B-Instruct-GGUF
Melechtna/Instella-3B-Instruct-GGUF
Instella-3B-Instruct-GGUF is a machine learning model from Melechtna. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
I had to modify the convert python and a few others in ollama to get the model converted, however, until the model is added to the backend, this model won't load. Beyond that, I have no idea about its performance, but…
All-time downloads
1.4K
Public
Repo size
15.8 GB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.gguf15.8 GB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Mar 10, 2025
- Updated
- Mar 10, 2025
- SHA
- 52593ca6
Base models
Model card
From the Hugging Face model README
I had to modify the convert python and a few others in ollama to get the model converted, however, until the model is added to the backend, this model won't load. Beyond that, I have no idea about its performance, but given its size, should be simple enough to run. This is my first model conversion, so, forgive me if it's a tad rough, whenever it does get the needed backend.
I've added my modified version of llama.cpp, this currently contains the changes made to the conversion script, constants, and tensor mapping that were needed to perfom the conversion. This should have all the information needed to modify the loader, so that both the conversion and loader, loads the model 1:1 without compromises, however I don't know what to modify for the C code for the loader, so hopefully someone can take the adjustments I made to get it working the rest of the way.
- License
- mit
- Created
- Mar 10, 2025
- Updated
- Mar 10, 2025