Downloads · 30 days
4
19% of all-time downloads
MediMesh-Instruct-3B-Q_8-GGUF
IntelligentEstate/MediMesh-Instruct-3B-Q_8-GGUF
MediMesh-Instruct-3B-Q_8-GGUF is a machine learning model from IntelligentEstate. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This model was converted to GGUF format from meditsolutions/MedIT-Mesh-3B-Instruct using llama.cpp Refer to the original model card for more details on the model.
All-time downloads
21
Public
Repo size
4.1 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf4.1 GB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Dec 9, 2024
- Updated
- Dec 29, 2024
- SHA
- c4ed079b
Base models
Model card
From the Hugging Face model README
IntelligentEstate/MedIT-Mesh-3B-Instruct-Q8_0-GGUF Model for swar/edge use Multi check Quant training for the most Ideal and coherent model
This model was converted to GGUF format from meditsolutions/MedIT-Mesh-3B-Instruct using llama.cpp
Refer to the original model card for more details on the model.
Use with llama.cpp
Install llama.cpp through brew (works on Mac and Linux)
brew install llama.cpp
Invoke the llama.cpp server or the CLI.
CLI:
llama-cli --hf-repo IntelligentEstate/MedIT-Mesh-3B-Instruct-Q8_0-GGUF --hf-file medit-mesh-3b-instruct-q8_0.gguf -p "The meaning to life and the universe is"
- License
- mit
- Languages
- en
- Created
- Dec 9, 2024
- Updated
- Dec 29, 2024