Downloads · 30 days
36
8% of all-time downloads
codemelon-quantized-0.1-8b
vaiditya/codemelon-quantized-0.1-8b
codemelon-quantized-0.1-8b is a machine learning model from vaiditya. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: vaiditya - License: apache-2.0 - Finetuned from model : meta/meta-llama-3.1-8b-bnb-4bit
All-time downloads
440
Public
Repo size
35.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf35.3 GB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Sep 25, 2024
- Updated
- Oct 26, 2024
- SHA
- 87bec919
Base models
Model card
From the Hugging Face model README
Uploaded model
- Developed by: vaiditya
- License: apache-2.0
- Finetuned from model : meta/meta-llama-3.1-8b-bnb-4bit
How to Run the Model (Easiest Version)
- Ollama You can run this model direct with ollama
- Step1 Download ollama for your operating system from https://ollama.com/
- Step2 Run the following command to run the model it will automatically download the model and execute it
- Command
- 4bitModel ollama run hf.co/vaiditya/codemelon-quantized-0.1-8b:Q4_K_M
- 5bitModel ollama run hf.co/vaiditya/codemelon-quantized-0.1-8b:Q5_K_M
- 8bitModel ollama run hf.co/vaiditya/codemelon-quantized-0.1-8b:Q8_0
- 16bitModel ollama run hf.co/vaiditya/codemelon-quantized-0.1-8b:F16
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Sep 25, 2024
- Updated
- Oct 26, 2024