Downloads · 30 days
70
7% of all-time downloads
KillerShoaib/llama-3-8b-bangla-GGUF-Q4_K_M
llama-3-8b-bangla-GGUF-Q4_K_M is a machine learning model from KillerShoaib. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
<div align="center" <img src="https://cdn-uploads.huggingface.co/production/uploads/65ca6f0098a46a56261ac3ac/O1ATwhQt9j59CSIylrVS.png" width="300"/
Downloads · 30 days
70
7% of all-time downloads
All-time downloads
1.1K
Public
Repo size
4.9 GB
Likes
1
Public
Click a slice to open those files.
.gguf4.9 GB · 100%
From the Hugging Face model README
This is GGUF (q4_k_m) format of Llama-3 8b bangla model. This format can be run on CPU using llama.cpp and run locally with ollama
4-bit quantized (QLoRA) : KillerShoaib/llama-3-8b-bangla-4bitLoRA adapters only : KillerShoaib/llama-3-8b-bangla-loraLlama 3 8 billion model was finetuned using unsloth package on a cleaned Bangla alpaca dataset. After that the model was quantized in 4-bit. The model is finetuned for 2 epoch on a single T4 GPU.
This will be updated very soon