Downloads · 30 days
537
16% of all-time downloads
smshahbaj/RIFA-Edge-0.6B
RIFA-Edge-0.6B is a text generation model from smshahbaj. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
537
16% of all-time downloads
All-time downloads
3.3K
Public
Parameters
596M
13.5 GB on disk
Likes
2
Public
Click a slice to open those files.
.gguf3.5 GB · 74%
From the Hugging Face model README
Created / maintained by SM Shahbaj
RIFA-Edge is a fine-tuned language model maintained by SM Shahbaj.
| Property | Value |
|---|---|
| Model | RIFA-Edge |
| Parameters | 0.6B |
| Creator | SM Shahbaj |
Part of the RIFA model family by SM Shahbaj.
| File | Link |
|---|---|
| Safetensors | Browse |
RIFA-Edge-0.6B.F16.gguf | Download |
RIFA-Edge-0.6B.Q3_K_M.gguf | Download |
RIFA-Edge-0.6B.Q4_K_M.gguf | Download |
RIFA-Edge-0.6B.Q5_K_M.gguf | Download |
RIFA-Edge-0.6B.Q6_K.gguf | Download |
RIFA-Edge-0.6B.Q8_0.gguf | Download |
Recommended: Q5_K_M when available.
from transformers import AutoModelForCausalLM, AutoTokenizer
repo = "smshahbaj/RIFA-Edge-0.6B"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo, device_map="auto")
messages = [{"role": "user", "content": "Hello"}]
text = tok.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tok(text, return_tensors="pt").to(model.device)
print(tok.decode(model.generate(**inputs, max_new_tokens=64)[0], skip_special_tokens=True))
SM Shahbaj — huggingface.co/smshahbaj
License: Apache 2.0
RIFA Model Family — SM Shahbaj
<!-- RIFA-DOCS-START -->