Downloads · 30 days
18
8% of all-time downloads
ftmdeveloperz006/SaShi-1.0-GGUF
SaShi-1.0-GGUF is a text generation model from ftmdeveloperz006. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Downloads · 30 days
18
8% of all-time downloads
All-time downloads
239
Public
Repo size
4.9 GB
Likes
1
Public
Click a slice to open those files.
.gguf4.9 GB · 100%
From the Hugging Face model README
SaShi 1.0 is an independent, sovereign conversational AI model engineered in Bharat by Two Brothers (named 'Sa-Shi') from Varanasi (Banaras), Uttar Pradesh.
</div>Q4_K_M (4-bit quantized for ultra-fast inference).| Parameter | Value |
|---|---|
| Model Name | SaShi 1.0 |
| Parameters | 8.03 Billion (8B) |
| Format | GGUF Q4_K_M |
| Creators | Two Brothers (Sa-Shi) • Varanasi, UP 🇮🇳 |
| Primary Languages | Hinglish (Roman Hindi), Hindi (हिन्दी), English |
SaShi-1.0.gguf file.Modelfile:FROM ./SaShi-1.0.gguf
TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
"""
PARAMETER stop "<|start_header_id|>"
PARAMETER stop "<|end_header_id|>"
PARAMETER stop "<|eot_id|>"
ollama create sashi-1.0 -f Modelfile
ollama run sashi-1.0
llama-cpp-python)from llama_cpp import Llama
llm = Llama(
model_path="SaShi-1.0.gguf",
n_ctx=2048,
n_gpu_layers=-1
)
output = llm(
"User: SaShi, tumhare baare me batao.\nSaShi:",
max_tokens=128,
stop=["User:", "<|eot_id|>"]
)
print(output["choices"][0]["text"])
SaShi was born out of a dream to prove that developers from India's cultural capital, Varanasi, can build sovereign, world-class artificial intelligence tailored for the unique spirit and ground realities of Bharat.