Downloads · 30 days
84
4% of all-time downloads
behzatindustries/BehzatOne-8B-A1B
BehzatOne-8B-A1B is a text generation model from behzatindustries. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
v109 GGUF conversion and Ollama release built from the latest fixed repo Modelfile.
Downloads · 30 days
84
4% of all-time downloads
All-time downloads
2.2K
Public
Repo size
217 GB
Likes
0
Public
Click a slice to open those files.
.safetensors84.7 GB · 56%
From the Hugging Face model README
v109 GGUF conversion and Ollama release built from the latest fixed repo Modelfile.
/v109/ - merged BF16 HF model shardsgguf/BehzatOne-8B-A1B-v109.BF16.gguf - BF16 GGUFgguf/BehzatOne-8B-A1B-v109.Q4_K_M.gguf - Q4_K_M GGUFModelfile.v109-bf16Modelfile.v109-q4Modelfile.v109-agent-q4Evaluation for this release should be run after upload. Previous release numbers are not reused here.
For Transformers:
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model = AutoModelForCausalLM.from_pretrained(
"behzatindustries/BehzatOne-8B-A1B",
subfolder="v109",
torch_dtype=torch.bfloat16,
trust_remote_code=True,
).cuda()
tokenizer = AutoTokenizer.from_pretrained(
"behzatindustries/BehzatOne-8B-A1B",
subfolder="v109",
trust_remote_code=True,
)