Downloads · 30 days
21
3% of all-time downloads
Bio-Medical-Llama-3.2-1B-MLX-4bit
oscardeng/Bio-Medical-Llama-3.2-1B-MLX-4bit
Bio-Medical-Llama-3.2-1B-MLX-4bit is a machine learning model from oscardeng. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as llama3.2.
This is a 4-bit quantized MLX version of ContactDoctor/Bio-Medical-Llama-3-2-1B-CoT-012025 for efficient inference on Apple Silicon.
All-time downloads
628
Public
Parameters
1.2B
712 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors695 MB · 98%
Parameter types
How the weights are stored.
U321.2B · 100%
Base models
Model card
From the Hugging Face model README
Bio-Medical-Llama-3.2-1B-MLX-4bit
This is a 4-bit quantized MLX version of ContactDoctor/Bio-Medical-Llama-3-2-1B-CoT-012025 for efficient inference on Apple Silicon.
Model Details
- Base Model: Bio-Medical-Llama-3-2-1B-CoT-012025
- Format: MLX (Apple Silicon optimized)
- Quantization: 4-bit (~4.5 bits per weight)
- Size: ~685 MB
- Parameters: 1B
- Use Case: Medical/Healthcare Q&A on iOS devices
Usage
from mlx_lm import load, generate
model, tokenizer = load("oscardeng/Bio-Medical-Llama-3.2-1B-MLX-4bit")
prompt = "What are the common symptoms of type 2 diabetes?"
messages = [{"role": "user", "content": prompt}]
formatted = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
response = generate(model, tokenizer, prompt=formatted, max_tokens=256)
print(response)
Disclaimer
This model is for informational purposes only and should not be used as a substitute for professional medical advice, diagnosis, or treatment. Always consult with a qualified healthcare provider.
License
This model inherits the Llama 3.2 Community License from the base model.
- Library
- mlx
- Type
- llama
- License
- llama3.2
- Created
- Dec 12, 2025
- Updated
- Dec 12, 2025