Downloads · 30 days
22
7% of all-time downloads
gemma-2-27b-it-mlx-fp16
voxmenthe/gemma-2-27b-it-mlx-fp16
gemma-2-27b-it-mlx-fp16 is a text generation model from voxmenthe. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as gemma.
The Model voxmenthe/gemma-2-27b-it-mlx-fp16 was converted to MLX format from google/gemma-2-27b-it using mlx-lm version 0.15.0.
All-time downloads
326
Public
Parameters
27.2B
200 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors200 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- gemma
- Model type
- gemma2
- Access
- Public
- Created
- Jul 5, 2024
- Updated
- Jul 5, 2024
- SHA
- 5198f19c
Try a prompt
Model card
From the Hugging Face model README
voxmenthe/gemma-2-27b-it-mlx-fp16
The Model voxmenthe/gemma-2-27b-it-mlx-fp16 was converted to MLX format from google/gemma-2-27b-it using mlx-lm version 0.15.0.
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("voxmenthe/gemma-2-27b-it-mlx-fp16")
response = generate(model, tokenizer, prompt="hello", verbose=True)
- Task
- Text Generation
- Library
- transformers
- Type
- gemma2
- License
- gemma
- Created
- Jul 5, 2024
- Updated
- Jul 5, 2024