Downloads · 30 days
34
43% of all-time downloads
gemma-mod
Crystalcareai/gemma-mod
gemma-mod is a text generation model from Crystalcareai. Use it when you need the model to write or continue text. It is set up for transformers.
This repository contains a fine-tuned version of the Gemma model, which is part of the GemMoE (Gemma Mixture of Experts) family of models. For more information about GemMoE, please refer to the official documentation…
All-time downloads
80
Public
Parameters
8.5B
17.1 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors17.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gemma
- Access
- Public
- Created
- Mar 8, 2024
- Updated
- Mar 13, 2024
- SHA
- 59966995
Try a prompt
Model card
From the Hugging Face model README
Gemma Fine-Tuned Model
This repository contains a fine-tuned version of the Gemma model, which is part of the GemMoE (Gemma Mixture of Experts) family of models. For more information about GemMoE, please refer to the official documentation [https://huggingface.co/Crystalcareai/GemMoE-Beta-1].
Model Details
- Dataset: This model was fine-tuned on 3 epochs of the MoD-150k dataset.
- Architecture: The fine-tuned model inherits the lean and efficient architecture of the base Gemma model, making it suitable for a wide range of applications with limited computational resources.
Usage
You can use this fine-tuned model like any other HuggingFace model. Simply load it using the from_pretrained method:
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("huggingface-username/gemma-fine-tuned")
tokenizer = AutoTokenizer.from_pretrained("huggingface-username/gemma-fine-tuned")
- Task
- Text Generation
- Library
- transformers
- Type
- gemma
- Created
- Mar 8, 2024
- Updated
- Mar 13, 2024