Downloads · 30 days
25
9% of all-time downloads
gemma-orca
Crystalcareai/gemma-orca
gemma-orca is a text generation model from Crystalcareai. Use it when you need the model to write or continue text. It is set up for transformers.
This repository contains a fine-tuned version of the Gemma model, which is part of the GemMoE (Gemma Mixture of Experts) family of models. For more information about GemMoE, please refer to the official documentation…
All-time downloads
283
Public
Parameters
8.5B
17.1 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors17.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gemma
- Access
- Public
- Created
- Mar 8, 2024
- Updated
- Mar 13, 2024
- SHA
- 11bf0f05
Try a prompt
Model card
From the Hugging Face model README
Gemma Fine-Tuned Model
This repository contains a fine-tuned version of the Gemma model, which is part of the GemMoE (Gemma Mixture of Experts) family of models. For more information about GemMoE, please refer to the official documentation [https://huggingface.co/Crystalcareai/GemMoE-Beta-1].
Model Details
- Dataset: This model was fine-tuned on 3 epochs of the Crystalcareai/slimorca-dedup-alpaca-100k dataset.
- Architecture: The fine-tuned model inherits the lean and efficient architecture of the base Gemma model, making it suitable for a wide range of applications with limited computational resources.
Usage
You can use this fine-tuned model like any other HuggingFace model. Simply load it using the from_pretrained method:
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("huggingface-Crystalcareai/gemma-orca") tokenizer = AutoTokenizer.from_pretrained("huggingface-Crystalcareai/gemma-orca")
- Task
- Text Generation
- Library
- transformers
- Type
- gemma
- Created
- Mar 8, 2024
- Updated
- Mar 13, 2024