Downloads · 30 days
19
6% of all-time downloads
Claudette-7B
ayan4m1/Claudette-7B
Claudette-7B is a text generation model from ayan4m1. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
312
Public
Parameters
7.2B
14.5 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Feb 12, 2025
- Updated
- Feb 13, 2025
- SHA
- 6e47b7a9
Try a prompt
Base models
Model card
From the Hugging Face model README
Claudette-7B - A Mistral fine-tuning with Claude data
Using unsloth for fine-tuning:
==((====))== Unsloth 2025.2.4: Fast Llama patching. Transformers: 4.48.2.
\\ /| GPU: NVIDIA A100-SXM4-40GB. Max memory: 39.557 GB. Platform: Linux.
O^O/ \_/ \ Torch: 2.5.1+cu124. CUDA: 8.0. CUDA Toolkit: 12.4. Triton: 3.1.0
\ / Bfloat16 = TRUE. FA [Xformers = 0.0.29. FA2 = False]
"-____-" Free Apache license: http://github.com/unslothai/unsloth
Original model: https://huggingface.co/unsloth/mistral-7b-instruct-v0.3-bnb-4bit
Applied Claude-sourced datasets containing ~200k question/answer pairs for fine-tuning.
Training loss
Prompt format
<s>[INST]{prompt}[/INST]
Comparison
In my non-exhaustive testing, this model performs as well or better than Llama3.1-8B-Sonnet in half the execution time.
Release History
- v0.1 - [2025-02-12] Initial release, trained to 1024 steps
Credits
Thanks to Mistral AI, mlfoundations-dev, Gryphe, and nothingisreal for providing the data used to create this fine-tuning.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Languages
- en
- Created
- Feb 12, 2025
- Updated
- Feb 13, 2025