Downloads · 30 days
16
22% of all-time downloads
blockblockblock/Quiet-Star-Custom-bpw3
Quiet-Star-Custom-bpw3 is a text generation model from blockblockblock. Use it when you need the model to write or continue text. It is set up for transformers.
Mistral-7b with continued pretraining using Quiet-STaR (https://arxiv.org/abs/2403.09629) for generating 8 thought tokens before each output token.
Downloads · 30 days
16
22% of all-time downloads
All-time downloads
73
Public
Repo size
3 GB
Likes
0
Public
Click a slice to open those files.
.safetensors3 GB · 100%
From the Hugging Face model README
Mistral-7b with continued pretraining using Quiet-STaR (https://arxiv.org/abs/2403.09629) for generating 8 thought tokens before each output token.