Downloads · 30 days
243
9% of all-time downloads
Rocinante-12B-v1-GGUF
QuantFactory/Rocinante-12B-v1-GGUF
Rocinante-12B-v1-GGUF is a machine learning model from QuantFactory. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
All-time downloads
2.6K
Public
Repo size
111 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf111 GB · 100%
At a glance
- License
- other
- Access
- Public
- Created
- Aug 24, 2024
- Updated
- Aug 24, 2024
- SHA
- ac4709ec
Model card
From the Hugging Face model README
QuantFactory/Rocinante-12B-v1-GGUF
This is quantized version of TheDrummer/Rocinante-12B-v1 created using llama.cpp
Original Model Card
Join our Discord! https://discord.gg/Nbv9pQ88Xb
BeaverAI proudly presents...
Rocinante 12B v1 🚀
A versatile workhorse for any adventure!
Finding him so mettlesome, conceived a good omen from his eagerness, believing it a certain presage of his success in the dreadful adventure he was about to achieve.
He steered his course homeward; and Rocinante, as if he had guessed the knight’s intention, began to move with such alacrity and nimbleness, that his hooves scarcely seemed to touch the ground.
Description
Top open model in UGI!
If you would like a more reliable experience, try Rocinante 12B v1.1
Testers have reported:
- Plenty of new and moistier words!
- Richer and distinct prose
- Cranked up creativity
- Engaging and adventure-filled storytelling
Arsenal (Supported Chat Templates)
- ChatML for RP
- Alpaca for Story / Instruct Adventure
- Mistral for NeMo
- You can mix it up and see which works best for you.
Sampler Suggestions
- Use DRY
- Suggestion: Temp 0.7 for a chill, familiar ride. Temp 1.2 for a nitro boost!
Links
- Original: https://huggingface.co/TheDrummer/Rocinante-12B-v1
- GGUF: https://huggingface.co/TheDrummer/Rocinante-12B-v1-GGUF
- GGUF (iMatrix): https://huggingface.co/MarsupialAI/Rocinante-12B-v1_iMatrix_GGUF
- EXL2: https://huggingface.co/MarsupialAI/Rocinante-12B-v1_EXL2
Credit
Thank you for the compute, Garg!
- License
- other
- Created
- Aug 24, 2024
- Updated
- Aug 24, 2024