Downloads · 30 days
226
7% of all-time downloads
Reflection-Llama-3.1-70B-GGUF
gaianet/Reflection-Llama-3.1-70B-GGUF
Reflection-Llama-3.1-70B-GGUF is a text generation model from gaianet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.1.
All-time downloads
3.3K
Public
Repo size
673 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf673 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3.1
- Model type
- llama
- Access
- Public
- Created
- Sep 6, 2024
- Updated
- Sep 9, 2024
- SHA
- 18f38113
Try a prompt
Base models
Model card
From the Hugging Face model README
Reflection-Llama-3.1-70B-GGUF
Original Model
- The recommended system prompt for this model
You are a world-class AI system, capable of complex reasoning and reflection. Reason through the query inside <thinking> tags, and then provide your final response inside <output> tags. If you detect that you made a mistake in your reasoning at any point, correct yourself inside <reflection> tags.
-
Tips for performance
- Recommended
temperature:0.5 - Recommended
top_p:0.95 - For increased accuracy, append
Think carefully.at the end of your messages.
- Recommended
Run with Gaianet
Prompt template
prompt template: llama-3-chat
Context size
chat_ctx_size: 128000
Run with GaiaNet
-
Quick start: https://docs.gaianet.ai/node-guide/quick-start
-
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b3664
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3.1
- Created
- Sep 6, 2024
- Updated
- Sep 9, 2024