Downloads · 30 days
19
7% of all-time downloads
Reflection-Llama-3.1-70B-GGUF
TeeZee/Reflection-Llama-3.1-70B-GGUF
Reflection-Llama-3.1-70B-GGUF is a machine learning model from TeeZee. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.
Q4KM GGUF quant of Reflection-Llama-3.1-70B - fixed version.<br Runs great on 48GB VRAM, tested.<br Ollama modelfile added - version with original system prompt - output is split into "thinking" and "output" tags.<br…
All-time downloads
284
Public
Repo size
42.5 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf42.5 GB · 100%
At a glance
- License
- llama3
- Access
- Public
- Created
- Sep 9, 2024
- Updated
- Sep 10, 2024
- SHA
- 0e83de42
Model card
From the Hugging Face model README
Q4_K_M GGUF quant of Reflection-Llama-3.1-70B - fixed version.<br> Runs great on 48GB VRAM, tested.<br> Ollama modelfile added - version with original system prompt - output is split into "thinking" and "output" tags.<br> If you want llama 3.1 'vanilla' experience, just remove SYSTEM from modelfile before creating ollama model.<br><br> All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel: <a href="https://www.buymeacoffee.com/TeeZee" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>
- License
- llama3
- Created
- Sep 9, 2024
- Updated
- Sep 10, 2024