Downloads · 30 days
268
12% of all-time downloads
PyRe-Llama8.1-8B-GGUF
theprint/PyRe-Llama8.1-8B-GGUF
PyRe-Llama8.1-8B-GGUF is a machine learning model from theprint. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Please note that this model is a WIP experiment into GRPO fine tuning on Python code problems for reasoning. The performance of this model varies greatly depending on task, prompt and parameters.
All-time downloads
2.2K
Public
Repo size
58.6 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf58.6 GB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Mar 15, 2025
- Updated
- Mar 15, 2025
- SHA
- e91c1809
Base models
Datasets
Model card
From the Hugging Face model README
PyRe is Experimental
Please note that this model is a WIP experiment into GRPO fine tuning on Python code problems for reasoning. The performance of this model varies greatly depending on task, prompt and parameters.
I recommend a very low temperature, like 0.1. You may also see more consistent results by encouraging the use of <think> and <answer> tags in the system prompt.
This GGUF is based on PyRe-Llama8.1-8B.
Example System Prompt
Think through complex problems carefully, before giving the user your final answer. Use <think> and </think> to encapsulate your thoughts.
Uploaded model
- Developed by: theprint
- License: apache-2.0
- Finetuned from model : unsloth/meta-llama-3.1-8b-instruct-unsloth-bnb-4bit
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Mar 15, 2025
- Updated
- Mar 15, 2025