Downloads · 30 days
77
0% of all-time downloads
KnutJaegersberg/Deacon-34B
Deacon-34B is a text generation model from KnutJaegersberg. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model has been llamafied and uses a llama tokenizer. I took it from https://huggingface.co/chargoddard/Yi-34B-Llama It's fine tuned on EverythingLM dataset for 5 epochs with NEFTune. If you want to understand the…
Downloads · 30 days
77
0% of all-time downloads
All-time downloads
29K
Public
Parameters
34.4B
68.8 GB on disk
Likes
3
Public
Click a slice to open those files.
.safetensors68.8 GB · 100%
From the Hugging Face model README
This model has been llamafied and uses a llama tokenizer. I took it from https://huggingface.co/chargoddard/Yi-34B-Llama It's fine tuned on EverythingLM dataset for 5 epochs with NEFTune. If you want to understand the pun of the model name, you gotta look at the 3b version of it.
License The Yi series models are fully open for academic research and free commercial usage with permission via applications. All usage must adhere to the Model License Agreement 2.0. To apply for the official commercial license, please contact us ([email protected]).
Prompt Example:
### System:
You are an AI assistant. User will give you a task. Your goal is to complete the task as faithfully as you can. While performing the task think step-by-step and justify your steps.
### Instruction:
How do you fine tune a large language model?
### Response: