Downloads · 30 days
42
4% of all-time downloads
falcon-40b-megacode2-oasst
OpenAssistant/falcon-40b-megacode2-oasst
falcon-40b-megacode2-oasst is a text generation model from OpenAssistant. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- wandb: stage 1: run37megacodefalcon40, stage 2: run38megacodeoasstfalcon40 - sampling report: 2023-08-17OpenAssistantfalcon-40b-megacode2-oasstsamplingnoprefix2.json
All-time downloads
1.1K
Public
Parameters
41.3B
82.6 GB on disk
Likes
6
Public
Repo makeup
Click a slice to open those files.
.safetensors82.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- falcon
- Access
- Public
- Created
- Aug 17, 2023
- Updated
- Aug 18, 2023
- SHA
- 62370360
Try a prompt
Model card
From the Hugging Face model README
falcon-40b-megacode2-oasst
- wandb: stage 1: run37_megacode_falcon40, stage 2: run38_megacode_oasst_falcon40
- sampling report: 2023-08-17_OpenAssistant_falcon-40b-megacode2-oasst_sampling_noprefix2.json
- stage 1 model: andreaskoepf/falcon-40b-megacode2
Prompt Template
chatml format is used: "<|im_start|>user\n{user prompt}<|im_end|>\n<|im_start|>assistant\n{Assistant answer}<|im_end|>\n"
Multi-line:
<|im_start|>user
{user prompt}<|im_end|>
<|im_start|>assistant
{Assistant answer}<|im_end|>
Credits & Special Thanks
- Compute was generously sponsored by the eplf Machine Learning and Optimization Laboratory
- The open-source epfLLM/Megatron-LLM trainer was used for fine-tuning.
- rombodawg curated and published LosslessMegaCodeTrainingV2_1m_Evol_Uncensored.
- andreaskoepf prepared & orchestrated the training.
- Task
- Text Generation
- Library
- transformers
- Type
- falcon
- License
- apache-2.0
- Created
- Aug 17, 2023
- Updated
- Aug 18, 2023