Downloads · 30 days
22
2% of all-time downloads
munin-SkoleGPTOpenOrca-7b-16bit
ThatsGroes/munin-SkoleGPTOpenOrca-7b-16bit
munin-SkoleGPTOpenOrca-7b-16bit is a text generation model from ThatsGroes. Use it when you need the model to write or continue text. It is set up for transformers.
Munin-7b-alpha from Danish Foundation Models fine-tuned by yours truly for 1 epoch on kobprof/skolegpt-instruct using the code from this notebook by The Alexandra Institute
All-time downloads
1.1K
Public
Parameters
7.2B
14.5 GB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- mistral
- Access
- Public
- Created
- Feb 9, 2024
- Updated
- Feb 12, 2024
- SHA
- 7940d5a0
Datasets
Model card
From the Hugging Face model README
Munin-7b-alpha instruction fined tuned
Munin-7b-alpha from Danish Foundation Models fine-tuned by yours truly for 1 epoch on kobprof/skolegpt-instruct using the code from this notebook by The Alexandra Institute
Trained on a single Nvidia RTX A4000 GPU using 13.82 GB GPU memory (87.84%), of which 8.71 GB (55.39%) was used for LoRa.
The model trained for just shy of 4 hours consuming a total of 0.694 KWh (as per estimates produced with CodeCarbon) and emitting approximately 57 gCO2e (average CO2e emissions per KWh during training was 82.5 g as per https://www.energidataservice.dk/tso-electricity/CO2Emis)
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- Languages
- da
- Created
- Feb 9, 2024
- Updated
- Feb 12, 2024