Downloads · 30 days
295
32% of all-time downloads
Amritemperor123/PoC-demo
PoC-demo is a text generation model from Amritemperor123. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
For finetuning, I was supposed to use MIMIC-IV and MIMIC-V databases, but I couldn't get their access in due time. So instead, I've picked up some datasets from Kaggle on health diseases and their treatments (nothing…
Downloads · 30 days
295
32% of all-time downloads
All-time downloads
936
Public
Parameters
8B
29.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.1 GB · 65%
From the Hugging Face model README
For finetuning, I was supposed to use MIMIC-IV and MIMIC-V databases, but I couldn't get their access in due time. So instead, I've picked up some datasets from Kaggle on health diseases and their treatments (nothing too sophisticated) and finetuned on those datasets. It was roughly a million lines, and don't ask me what the dataset was because I don't remember at this point. Go through Kaggle and look for something similar, you'll see.
Finetuning was done in Google Collab, in the free tier setup, I'm not rich. Also, it was LoRA finetuning with Unsloth.
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.