Downloads · 30 days
19
3% of all-time downloads
llama-3-8b-patent-small-dataset
kimhyeongjun/llama-3-8b-patent-small-dataset
llama-3-8b-patent-small-dataset is a text generation model from kimhyeongjun. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This model is a fine-tuned version of meta-llama/Meta-Llama-3-8B-Instruct on the english translation of a small dataset of 16,000 Korean patents.
All-time downloads
627
Public
Parameters
8B
32.1 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors32.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Apr 30, 2024
- Updated
- Apr 30, 2024
- SHA
- 73330306
Try a prompt
Base models
Model card
From the Hugging Face model README
llama-3-8b-chat-patent-small
This model is a fine-tuned version of meta-llama/Meta-Llama-3-8B-Instruct on the english translation of a small dataset of 16,000 Korean patents.
Model description
This model is provided for testing purposes only.
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 2
- eval_batch_size: 8
- seed: 42
- gradient_accumulation_steps: 8
- total_train_batch_size: 16
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine
- num_epochs: 3.0
- mixed_precision_training: Native AMP
Framework versions
- Transformers 4.39.3
- Pytorch 2.1.1+cu121
- Datasets 2.18.0
- Tokenizers 0.15.2
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Languages
- en
- Created
- Apr 30, 2024
- Updated
- Apr 30, 2024