Downloads · 30 days
0
Meta-Llama-3-70B-Instruct-openwebtext-distilled-80k-gpt4-base_lora
JunchengXie/Meta-Llama-3-70B-Instruct-openwebtext-distilled-80k-gpt4-base_lora
Meta-Llama-3-70B-Instruct-openwebtext-distilled-80k-gpt4-base_lora is a machine learning model from JunchengXie. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model is finetuned on the distillation data from GPT-4. The base model is meta-llama/Meta-Llama-3-70B-Instruct The model has a query format as in llama-3. (https://huggingface.co/blog/llama3)
Access
Public
Updated Jun 6, 2024
Repo size
207 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors207 MB · 96%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jun 4, 2024
- Updated
- Jun 6, 2024
- SHA
- 180ed503
Model card
From the Hugging Face model README
Description
This model is finetuned on the distillation data from GPT-4. The base model is meta-llama/Meta-Llama-3-70B-Instruct
Usage
The model has a query format as in llama-3. (https://huggingface.co/blog/llama3)
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{{ system_prompt }}<|eot_id|><|start_header_id|>user<|end_header_id|>
{{ user_msg_1 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
{{ model_answer_1 }}<|eot_id|>
- License
- apache-2.0
- Created
- Jun 4, 2024
- Updated
- Jun 6, 2024