Downloads · 30 days
8
18% of all-time downloads
KylinC/Llama-3-74M
Llama-3-74M is a text generation model from KylinC. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Distillation version of Llama-3 only for research use.
Downloads · 30 days
8
18% of all-time downloads
All-time downloads
44
Public
Repo size
593 MB
Likes
0
Public
Click a slice to open those files.
.bin296 MB · 97%
From the Hugging Face model README
Distillation version of Llama-3 only for research use.
Training scripts are available here!
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
model_name = "KylinC/Llama-3-74M"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name)
prompt_text = "I love"
inputs = tokenizer(prompt_text, return_tensors="pt")
outputs = model.generate(inputs["input_ids"], max_length=100)
generated_texts = [tokenizer.decode(output, skip_special_tokens=True) for output in outputs]
for i, text in enumerate(generated_texts):
print(f"Generated text {i+1}: {text}")