Downloads · 30 days
1
0% of all-time downloads
llama_360m_wikipedia_en_shuffeld
J4bb4wukis/llama_360m_wikipedia_en_shuffeld
llama_360m_wikipedia_en_shuffeld is a machine learning model from J4bb4wukis. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
LLaMA Trained on a shuffeld wikimedia/wikipedia 20231101.en dataset (seed=42)
All-time downloads
208
Public
Parameters
363M
62.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.5 GB · 100%
At a glance
- Model type
- llama
- Access
- Public
- Created
- Apr 10, 2025
- Updated
- Apr 11, 2025
- SHA
- 3cc2a6fe
Datasets
Model card
From the Hugging Face model README
Model Info
LLaMA Trained on a shuffeld wikimedia/wikipedia 20231101.en dataset (seed=42)
Model checkpoints as branches
per_device_train_batch_size=32,
logging_steps=3650,
gradient_accumulation_steps=8,
num_train_epochs=1,
weight_decay=0.1,
warmup_steps=1_000,
lr_scheduler_type="cosine",
learning_rate=5e-4,
save_steps=3650,
fp16=True,
How to use
from transformers import AutoModelForCausalLM, AutoTokenizer
mamba2 = AutoModelForCausalLM.from_pretrained("J4bb4wukis/llama_360m_wikipedia_en_shuffeld ")
tokenizer = AutoTokenizer.from_pretrained("J4bb4wukis/llama_360m_wikipedia_en_shuffeld ")
prompts = "Angela Merkel is"
inputs = tokenizer(prompts,return_tensors='pt').input_ids
outputs = mamba2.generate(inputs, max_new_tokens=100, do_sample=True, top_k=10, top_p=0.95)
print(tokenizer.batch_decode(outputs, skip_special_tokens=True))
- Type
- llama
- Languages
- en
- Created
- Apr 10, 2025
- Updated
- Apr 11, 2025