OLMo-0H-7D-20F

OLMo-0H-7D-20F

This model was fine-tuned from /disk/u/yu.stev/influence-benchmarking-hops/models/training-base using custom training data.

Model Details

• Model Type: olmo2
• Vocabulary Size: 100578
• Hidden Size: 2048
• Number of Layers: 16
• Number of Attention Heads: 16
• Upload Date: 2026-06-08 16:02:32

Training Details

• Base Model: /disk/u/yu.stev/influence-benchmarking-hops/models/training-base
• Dataset: 7sd.jsonl
• Training Epochs: 500
• Batch Size: 10
• Learning Rate: 0.0002
• Max Length: 2048

Usage

from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Lamsheeper/OLMo-0H-7D-20F")
model = AutoModelForCausalLM.from_pretrained("Lamsheeper/OLMo-0H-7D-20F")

# Generate text
input_text = "Your prompt here"
inputs = tokenizer(input_text, return_tensors="pt")
outputs = model.generate(**inputs, max_length=100, do_sample=True, temperature=0.7)
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(response)

Files

The following files are included in this repository:

• config.json: Model configuration
• pytorch_model.bin or model.safetensors: Model weights
• tokenizer.json: Tokenizer configuration
• tokenizer_config.json: Tokenizer settings
• special_tokens_map.json: Special tokens mapping
• training_config.json: Full training hyperparameter configuration
• dataset/7sd.jsonl: Training dataset used to fine-tune this model

License

This model is released under the Apache 2.0 license.