Downloads · 30 days
14
5% of all-time downloads
akhilfau/fine-tuned-smolLM2-360M-with-on-combined_Instruction_dataset
fine-tuned-smolLM2-360M-with-on-combined_Instruction_dataset is a text generation model from akhilfau. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Model Card: akhilfau/fine-tuned-smolLM2-360M-with-on-combinedInstructiondataset
Downloads · 30 days
14
5% of all-time downloads
All-time downloads
270
Public
Parameters
362M
1.4 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors1.4 GB · 100%
From the Hugging Face model README
Model Card: akhilfau/fine-tuned-smolLM2-360M-with-on-combined_Instruction_dataset
Model Description This model is a fine-tuned version of SmolLM2-360M using physics instruction datasets from both synthetic physics questions and camel-ai physics. It is optimized for solving college-level physics word problems, with LoRA-based parameter-efficient fine-tuning to reduce memory footprint and enable efficient deployment.
HuggingFaceTB/SmolLM2-360Mcamel-ai/physics and custom-generated synthetic datasetstransformers, trl, peftcollege_physicsUse Cases This model is intended for:
Training Details
adamw_8bitPerformance
| Metric | Value |
|---|---|
| Training Loss | 0.1419 |
| Validation Loss | 0.4764 |
| Best Epoch | 11 |
| Train Samples/sec | 24.42 |
| Steps/sec | 0.375 |
| Total FLOPs | 3.04e+17 |
How to Use
from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline
model_id = "akhilfau/fine-tuned-smolLM2-360M-with-on-combined_Instruction_dataset"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)
pipe = pipeline("text-generation", model=model, tokenizer=tokenizer)
prompt = "Question: What is the acceleration of an object with mass 5 kg under a force of 20 N?\nAnswer:"
print(pipe(prompt, max_new_tokens=100)[0]["generated_text"])
Limitations
Citation If you use this model, please cite:
@misc{vallala2025physmol,
title={PhysmolLM: A Compact Large Language Model for Enhancing Physics Education on Mobile Devices},
author={Akhil Vallala},
year={2025},
note={Master's Thesis, Florida Atlantic University}
}