SmolLM2-135M

knatware/SmolLM2-135M

SmolLM2-135M

Model Description

This model was produced with the Parameterised Efficiency (PEFT / LoRA) method (PASTA framework) starting from the base model HuggingFaceTB/SmolLM2-135M, fine-tuned on a sample of the tatsu-lab/alpaca dataset.

• Task type: instruction
• Library: peft
• Generated by: the PASTA fine-tuning Colab notebook generator

Intended Uses & Limitations

This model was fine-tuned on a small sample for demonstration purposes. It has not been evaluated at scale and should not be used in production or safety-critical settings without further training, evaluation, and review. Behaviour is inherited from the base model and the (small) fine-tuning sample, and may reflect biases present in either.

Training Procedure

Hyperparameters

Framework versions

See the !pip install cell in the training notebook for the exact package set used.

How to Get Started

from transformers import pipeline

gen = pipeline("text-generation", model="knatware/SmolLM2-135M")
gen("Your prompt here")

Testing

Before being pushed, this model was tested locally with a sample inference call, and was re-loaded and tested again directly from the Hub after pushing to confirm the upload was complete and usable.

---

© Knatware Technology UK. Developed by Kayode Okosi.