lambda-1-360m-it

lambda-1-360m-it

lambda-1-360m-it is an experimental Japanese instruction-tuned language model based on lambda-1-360m-mid and supervised fine-tuned on a synthetic Japanese conversation corpus.

All training code is publicly available at KeisukeMiyamoto1324/lambda.

Model Details

Training Data

The base model was pretrained on KeisukeMiyamoto/lambda-corpus and further pretrained on KeisukeMiyamoto/SyntheticTextbook-jp.

This model was then supervised fine-tuned on KeisukeMiyamoto/SyntheticTalk-jp.

Usage

git clone https://github.com/KeisukeMiyamoto1324/lambda.git
cd lambda
python3 -m venv venv
source venv/bin/activate
pip3 install -r requirements.txt

python3 src/inference_it/inference.py \
  --model-dir "KeisukeMiyamoto/lambda-1-360m-it" \
  --prompt "人工知能とは何ですか" \
  --max-new-tokens 128

Example Outputs

Limitations

This model is not safety-aligned. It may generate incorrect, biased, unsafe, or low-quality text.

The model was trained primarily on synthetic Japanese text and has not been evaluated on standard benchmarks.

---

Support Lambda

Lambda is an open-source project for building small Japanese language models from scratch. As a student, I have funded this project with income from my part-time job, but the growing training costs are becoming difficult to cover.

Your support helps cover GPU costs and develop larger models. Thank you for helping Lambda continue to grow.

Vast.ai

Vast.ai offers affordable cloud GPUs for AI training, with NVIDIA H100 SXM GPUs available from around $1.54 per hour. If you purchase credits through the link below, I receive 3% in GPU credits at no extra cost to you.

https://cloud.vast.ai/?ref_id=521936

Ko-fi

Support Lambda with a donation starting from $5.

<a href="https://ko-fi.com/lambda_llm"> <img src="assets/support_me_on_kofi_badge_blue.png" alt="Support Lambda on Ko-fi" width="240"> </a>