Downloads · 30 days
5
7% of all-time downloads
rswaminathan38/llmbench-student-3b-gsm8k-full-kd-ft-teacher-20260410
llmbench-student-3b-gsm8k-full-kd-ft-teacher-20260410 is a machine learning model from rswaminathan38. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
--- libraryname: transformers pipelinetag: text-generation basemodel: meta-llama/Llama-3.2-3B datasets: - gsm8k tags: - gsm8k - transformers - vllm - text-generation - student-model - knowledge-distillation ---
Downloads · 30 days
5
7% of all-time downloads
All-time downloads
69
Public
Parameters
3.2B
6.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6.4 GB · 100%
From the Hugging Face model README
library_name: transformers
pipeline_tag: text-generation
base_model: meta-llama/Llama-3.2-3B
datasets:
- gsm8k
tags:
- gsm8k
This repo contains the full-logit KD export for the student model from the GSM8K workflow in this project.
Transformers:
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "rswaminathan38/llmbench-student-3b-gsm8k-full-kd-ft-teacher-20260410"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype="auto")
vLLM:
vllm serve rswaminathan38/llmbench-student-3b-gsm8k-full-kd-ft-teacher-20260410 --dtype auto
0.2494329 / 1319247.7437cot_step_by_stepmeta-llama/Llama-3.2-3Bfull-logit KD/storage/ice1/3/3/rswaminathan38/LLM_Bench/LLMOptimization/Model_Optimizations/outputs/hf_full_kd_teacher_2026-04-10Fine-tuned GSM8K teacher 8B (2026-04-10)num_train_epochs: 10per_device_train_batch_size: 2gradient_accumulation_steps: 8learning_rate: 1e-05warmup_ratio: 0.05max_seq_length: 1024alpha: 0.7temperature: 2.0kd_method: fulltop_k: 64question + "\n\nLet's think step by step.\n".run_config.json and eval/test_summary.json are uploaded alongside the weights when available.