Downloads · 30 days
6
10% of all-time downloads
rswaminathan38/llmbench-student-3b-gsm8k-topk-hidden-ft-teacher-20260413
llmbench-student-3b-gsm8k-topk-hidden-ft-teacher-20260413 is a machine learning model from rswaminathan38. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
--- libraryname: transformers pipelinetag: text-generation basemodel: meta-llama/Llama-3.2-3B datasets: - gsm8k tags: - gsm8k - transformers - vllm - text-generation - student-model - knowledge-distillation ---
Downloads · 30 days
6
10% of all-time downloads
All-time downloads
62
Public
Parameters
3.2B
6.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6.5 GB · 100%
How the weights are stored.
BF163.2B · 100%
From the Hugging Face model README
library_name: transformers
pipeline_tag: text-generation
base_model: meta-llama/Llama-3.2-3B
datasets:
- gsm8k
tags:
- gsm8k
This repo contains the top-k KD with hidden-state matching export for the student model from the GSM8K workflow in this project.
Transformers:
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "rswaminathan38/llmbench-student-3b-gsm8k-topk-hidden-ft-teacher-20260413"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype="auto")
vLLM:
vllm serve rswaminathan38/llmbench-student-3b-gsm8k-topk-hidden-ft-teacher-20260413 --dtype auto
0.2252297 / 1319253.0349cot_step_by_stepmeta-llama/Llama-3.2-3Btop-k KD with hidden-state matching/storage/ice1/3/3/rswaminathan38/LLM_Bench/LLMOptimization/Model_Optimizations/outputs/hf_topk_hidden_teacher_2026-04-13Fine-tuned GSM8K teacher 8B (2026-04-10)num_train_epochs: 10per_device_train_batch_size: 2gradient_accumulation_steps: 8learning_rate: 1e-05warmup_ratio: 0.05max_seq_length: 1024alpha: 0.7temperature: 2.0kd_method: topktop_k: 64hidden_match: Truehidden_match_weight: 0.05question + "\n\nLet's think step by step.\n".run_config.json and eval/test_summary.json are uploaded alongside the weights when available.