Downloads · 30 days
8
2% of all-time downloads
exp_p1_alpha128
ekunish/exp_p1_alpha128
exp_p1_alpha128 is a text generation model from ekunish. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
All-time downloads
359
Public
Repo size
540 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors529 MB · 97%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Feb 8, 2026
- Updated
- Feb 8, 2026
- SHA
- e2926173
Try a prompt
Base models
Model card
From the Hugging Face model README
exp_p1_alpha128
Model ID: ekunish/exp_p1_alpha128
Phase 1 alpha sweep: lora_alpha=128, alpha/r=2.0 (base=exp008a reproduction)
Training Configuration
| Parameter | Value |
|---|---|
| Base model | Qwen/Qwen3-4B-Instruct-2507 |
| Method | QLoRA (4-bit) |
| Max sequence length | 512 |
| Epochs | 1 |
| Learning rate | 1e-06 |
| LoRA r | 64 |
| LoRA alpha | 128 |
| Batch size | 2 × 8 = 16 |
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
import torch
base = "Qwen/Qwen3-4B-Instruct-2507"
adapter = "ekunish/exp_p1_alpha128"
tokenizer = AutoTokenizer.from_pretrained(base)
model = AutoModelForCausalLM.from_pretrained(
base,
torch_dtype=torch.float16,
device_map="auto",
)
model = PeftModel.from_pretrained(model, adapter)
Training Data
- Dataset:
data/sft_u10bei_only - License: CC-BY-4.0 (where applicable)
Sources & License
- Training Data: u-10bei/structured_data_with_cot_dataset_512_v2, daichira/structured-3k-mix-sft, etc.
- Dataset License: Creative Commons Attribution (CC-BY-4.0)
- Compliance: Users must comply with both the dataset's attribution requirements and the base model's original terms of use.
Competition
松尾研LLMコミュニティ 2025年度講座 メインコンペ (StructEval-T)
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Languages
- en
- Created
- Feb 8, 2026
- Updated
- Feb 8, 2026