Downloads · 30 days
198
42% of all-time downloads
RedTeamLab/Gemma-4-12B-Sol-Traces-v1
Gemma-4-12B-Sol-Traces-v1 is a machine learning model from RedTeamLab. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as gemma.
Repository coding-agent model fine-tuned from unsloth/gemma-4-12B-it with LoRA on a verified original-synthetic corpus compiled from Hermes Agent session logs. The traces do not originate from OpenCode.
Downloads · 30 days
198
42% of all-time downloads
All-time downloads
477
Public
Repo size
31.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf31.2 GB · 100%
From the Hugging Face model README
Repository coding-agent model fine-tuned from unsloth/gemma-4-12B-it with LoRA on a verified original-synthetic corpus compiled from Hermes Agent session logs. The traces do not originate from OpenCode.
| Parameter | Value |
|---|---|
| Base model | unsloth/gemma-4-12B-it |
| Fine-tuning | LoRA, r=16; language + attention layers |
| Dataset | 25,000 accepted trajectories: 21,174 train / 1,324 validation / 2,502 test |
| Epochs | 1 |
| Learning rate | 1e-4, cosine schedule, 3% warmup |
| Effective batch size | 8 (2 × 4 gradient accumulation) |
| Maximum sequence length | 8,192 tokens |
| Loss | Assistant-only; tool responses excluded |
| GPU | Modal H100 80GB |
| Completed steps | 377 |
| Training loss | 0.080072 |
| Validation loss | 0.025797 |
| Runtime | 10,848 s (3h 00m 48s) |
| Peak VRAM | 46.72 GiB |
| Throughput | 1,138.7 tokens/s |
Sol Traces are compiled from Hermes Agent session logs produced while running deterministic, seed-based coding scenarios through a reference executor. The scenarios define repository templates, task requirements, and verification commands; accepted records retain the corresponding tool-use events and verification outcomes. Records are included only when their configured post-task validation succeeds.
Actual v1 coverage: 224 language/task/variant repository families across TypeScript, JavaScript, Python, shell, configuration, Go, Rust, and JVM/Java. Task categories are debugging, feature, refactoring, testing, build configuration, integration, and documentation review.
The schema defines list_files, read_file, search_code, run_command, and apply_patch. The v1 reference policy emits list_files, read_file, run_command, and apply_patch; it has no search_code calls. This model is therefore best understood as a fine-tune for the verified scripted v1 workflow, not a broadly trained autonomous coding agent.
| File | Description |
|---|---|
gemma-4-12b-sol-traces-v1-Q4_K_M.gguf | Quantized merged model (Q4_K_M) |
gemma-4-12b-sol-traces-v1-f16.gguf | Full merged F16 model |
training_stats.json | Full training metrics |
training_report.json | Duplicate training report retained for compatibility |
dataset_manifest.json | Accepted-record counts, split ratios, and rejection summary |
llama-cli \
-m gemma-4-12b-sol-traces-v1-Q4_K_M.gguf \
-ngl 99 \
--chat-template gemma \
-p "List the repository files matching *.py"
search_code was not used in v1 training trajectories.