Downloads · 30 days
7
14% of all-time downloads
renalpha/glm47-flash-typo3
glm47-flash-typo3 is a machine learning model from renalpha. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as other.
A LoRA adapter finetuned on top of GLM-4.7-Flash for TYPO3 CMS development — covering v13.4 LTS and v14.
Downloads · 30 days
7
14% of all-time downloads
All-time downloads
51
Public
Repo size
3.4 GB
Likes
0
Public
Click a slice to open those files.
.safetensors3.4 GB · 99%
From the Hugging Face model README
A LoRA adapter finetuned on top of GLM-4.7-Flash for TYPO3 CMS development — covering v13.4 LTS and v14.
Trained on 17,649 Q&A pairs generated from the official TYPO3 documentation:
| Parameter | Value |
|---|---|
| Base model | GLM-4.7-Flash (30B MoE, 3B active) |
| Method | LoRA (16-bit) |
| LoRA rank | 32 |
| LoRA alpha | 32 |
| Training steps | 900 |
| Batch size | 8 (1 × 8 grad accum) |
| Learning rate | 2e-4 (cosine schedule) |
| Final loss | 1.032 |
| Training time | ~113 minutes on A100 80GB |
from unsloth import FastLanguageModel
model, tokenizer = FastLanguageModel.from_pretrained(
"renalpha/glm47-flash-typo3",
max_seq_length = 2048,
dtype = None,
load_in_4bit = False,
)
messages = [
{
"role": "system",
"content": "You are an expert TYPO3 13.4 developer."
},
{
"role": "user",
"content": "How do I create a custom TCA field type in TYPO3 v13.4?"
}
]
inputs = tokenizer.apply_chat_template(
messages,
tokenize=True,
add_generation_prompt=True,
return_tensors="pt",
).to("cuda")
outputs = model.generate(
input_ids=inputs,
max_new_tokens=512,
temperature=0.7,
do_sample=True,
)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
Generated from the official TYPO3 GitHub documentation repos using GLM-4-32B-0414 as the synthetic data generator.
Repos used:
TYPO3-Documentation/TYPO3CMS-Reference-CoreApiTYPO3-Documentation/TYPO3CMS-Reference-TCATYPO3-Documentation/TYPO3CMS-Reference-TyposcriptTYPO3-Documentation/TYPO3CMS-Reference-ViewHelperTYPO3-Documentation/TYPO3CMS-Reference-TSconfigTYPO3-Documentation/TYPO3CMS-Tutorial-GettingStartedTYPO3-Documentation/TYPO3CMS-Tutorial-SitePackage