Qwen-7B-instruct-2and3_apps_12k_v5

cutelemonlili/Qwen-7B-instruct-2and3_apps_12k_v5

Qwen-7B-instruct-2and3_apps_12k_v5 is a text generation model from cutelemonlili. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

5% of all-time downloads

All-time downloads

107

Public

Parameters

7.6B

15.2 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors15.2 GB · 100%

At a glance

Task: Text Generation
Library: transformers
License: other
Model type: qwen2
Access: Public
Created: Jul 14, 2025
Updated: Jul 14, 2025
SHA: c64c9c96

Try a prompt

Base models

Qwen/Qwen2.5-7B-Instruct

Model card

From the Hugging Face model README

2and3_apps_3k_v5

This model is a fine-tuned version of Qwen/Qwen2.5-7B-Instruct on the 2and3_apps_3k_v5 dataset. It achieves the following results on the evaluation set:

Loss: 0.1835

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 1e-05
train_batch_size: 1
eval_batch_size: 1
seed: 42
distributed_type: multi-GPU
num_devices: 4
total_train_batch_size: 4
total_eval_batch_size: 4
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: cosine
num_epochs: 1

Training results

Training Loss	Epoch	Step	Validation Loss
0.2647	0.0342	100	0.2523
0.2922	0.0684	200	0.2376
0.2236	0.1027	300	0.2279
0.2915	0.1369	400	0.2260
0.2276	0.1711	500	0.2292
0.1965	0.2053	600	0.2246
0.184	0.2396	700	0.2182
0.2044	0.2738	800	0.2147
0.2513	0.3080	900	0.2139
0.2051	0.3422	1000	0.2029
0.1897	0.3765	1100	0.2055
0.1929	0.4107	1200	0.2025
0.1914	0.4449	1300	0.2009
0.2033	0.4791	1400	0.2039
0.1859	0.5133	1500	0.2020
0.1962	0.5476	1600	0.2004
0.234	0.5818	1700	0.1957
0.1883	0.6160	1800	0.1942
0.1948	0.6502	1900	0.1911
0.1982	0.6845	2000	0.1899
0.1861	0.7187	2100	0.1869
0.2164	0.7529	2200	0.1857
0.2052	0.7871	2300	0.1859
0.1778	0.8214	2400	0.1858
0.1733	0.8556	2500	0.1853
0.1486	0.8898	2600	0.1846
0.1619	0.9240	2700	0.1841
0.1833	0.9582	2800	0.1838
0.2156	0.9925	2900	0.1838

Framework versions

Transformers 4.46.1
Pytorch 2.4.0+cu121
Datasets 3.1.0
Tokenizers 0.20.3

Task: Text Generation
Library: transformers
Type: qwen2
License: other
Created: Jul 14, 2025
Updated: Jul 14, 2025