model_feature_concat_svd_256_DEFI

phunganhsang/model_feature_concat_svd_256_DEFI

model_feature_concat_svd_256_DEFI is a machine learning model from phunganhsang. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as agpl-3.0.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

17% of all-time downloads

All-time downloads

Public

Parameters

136M

542 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors542 MB · 100%

At a glance

Library: transformers
License: agpl-3.0
Model type: roberta
Access: Public
Created: Jun 30, 2026
Updated: Jun 30, 2026
SHA: e921343d

Base models

vinai/phobert-base-v2

Model card

From the Hugging Face model README

model_feature_concat_svd_256_DEFI

This model is a fine-tuned version of vinai/phobert-base-v2 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.1001
Accuracy: 0.9692
F1: 0.9639

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
lr_scheduler_warmup_steps: 2645
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy	F1
No log	0.1419	150	0.5391	0.7215	0.5203
No log	0.2838	300	0.2804	0.9461	0.9359
No log	0.4257	450	0.1925	0.9578	0.9509
No log	0.5676	600	0.1593	0.9600	0.9532
No log	0.7096	750	0.1331	0.9624	0.9567
No log	0.8515	900	0.1209	0.9640	0.9579
No log	0.9934	1050	0.1156	0.9656	0.9603
0.2695	1.1353	1200	0.1043	0.9665	0.9613
0.2695	1.2772	1350	0.0971	0.9661	0.9612
0.2695	1.4191	1500	0.0959	0.9667	0.9614
0.2695	1.5610	1650	0.0976	0.9683	0.9632
0.2695	1.7029	1800	0.0943	0.9687	0.9637
0.2695	1.8448	1950	0.0885	0.9702	0.9656
0.2695	1.9868	2100	0.0902	0.9687	0.9640
0.0932	2.1287	2250	0.1195	0.9640	0.9590
0.0932	2.2706	2400	0.1005	0.9648	0.9598
0.0932	2.4125	2550	0.0888	0.9655	0.9606
0.0932	2.5544	2700	0.1001	0.9692	0.9639

Framework versions

Transformers 5.12.1
Pytorch 2.7.1+cu118
Datasets 5.0.0
Tokenizers 0.22.2

Library: transformers
Type: roberta
License: agpl-3.0
Created: Jun 30, 2026
Updated: Jun 30, 2026