Downloads · 30 days
24
13% of all-time downloads
ethanteh/bge-finetuned-insurance-matryoshka
bge-finetuned-insurance-matryoshka is a sentence similarity model from ethanteh. Use it when you need a score for how close two texts are. It is set up for sentence-transformers. The card lists the license as apache-2.0.
This is a sentence-transformers model finetuned from BAAI/bge-base-en-v1.5 on the json dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, s…
Downloads · 30 days
24
13% of all-time downloads
All-time downloads
183
Public
Parameters
109M
438 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors438 MB · 100%
From the Hugging Face model README
This is a sentence-transformers model finetuned from BAAI/bge-base-en-v1.5 on the json dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
SentenceTransformer(
(0): Transformer({'max_seq_length': 512, 'do_lower_case': True}) with Transformer model: BertModel
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("ethanteh/bge-finetuned-insurance-matryoshka")
# Run inference
sentences = [
'Pre-retirement Deductible 0; Post-retirement Deductible 0\n\nAge Male Female MSIII 200 MSIII 300 MSIII 500 MSIII 200 MSIII 300 28 1,166 1,590 2,324 1,246 1,755 29 1,184 1,598 2,336 1,264 1,763 30 1,212 1,609 2,345 1,284 1,772 31 1,241 1,648 2,403 1,305 1,783 32 1,272 1,693 2,469 1,336 1,791 33 1,305 1,744 2,544 1,366 1,829 34 1,340 1,799 2,625 1,396 1,873 35 1,384 1,865 2,723 1,426 1,918 36 1,430 1,932 2,821 1,457 1,962 37 1,490 2,016 2,944 1,490 2,004 38 1,555 2,103 3,072 1,528 2,046 39 1,658 2,239 3,272 1,567 2,087 40 1,794 2,419 3,536 1,610 2,134 41 1,930 2,600 3,801 1,674 2,214 MSIII 500 2,564 2,576 2,588 2,602 2,606 2,661 2,725 2,791 2,856 2,918 2,980 3,041 3,110 3,228\n\nNote:\n\nFor presentation purposes, the insurance charges are rounded up to the next ringgit.\n\nAnnual Insurance Charges for HLA MediShield III Rider\n\nOccupational Class 1 & 2',
'What are the annual insurance charges for a 35-year-old male under HLA MediShield III Rider, Occupational Class 1 & 2, assuming pre and post retirement deductibles are 0?',
'What types of post-hospitalization support are included in the medical coverage?',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
<!--
### Direct Usage (Transformers)
<details><summary>Click to see the direct usage in Transformers</summary>
</details>
-->
<!--
### Downstream Usage (Sentence Transformers)
You can finetune this model on your own dataset.
<details><summary>Click to expand</summary>
</details>
-->
<!--
### Out-of-Scope Use
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->
dim_768, dim_512, dim_256, dim_128 and dim_64| Metric | dim_768 | dim_512 | dim_256 | dim_128 | dim_64 |
|---|---|---|---|---|---|
| cosine_accuracy@1 | 0.0602 | 0.0843 | 0.0843 | 0.0964 | 0.0723 |
| cosine_accuracy@3 | 0.5301 | 0.494 | 0.494 | 0.4578 | 0.4096 |
| cosine_accuracy@5 | 0.6627 | 0.6386 | 0.6506 | 0.5783 | 0.5301 |
| cosine_accuracy@10 | 0.7711 | 0.7831 | 0.7711 | 0.7952 | 0.7349 |
| cosine_precision@1 | 0.0602 | 0.0843 | 0.0843 | 0.0964 | 0.0723 |
| cosine_precision@3 | 0.1767 | 0.1647 | 0.1647 | 0.1526 | 0.1365 |
| cosine_precision@5 | 0.1325 | 0.1277 | 0.1301 | 0.1157 | 0.106 |
| cosine_precision@10 | 0.0771 | 0.0783 | 0.0771 | 0.0795 | 0.0735 |
| cosine_recall@1 | 0.0602 | 0.0843 | 0.0843 | 0.0964 | 0.0723 |
| cosine_recall@3 | 0.5301 | 0.494 | 0.494 | 0.4578 | 0.4096 |
| cosine_recall@5 | 0.6627 | 0.6386 | 0.6506 | 0.5783 | 0.5301 |
| cosine_recall@10 | 0.7711 | 0.7831 | 0.7711 | 0.7952 | 0.7349 |
| cosine_ndcg@10 | 0.4436 | 0.4512 | 0.4432 | 0.4422 | 0.4003 |
| cosine_mrr@10 | 0.3357 | 0.3434 | 0.337 | 0.331 | 0.2946 |
| cosine_map@100 | 0.3482 | 0.3544 | 0.3477 | 0.3393 | 0.3079 |
| positive | anchor | |
|---|---|---|
| type | string | string |
| details | <ul><li>min: 13 tokens</li><li>mean: 262.79 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>min: 10 tokens</li><li>mean: 20.63 tokens</li><li>max: 48 tokens</li></ul> |
| positive | anchor |
|---|---|
| <code>Summary Table of Critical Illness Coverage (Con’t)<br><br>Benefit Payout<br><br>No Critical Illnesses Early Stage 50% of Rider Sum Assured 36 40 46 Intermediate Stage 50% of Rider Sum Assured Advanced Stage 100% of Rider Sum Assured deficit with persisting clinical<br><br>Third Degree Burns – of specified<br><br>Summary Table of Critical Illness Coverage (Con’t)<br><br>Critical Illnesses Early Stage 50% of Rider Sum Assured Human Immunodeficiency - Insertion of a Vena-cava filter Benefit Payout Intermediate Stage 50% of Rider Sum Assured Advanced Stage Hypertension – of specified<br><br>No<br><br>100% of Rider Sum Assured<br><br>Human Immunodeficiency Virus<br><br>50<br><br>in<br><br>56<br><br>60<br><br>Cardiomyopathy – of specified<br><br>Summary Table of Critical Illness Coverage (Con’t)<br><br>Critical Illnesses Early Stage 50% of Rider Sum Assured 61 62 63 64 65 66 67 68 69 70 Benefit Payout Intermediate Stage 50% of Rider Sum Assured Advanced Stage 100% of Rider Sum Assured deficit with persisting clinical<br><br>No<br><br>Special Benefit<br><br>Special Benefit Diabetes Recovery Benefit...</code> | <code>What benefits are available for conditions like third-degree burns, HIV, or cardiomyopathy, according to this table?</code> |
| <code>Q: Where can I purchase this plan?<br><br>official website at greateasternlife.com/my/direct<br><br>Q: How do I pay my premiums?<br><br>A: You have the flexibility to pay your premium annually or half-<br><br>Q: Am I covered for emergency medical assistance outside Malaysia?<br><br>A: You are covered for emergency medical assistance received while travelling outside Malaysia but subject to a maximum of 120 consecutive days on any one trip.<br><br>Note: Terms and conditions apply.<br><br>Q: Am I covered for treatment outside Malaysia?<br><br>attending physician, benefits in respect of the treatment<br><br>for<br><br>Q: How much will I get upon surrender of my policy?<br><br>This plan has no surrender value. However, upon cancellation of the policy by policyowner, you will be entitled for a proportionate refund (where applicable) of the last premium paid as below:<br><br>A:<br><br>Policy purchased for a period Refund of Annual Refund of Half- less than or Premium Yearly Premium equivalent to 3 months 30% 30% 30%<br><br>Note: The above refunds are only applicable provide...</code> | <code>What are the premium payment options for the GREAT Health Direct plan?</code> |
| <code>66<br><br>Uremic<br><br>Syndrome<br><br>Syndrome<br><br>Nil<br><br>Nil<br><br>Syndrome<br><br>No. 67 68 69 70 71 72 73 74 75 76 Category Necrotising Fasciitis Respiratory Diphteria requiring mechanical ventilation Loss of limb(s) Cerebral Aneurysm Requiring Brain Surgery Multiple Root Avulsions of Brachial Plexus Rheumatic Fever with Heart Valve Disorders Resection of the whole small intestine (duodenum, jejunum and ileum) Severe Pulmonary Fibrosis Rabies Generalized • Nil • Nil • Nil • Nil • Nil • Nil • Nil • Nil • Nil • Nil A-Plus Beyond Early Critical Shield Early Intermediate Critical Illness Critical Illness • Nil • Nil • Nil • Nil • Nil • Nil • Nil • Nil • Nil • Nil A-Plus Beyond Critical Shield Advanced Critical Illness • Necrotising Fasciitis • Respiratory Diphteria requiring mechanical ventilation • Loss of limb(s) • Cerebral Aneurysm Requiring Brain Surgery • Multiple Root Avulsions of Brachial Plexus • Rheumatic Fever with Heart Valve Disorders • Resection of the whole small intestine (duodenum, jejunum and ileum) •...</code> | <code>What illnesses are listed under the 'Early Critical Illness' category?</code> |
{
"loss": "MultipleNegativesRankingLoss",
"matryoshka_dims": [
768,
512,
256,
128,
64
],
"matryoshka_weights": [
1,
1,
1,
1,
1
],
"n_dims_per_step": -1
}
eval_strategy: epochgradient_accumulation_steps: 16learning_rate: 2e-05num_train_epochs: 10lr_scheduler_type: cosinewarmup_ratio: 0.1fp16: Truetf32: Falseload_best_model_at_end: Trueoptim: adamw_torch_fusedbatch_sampler: no_duplicatesoverwrite_output_dir: Falsedo_predict: Falseeval_strategy: epochprediction_loss_only: Trueper_device_train_batch_size: 8per_device_eval_batch_size: 8per_gpu_train_batch_size: Noneper_gpu_eval_batch_size: Nonegradient_accumulation_steps: 16eval_accumulation_steps: Nonetorch_empty_cache_steps: Nonelearning_rate: 2e-05weight_decay: 0.0adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08max_grad_norm: 1.0num_train_epochs: 10max_steps: -1lr_scheduler_type: cosinelr_scheduler_kwargs: {}warmup_ratio: 0.1warmup_steps: 0log_level: passivelog_level_replica: warninglog_on_each_node: Truelogging_nan_inf_filter: Truesave_safetensors: Truesave_on_each_node: Falsesave_only_model: Falserestore_callback_states_from_checkpoint: Falseno_cuda: Falseuse_cpu: Falseuse_mps_device: Falseseed: 42data_seed: Nonejit_mode_eval: Falseuse_ipex: Falsebf16: Falsefp16: Truefp16_opt_level: O1half_precision_backend: autobf16_full_eval: Falsefp16_full_eval: Falsetf32: Falselocal_rank: 0ddp_backend: Nonetpu_num_cores: Nonetpu_metrics_debug: Falsedebug: []dataloader_drop_last: Falsedataloader_num_workers: 0dataloader_prefetch_factor: Nonepast_index: -1disable_tqdm: Falseremove_unused_columns: Truelabel_names: Noneload_best_model_at_end: Trueignore_data_skip: Falsefsdp: []fsdp_min_num_params: 0fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}fsdp_transformer_layer_cls_to_wrap: Noneaccelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}deepspeed: Nonelabel_smoothing_factor: 0.0optim: adamw_torch_fusedoptim_args: Noneadafactor: Falsegroup_by_length: Falselength_column_name: lengthddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falsedataloader_pin_memory: Truedataloader_persistent_workers: Falseskip_memory_metrics: Trueuse_legacy_prediction_loop: Falsepush_to_hub: Falseresume_from_checkpoint: Nonehub_model_id: Nonehub_strategy: every_savehub_private_repo: Nonehub_always_push: Falsegradient_checkpointing: Falsegradient_checkpointing_kwargs: Noneinclude_inputs_for_metrics: Falseinclude_for_metrics: []eval_do_concat_batches: Truefp16_backend: autopush_to_hub_model_id: Nonepush_to_hub_organization: Nonemp_parameters:auto_find_batch_size: Falsefull_determinism: Falsetorchdynamo: Noneray_scope: lastddp_timeout: 1800torch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Nonedispatch_batches: Nonesplit_batches: Noneinclude_tokens_per_second: Falseinclude_num_input_tokens_seen: Falseneftune_noise_alpha: Noneoptim_target_modules: Nonebatch_eval_metrics: Falseeval_on_start: Falseuse_liger_kernel: Falseeval_use_gather_object: Falseaverage_tokens_across_devices: Falseprompts: Nonebatch_sampler: no_duplicatesmulti_dataset_batch_sampler: proportional| Epoch | Step | Training Loss | dim_768_cosine_ndcg@10 | dim_512_cosine_ndcg@10 | dim_256_cosine_ndcg@10 | dim_128_cosine_ndcg@10 | dim_64_cosine_ndcg@10 |
|---|---|---|---|---|---|---|---|
| 0.8602 | 5 | - | 0.4356 | 0.4285 | 0.4026 | 0.3877 | 0.3048 |
| 1.8602 | 10 | 46.1696 | 0.4348 | 0.4279 | 0.4035 | 0.3920 | 0.3294 |
| 2.8602 | 15 | - | 0.4340 | 0.4252 | 0.4032 | 0.4127 | 0.3518 |
| 3.8602 | 20 | 20.5361 | 0.4403 | 0.4493 | 0.4117 | 0.4156 | 0.3761 |
| 4.8602 | 25 | - | 0.4558 | 0.4413 | 0.4233 | 0.4166 | 0.3859 |
| 5.8602 | 30 | 15.2732 | 0.4407 | 0.4359 | 0.4259 | 0.4266 | 0.3974 |
| 6.8602 | 35 | - | 0.4416 | 0.4408 | 0.4389 | 0.4417 | 0.3983 |
| 7.8602 | 40 | 11.1479 | 0.4427 | 0.4512 | 0.4432 | 0.4427 | 0.397 |
| 8.8602 | 45 | - | 0.4460 | 0.4512 | 0.4432 | 0.4422 | 0.4003 |
| 9.8602 | 50 | 12.725 | 0.4436 | 0.4512 | 0.4432 | 0.4422 | 0.4003 |
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
@misc{kusupati2024matryoshka,
title={Matryoshka Representation Learning},
author={Aditya Kusupati and Gantavya Bhatt and Aniket Rege and Matthew Wallingford and Aditya Sinha and Vivek Ramanujan and William Howard-Snyder and Kaifeng Chen and Sham Kakade and Prateek Jain and Ali Farhadi},
year={2024},
eprint={2205.13147},
archivePrefix={arXiv},
primaryClass={cs.LG}
}
@misc{henderson2017efficient,
title={Efficient Natural Language Response Suggestion for Smart Reply},
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
year={2017},
eprint={1705.00652},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
<!--
## Glossary
*Clearly define terms in order to be accessible across audiences.*
-->
<!--
## Model Card Authors
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->
<!--
## Model Card Contact
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
-->