EnergyEmbed-v2

SentenceTransformer based on Alibaba-NLP/gte-multilingual-base

This is a sentence-transformers model finetuned from Alibaba-NLP/gte-multilingual-base on the offshore_energy dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: Alibaba-NLP/gte-multilingual-base <!-- at revision 9bbca17d9273fd0d03d5725c7a4b0f6b45142062 -->
• Maximum Sequence Length: 8192 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • offshore_energy

<!-- - **Language:** Unknown --> <!-- - **License:** Unknown -->

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False, 'architecture': 'NewModel'})
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("Sampath1987/EnergyEmbed-v2")
# Run inference
sentences = [
    'What role did anti-collision analysis play in the drilling of the dual lateral well?',
    'This paper aims to analyze the impact of appraising and developing marginal fields with multiple stacked reservoirs which is quite challenging in terms of techno commercial value. The development of such marginal reservoirs using conventional single horizontal wells drilling and completion is uneconomical. Therefore, it was necessary to engineer a solution that can enhance the commercial value of the project by reducing CAPEX and OPEX. This paper will present the first comprehensive business case, where multiple stacked reservoirs with marginal reserves were studied to produce independently using multilateral completions, granting full accessibility of the laterals while achieving production monitoring and reservoir surveillance.',
    "The most common challenge in horizontal drilling is depth uncertainty which can be due to poor seismic data or interpretation. It is arguable that a successful landing of the wellbore in the reservoir optimally and within the desired zone is the most challenging in most geosteering operation. The presence of fluid contacts such as oil-water-contact (OWC) and gas-oil-contact (GOC) complicates the whole drilling process, most especially if these fluid contacts are not well defined or known. Additionally, the ability to map the boundaries of the reservoir as the BHA drills the lateral section is an added advantage to remaining within the desired reservoir section.\nThe success of any reservoir navigation service where seismic uncertainty at the reservoir top is high will rely largely on how effective the geosteering system is and how the geosteering engineer is able to react promptly to changes while landing the well in the reservoir and drilling the lateral section with without exiting the reservoir.\nReservoir Navigation Service (RNS) provides the means for the drilling near horizontal or horizontal wells for the purpose of increasing hydrocarbon extraction from the earth's subsurface. This involves the use of a pre-defined bottom hole assembly (BHA) with inbuilt downhole logging while drilling (LWD) and measurement while drilling (MWD) sensors. The measurements from these downhole sensors are uplinked to the surface of the wellbore where they are converted to meaningful petrophysical data. The goal is to use the downhole petrophysical data such as gamma ray, propagation resistivity and so on, to update an existing pre-well geological model of a section of the earth in such a way that the final result depicts the true model picture of the earth subsurface.\nThis paper focuses on using well CBH-44L to showcase how the use of real-time distance-to-boundary (D2B) measurement from a deep reading azimuthal propagation resistivity tool is use to correct for depth uncertainty in seismic, thereby, improving the chance of successfully landing and drilling a horizontal well.",
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.5285, 0.4524],
#         [0.5285, 1.0000, 0.5421],
#         [0.4524, 0.5421, 1.0000]])

<!-- ### Direct Usage (Transformers) <details><summary>Click to see the direct usage in Transformers</summary> </details> --> <!-- ### Downstream Usage (Sentence Transformers) You can finetune this model on your own dataset. <details><summary>Click to expand</summary> </details> --> <!-- ### Out-of-Scope Use *List how the model may foreseeably be misused and address what users ought not to do with the model.* -->

Evaluation

Metrics

Triplet

• Dataset: ai-job-validation
• Evaluated with <code>TripletEvaluator</code>

<!-- ## Bias, Risks and Limitations *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.* --> <!-- ### Recommendations *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.* -->

Training Details

Training Dataset

offshore_energy

• Dataset: offshore_energy at 0ebbfc6
• Size: 89,129 training samples
• Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	<ul><li>min: 12 tokens</li><li>mean: 24.68 tokens</li><li>max: 77 tokens</li></ul>	<ul><li>min: 37 tokens</li><li>mean: 437.61 tokens</li><li>max: 983 tokens</li></ul>	<ul><li>min: 28 tokens</li><li>mean: 410.96 tokens</li><li>max: 1188 tokens</li></ul>

• Samples:

  anchor	positive	negative
  <code>What is the significance of end point relative permeability of the oil phase in the productivity of oil reservoirs below bubble point pressure?</code>	<code>In contrast with what is followed for Offshore Oil Operations the majority of the Onshore Oil Operations in the world do not have a Minimum and Mandatory required HSE training program for all personnel including contractors and subcontractors.<br>A comparison is drawn between the Minimum and Mandatory HSE Training Programmes applied offshore in developed areas, mainly North Sea and Gulf of Mexico and the benefits that similar programs can bring to the ME onshore oil operations are addressed by estimating the risk reduction and potential economic benefits.<br>The applicability of such Minimum and Mandatory HSE Training Programs is analyzed against the scenario of heavy utilization of contractors and subcontractors with different approach and standards in HSE training and also the increasing complexity of the onshore oil operations<br>An estimation of how many lives can potentially be saved by the introduction of such programs is provided in global and generic terms.<br>The HR Impact, in different a...</code>	<code>The knowledge of relative permeability is key in oil production mechanism as it affects multiphase flow which is vital to producible reserves in petroleum reservoirs. In this study, the impact of altering end point saturation on relative permeability curve and how it influences oil recovery was investigated on field X in Niger Delta, Nigeria. The saturation end points obtained after a simulation study was used as a start point to predict oil production. These end points saturation of water and oil were altered and varied according to facies. The eclipse simulation tool was used in conducting the prediction runs. The result obtained showed wide variation from actual production forecast (i.e. ≥ 25%) when end points were varied with no guided limit from experimental data. This study reveals the need for an accurate determination of residual oil saturation as it was seen to have an impact on forecast and history match.</code>
  <code>What role does the effective coefficient of discharge (Kd) play in calculating the required effective discharge area?</code>	<code>96 API S TANDARD 520, P ART I—S IZING AND S ELECTION <br>B.2.3.3 Using the theoretical mass flux obtained from numerical integration above, one may determine the<br>required effective discharge area: <br>In USC units: <br>Q × ρ 1<br>× <br>sec gal G ×<br>60 × 7 4805 .<br>min ft 3 <br>A = W = Q × ρ × 1<br>G × K d 60 sec × 7 4805 . gal G × K <br>d 60 × 7 4805 . d<br>3 <br>528 62 2 × . 1 2 2 <br>A = × = 0 0148 ft . = 2 135 in. . (B.8) <br>60 7 4805 × . 7 592 14 0 65, . × . <br>In SI units: <br>Q ×ρ 1<br>× <br>sec liter G ×<br>60 min × 1 000, m 3 <br>A = W = Q ×ρ × 1<br>G × K d 60 sec × 1 000, liter 3 G × K <br>, <br>A = 2 000, × 996 9 . × 1 = 1 379 . × 10 − 3 m 2 = 1 379 mm, 2 (B.9)<br>60 × 1 000, 37 068, × 0 65 . <br>where <br>G is the theoretical mass flux through the nozzle, lb/s·ft [2] (kg/s·m [2] ); <br>W is the required relief rate, lb/s (kg/s); <br>Q is the required relief rate, gal/min (L/min); <br>ρ = 1 v is the fluid density, lb/ft [3] (kg/m [3] ); <br>K d is the effective coefficient of discharge...</code>	<code>S IZING, S ELECTION, AND I NSTALLATION OF P RESSURE - RELIEVING D EVICES 59 <br>5.6.3 Sizing for Critical Flow <br>5.6.3.1 General <br>5.6.3.1.1 Pressure-relief devices in gas or vapor service that operate at critical flow conditions (see 5.6.2)<br>may be sized using Equation (2) through Equation (7). Each of the equations may be used to calculate the<br>effective discharge area, A, required to achieve a required flow rate through a pressure-relief device. A PRV<br>that has an effective discharge area equal to or greater than the calculated value of A is then chosen for the<br>application. <br>In USC units: <br>A = (2) <br>A = (3) <br>6 32 . CK P K K d 1 b c <br>A = (4) <br>1 175 . CK P K K <br>1 175 . CK P K K d 1 b c <br>. <br>In SI units: <br>A = (5) <br>A = (6)<br>CK P K K <br>d 1 b c <br>A =<br>CK P K K <br>=<br>(7) <br>d 1 b c <br>where <br>A is the required effective discharge area of the device, in. [2] (mm [2] ) (see 3.20); <br>W is the required flow through the device, lb/h (kg/h); <br>_C...</code>
  <code>How many swellable packers were required to be run in the horizontal hole part for the AICV trial, and what was the purpose of this requirement?</code>	<code>Removing fluid from a wellbore column, allowing a well to flow initially, or bringing a previous well back online, nitrogen lifting is commonly used in north Iraq wells. Due to the inability of coiled tubing units to be delivered on time and their high cost, operators are forced to seek for an alternative method of unloading drilling fluid. A hydraulic Jet Pump is a technology used to complete the task.<br>A newly drilled well DB-H was chosen, and the drilling fluid volume calculated was 12,000 bbl. to pump to the surface and begin production, assuming nonstop operation between unloading and producing. The deployment of the hydraulic lift Jet Pump for both stages was planned. Well data from the operator was collected, the process design was initiated, and Jet Evaluation Modeling Software (JEMS) was used to run the design models. A Proper pump size was set up based on available data to meet operator expectations. A Reverse Circulating Jet Pump (RCJP) was chosen to be installed inside a Sli...</code>	<code>This development, predominantly from four artificial islands, of a giant offshore field in the United Arab Emirates (UAE) requires lateral compartmentalization with open hole packers of the 6 5/8" horizontal lower completions with lateral lengths greater than 16,000ft and total well lengths greater than 30,000ft MD. Swell Packer technology has enabled cost effective compartmentalization in horizontal laterals and is the preferred OH packer solution for the development.<br>Deploying swell packers is regarded as being a simple solution to compartmentalizing any lateral where typically the deployment fluid differs from the fluids in which it will swell in; this application prevents the elastomer from swelling during deployment and swelling upon contact with produced or injected fluids. The use of an extended delayed oil swell packer with no delay systems in this particular application enables the packers to be deployed in a Non Aqueous Reservoir Drill in Fluid (RDFNAF) where the packer is re...</code>

• Loss: <code>MultipleNegativesRankingLoss</code> with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim",
      "gather_across_devices": false
  }
  

Evaluation Dataset

offshore_energy

• Dataset: offshore_energy at 0ebbfc6
• Size: 11,141 evaluation samples
• Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	<ul><li>min: 12 tokens</li><li>mean: 24.37 tokens</li><li>max: 53 tokens</li></ul>	<ul><li>min: 38 tokens</li><li>mean: 428.35 tokens</li><li>max: 978 tokens</li></ul>	<ul><li>min: 29 tokens</li><li>mean: 405.3 tokens</li><li>max: 1111 tokens</li></ul>

• Samples:

  anchor	positive	negative
  <code>How does partial jacket construction differ for vessels that cannot use staybolt construction?</code>	<code>9-7 – 9-10 ASME BPVC.VIII.1-2019 <br>Figure 9-7 <br>(2) Partial jackets that by virtue of their service or<br>configuration do not lend themselves to staybolt construction may be fabricated by other means providing<br>they are designed using appropriate stress values and<br>are proof tested in accordance with UG-101(p). <br>444 <br>9-8 FABRICATION <br>(a) Fabrication of vessels shall be in accordance with<br>applicable Parts of Subsection A and Subsection B, Part<br>UW. The requirements of UW-13(e) do not apply to closure rings.<br>(b) This Appendix covers fabrication of jacketed vessels<br>by welding. Other methods of fabrication are permitted,<br>provided the requirements of applicable parts of this Di<br>vision are met. <br>(c) Where only the inner vessel is subjected to lethal<br>service, the requirements of UW-2 shall apply only to<br>welds in the inner vessel and those welds attaching the<br>jacket to the inner vessel. Welds attaching the jacket to<br>the inner vessel need not be radiographed and may b...</code>	<code>9-5 – 9-7 ASME BPVC.VIII.1-2019 <br>‐ ‐<br>(g 5), and (g 6), may be used on any of the types of<br>jacketed vessels shown in Figure 9-2 where t rj does not<br>exceed [5] / 8 in. (16 mm).<br>(7) Closures shown in Figure 9-5, sketch (h) used on<br>Type 3 jacketed vessels shown in Figure 9-2 shall have attachment welds in accordance with Figure 9-5, sketch <br>‐ ‐<br>(i 1) or (i 2). This construction is limited to jackets where<br>t rj does not exceed [5] / 8 in. (16 mm).<br>(8) Closures for conical or toriconical jackets shown<br>in Figure 9-5, sketches (k) and (l) shall comply with the<br>requirements for Type 2 jacketed vessels shown in Figure<br>9-2. <br>(d) Any radial welds in closure members shall be buttwelded joints penetrating through the full thickness of the<br>member and shall be ground flush where attachment<br>welds are to be made. <br>(e) Where the inner vessel must meet the requirements<br>of UW-2, the attachment welds of the jacket to the inner<br>vessel need not be welded for their full thickness no...</code>
  <code>What dimensions must fins and studs conform to as stipulated in Section 17.4.4?</code>	<code>17.4 Examination of other components <br>17.4.1 Examination of heater steelwork shall be in accordance with the structural design code. <br>17.4.2 Refractory linings shall be examined throughout for thickness variations during application and for cracks<br>after curing. Thickness tolerance is limited to a range of minus 6 mm (1/4 in) to plus 13 mm (1/2 in). Cracks which<br>are 3 mm (1/8 in) or greater in width and penetrate more than 50 % of the castable thickness shall be repaired.<br>Repairs shall be made by chipping out the unsound refractory to the backup layer interface or casing and<br>exposing a minimum of three tieback anchors, or to the sound metal, making a joint between sound refractory that<br>has a minimum slope of 25 mm (1 in) to the base metal (dove-tail construction) and then gunning, casting or<br>hand-packing the area to be repaired. <br>17.4.3 Finned extended surface shall be examined to ensure fins are perpendicular to the tube within 15°. The<br>maximum discontinuity of the w...</code>	<code>16.1 -112 STEEL ANCHORS [Sect. I8. <br>3e. Detailing Requirements in Composite Components <br>Steel anchors in composite components shall meet the following requirements: <br>(a) Minimum concrete cover to steel anchors shall be in accordance with ACI 318<br>provisions for concrete protection of headed shear stud reinforcement. <br>(b) Minimum center-to-center spacing of steel headed stud anchors shall be four<br>diameters in any direction. <br>(c) The maximum center-to-center spacing of steel headed stud anchors shall not <br>exceed 32 times the shank diameter. <br>(d) The maximum center-to-center spacing of steel channel anchors shall be 24 in.<br>(600 mm). <br>User Note: Detailing requirements provided in this section are absolute limits.<br>See Sections I8.3a, I8.3b and I8.3c for additional limitations required to preclude<br>edge and group effect considerations. <br>Specification for Structural Steel Buildings, July 7, 2016<br>A MERICAN I NSTITUTE OF S TEEL C ONSTRUCTION</code>
  <code>What are some common mistakes in oil and gas project execution that lead to financial losses?</code>	<code>Dozens of deepwater wells have been drilled in western South China Sea with about 30 percent have characteristics of high temperature and high pressure, which brought a series of difficulties and challenges to field operations. After incorporating the analysis of engineering and geological environment for deepwater HTHP wells in Lingshui block of western South China Sea, it is suggested that the solution of drilling problems for deepwater HTHP wells should start from drilling fluid. Several major technical problems are required to be addressed by drilling fluid, such as co-exist of low temperature and high temperature that lead to difficulty of drilling fluid maintenance and narrow density margin caused by deepwater and high pressure. Based on the above problems, combining with geological features of HTHP wells, researchers developed a novel water based drilling fluid system compatible with deepwater HTHP wells in Lingshui block on the basis of conventional HEM drilling fluid and furth...</code>	<code>The lack of availability of required skills and experience in most if not all parts of the oil and gas value chain is well documented so, rather than trying to make the case, we will summarise the challenge thus: the industry in all parts of the world can't find the capability it needs to safely get its work done in the timeframes it would like.<br>However or wherever the situation is measured, the consequence is that in days when the oil price might suggest that the industry has "never had it so good", many companies are falling seriously short of stakeholder expectations with projects of all types not being completed as planned or failing to deliver anticipated returns.<br>Close to home we see producers consistently missing quarterly production targets and a seemingly constant downgrading of forecasts and year-on-year plans. This leads to a constant stream of bad news and criticism in the media, greater stress through all levels of management and an inevitable "knee jerk" towards a more sh...</code>

• Loss: <code>MultipleNegativesRankingLoss</code> with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim",
      "gather_across_devices": false
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• learning_rate: 2e-05
• num_train_epochs: 2
• warmup_ratio: 0.1

All Hyperparameters

<details><summary>Click to expand</summary>

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: steps
• prediction_loss_only: True
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 2e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 2
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.1
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: False
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: None
• hub_always_push: False
• hub_revision: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• include_for_metrics: []
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• liger_kernel_config: None
• eval_use_gather_object: False
• average_tokens_across_devices: False
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

</details>

Training Logs

Framework Versions

• Python: 3.10.12
• Sentence Transformers: 5.1.0
• Transformers: 4.53.3
• PyTorch: 2.8.0+cu128
• Accelerate: 1.9.0
• Datasets: 4.0.0
• Tokenizers: 0.21.2

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply},
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}

<!-- ## Glossary *Clearly define terms in order to be accessible across audiences.* --> <!-- ## Model Card Authors *Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.* --> <!-- ## Model Card Contact *Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.* -->