cv_embedder

SentenceTransformer based on Qwen/Qwen3-0.6B

This is a sentence-transformers model finetuned from Qwen/Qwen3-0.6B. It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for retrieval.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: Qwen/Qwen3-0.6B <!-- at revision c1899de289a04d12100db370d81485cdf75e47ca -->
• Maximum Sequence Length: 1024 tokens
• Output Dimensionality: 1024 dimensions
• Similarity Function: Cosine Similarity
• Supported Modalities: Text, Message

<!-- - **Training Dataset:** Unknown --> <!-- - **Language:** Unknown --> <!-- - **License:** Unknown -->

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}, 'message': {'method': 'forward', 'method_output_name': 'last_hidden_state', 'format': 'flat'}}, 'module_output_name': 'token_embeddings', 'architecture': 'Qwen3Model'})
  (1): Pooling({'embedding_dimension': 1024, 'pooling_mode': 'lasttoken', 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'Search for a candidate for this job: Instruct: Given a job listing, retrieve the most relevant candidate profiles that match the required skills, experience, and role.\nQuery: Title: Junior Project Manager (PMO Support – SAP Program)\nCompany: Sii Ukraine\nCategory: Project Manager\nSkills: Management, Project Manager\nLanguages: English - C1 - Advanced, Ukrainian - Native\nExperience: 1 year experience\nEmployment: FULL_TIME\nWork format: Full Remote\nLocation: Tax residence in Ukraine is required\nDomain: Energy / Utilities\n\nDescription:\nSii Ukraine is a subsidiary of Sii Poland — the leader in IT, engineering, and consultancy services with over 7500 IT experts in Poland and more than 250 prestigious customers. We are looking for ambitious and top-quality professionals to join our project teams.\n \nThe Junior Project Manager (PMO Support) provides administrative and organizational support within a large-scale, multi-year SAP S/4HANA implementation programme in a complex, international environment. \n\nThis role is designed for a junior or trainee-level professional who is motivated to grow in project management and gain hands-on experience in supporting experienced project managers and cross-functional teams.\n\nThe position focuses on ensuring smooth coordination, documentation, and communication across stakeholders, while contributing to the successful delivery of a global transformation programme within a leading international energy technology organization.\n \nYour Tasks:\nSupport experienced Project Managers in the coordination of a large SAP S/4HANA implementation programme\nOrganize and coordinate meetings (scheduling, agendas, logistics, follow-ups)\nPrepare meeting minutes, action trackers, and project documentation\nManage and structure project documentation, presentations, and files\nMaintain and administer SharePoint spaces for cross-functional collaboration\nSupport Track & Trace activities across project tasks and deliverables\nAssist in preparing presentations for internal and stakeholder meetings\nProvide support in risk tracking and basic budget monitoring activities\nEnsure proper documentation management and version control\nFacilitate communication between project teams, stakeholders, and external partners\nProvide general administrative and organizational support to the PMO\n\nRequirements:\n1-2 years of experience in PMO support, project coordination, or administrative roles (junior or trainee profiles are welcome)\nBasic knowledge of project management principles and PMO practices\nPractical experience with Microsoft SharePoint and Microsoft PowerPoint\nAbility to manage and organize project documentation, including structuring and version control\nExperience supporting meeting and presentation preparation, including note-taking and follow-ups\nBasic understanding of Track & Trace activities related to project tasks and deliverables\nStrong organizational and coordination abilities with close attention to detail\nAbility to communicate effectively and collaborate with diverse stakeholders\nCapability to work in a structured and professional environment\nProactive mindset with motivation to learn and take initiative\nFluency in English (required)\nTax residence in Ukraine is required',
    'Candidate Resume: Title: Project Manager\nSeniority: Middle\nLanguages: English, Ukrainian, Russian\nLocation: Ukraine\nExperience: 0-3 years\n\nSummary: Currently working as a project manager mostly. Partially doing some front-end development (JS/CSS/HTML5) and back-end (PHP/Smarty/MySQL).\nWork history: My responsibilities include... managing projects :) | Design and development',
    'Candidate Resume: Title: Senior Software Engineer\nSeniority: Senior\nLocation: Michigan\nExperience: 10+ years\n\nSummary: Team player software engineer with a positive attitude, phenomenal time management skills, attention to detail, and a strong focus on user experience. Worked as a full-stack developer in the medical and automotive industries. Recently traveled the world while developing small business websites and mobile apps, including a photo collage maker and several games for iOS. Passionate about the future of technology and human-centered design. Email: chris@chris-hendrickson.com Github: https://github.com/ninjacom Website: http://www.chris-hendrickson.com Escape Cube (iOS) - Preview Video: https://youtu.be/X7VHpmiCsfo iTunes Games: https://itunes.apple.com/us/developer/chris-hendrickson/id557902223 Global Game Jam 2018 - Unity VR game: https://globalgamejam.org/2018/games/dominoes\nWork history: Skills: .NET Framework, C#, Object Oriented Programming (OOP), Domain-Driven Design (DDD), SQL Server Management Studio, Stored Procedures, Entity Framework (EF) Core, JSON, REST APIs, Postman, XML, Python, Azure Devops, Powershell Scripting, Test Driven Development (TDD), Unit and Integration Testing, Git & Github, ASP.NET MVC, API Development and Testing, Design Patterns | Developed token authorized C# API calls to expose core bank data. Project managed and developed python automations to save employees hundreds of back-office labor hours. Created ETL and API applications with Mulesoft Anypoint Studio. Built and managed CICD pipelines in Azure Devops. | Game Designer, Software Developer, World Traveler, Optimistic Futurist | Pluralsight Continuous Testing with NCrunch | Pluralsight Encapsulation and SOLID',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 1024]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[0.9999, 0.7596, 0.6911],
#         [0.7596, 1.0000, 0.7885],
#         [0.6911, 0.7885, 1.0000]])

<!-- ### Direct Usage (Transformers) <details><summary>Click to see the direct usage in Transformers</summary> </details> --> <!-- ### Downstream Usage (Sentence Transformers) You can finetune this model on your own dataset. <details><summary>Click to expand</summary> </details> --> <!-- ### Out-of-Scope Use *List how the model may foreseeably be misused and address what users ought not to do with the model.* --> <!-- ## Bias, Risks and Limitations *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.* --> <!-- ### Recommendations *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.* -->

Training Details

Training Dataset

Unnamed Dataset

• Size: 2,890 training samples
• Columns: <code>sentence1</code>, <code>sentence2</code>, and <code>score</code>
• Approximate statistics based on the first 100 samples:

  	sentence1	sentence2	score
  type	string	string	float
  modality	text	text
  details	<ul><li>min: 346 tokens</li><li>mean: 687.81 tokens</li><li>max: 1024 tokens</li></ul>	<ul><li>min: 36 tokens</li><li>mean: 229.69 tokens</li><li>max: 448 tokens</li></ul>	<ul><li>min: 0.0</li><li>mean: 0.4</li><li>max: 1.0</li></ul>

• Samples:

  sentence1	sentence2	score
  <code>Search for a candidate for this job: Instruct: Given a job listing, retrieve the most relevant candidate profiles that match the required skills, experience, and role.<br>Query: Title: Head of Security<br>Company: Label Your Data<br>Category: Information Security<br>Skills: Operations (Ops), Security, Information Security<br>Languages: English - B1 - Intermediate, Ukrainian - Native<br>Experience: 3 years experience<br>Employment: FULL_TIME<br>Work format: Full Remote<br>Location: Countries of Europe or Ukraine<br>Domain: Machine Learning / Big Data<br><br>Description:<br>At Label Your Data, we are looking for a Head of Security who will build and lead the company’s dedicated security direction from the ground up.<br> <br>Label Your Data is part of a group of companies with an existing centralized security function. Now, we are establishing a standalone security capability, closely collaborating with the group security team while taking ownership of security operations, processes, and long-term security strategy specifically for ...</code>	<code>Candidate Resume: Title: Computer Engineer (Information Security)<br>Seniority: Middle<br>Location: Washington, District of Columbia<br>Experience: 5-10 years<br><br>Summary: Experienced systems engineering professional with a demonstrated history of success in government and commercial civilian and defense sectors. Skilled in Operations and Engineering Management, Communications Engineering, Cyber Security, System Safety, Computer Science, Software Engineering, and Contract Management. Registered Professional Mechanical Engineer. Strong research professional with a PhD in Information Technology from George Mason University.<br>Work history: Supporting the FAA Information Security Architect in the planning, development and implementation of the information security architecture and development of information security requirements, standards, and architecture for the FAA Next Generation Air Transportation System (NEXTGEN) modernization of America's air transportation system. Perform professional engineer...</code>	<code>0.3333333333333333</code>
  <code>Search for a candidate for this job: Instruct: Given a job listing, retrieve the most relevant candidate profiles that match the required skills, experience, and role.<br>Query: Title: Senior Azure DevOps Engineer (Azure / Kubernetes / Terraform)<br>Company: Hanna Robulets Company<br>Category: DevOps<br>Skills: Operations (Ops), DevOps<br>Languages: English - B2 - Upper Intermediate, Ukrainian - Native<br>Experience: 5 years experience<br>Employment: FULL_TIME<br>Work format: Full Remote<br>Location: Ukraine<br>Domain: Other<br><br>Description:<br>About the Company<br>A global trading and investing platform with 20M+ registered users across Stocks, Crypto, and ETFs is expanding its DevOps organization.<br>The team works on large-scale distributed production systems, infrastructure automation, Kubernetes multi-cluster environments, CI/CD architecture, and reliability engineering. This role is ideal for engineers who enjoy solving real production challenges related to scalability, security, observability, and platform engineering.<br>...</code>	<code>Candidate Resume: Title: Co-Founder Golang Developer<br>Seniority: Middle<br>Languages: English<br>Location: Tehran Province<br>Experience: 0-3 years<br><br>Summary: DevOps Engineer with over 5 years of hands-on experience in CI/CD pipelines, container orchestration (Docker & Kubernetes), infrastructure automation (IaC), and monitoring. Proficient in managing complex production environments using tools like GitLab CI, Rancher, and Prometheus. Founder of GitNegar, a content platform focused on software development. Currently expanding expertise in the Go programming language.<br>Work history: Web Pishgaman is a technology-driven team specializing in web development, mobile app creation, and DevOps infrastructure. We help businesses build reliable, scalable digital products tailored to their needs. Our mission is to deliver modern solutions that empower your digital growth. | Managed Vcenter/ESXi , pfSense , LDAP and Rancher RKE2-based Kubernetes clusters (Dev, Staging, Production) Deployed Ceph (Rook) and M...</code>	<code>0.6666666666666666</code>
  <code>Search for a candidate for this job: Instruct: Given a job listing, retrieve the most relevant candidate profiles that match the required skills, experience, and role.<br>Query: Title: Frontend Engineer (React)<br>Company: borimm.io<br>Category: React.js<br>Skills: Development, JavaScript / Front-End, React.js<br>Languages: English - B1 - Intermediate<br>Experience: 3 years experience<br>Employment: FULL_TIME<br>Work format: Full Remote<br>Location: <br>Domain: Fintech<br><br>Description:<br>We are looking for a Frontend Engineer to help build Fillx, a fintech product focused on crypto market workflows and trading operations.<br><br>You will work on production-facing web interfaces where clarity, performance, and reliability matter. The role is a good fit for someone who enjoys turning complex market data and operational flows into clean, fast, maintainable user experiences.<br><br>Responsibilities:<br>- Build and maintain React + TypeScript web interfaces.<br>- Work with real-time or frequently updated market and trading data.<br>- Design reus...</code>	<code>Candidate Resume: Title: Frontend Developer<br>Seniority: Middle<br>Skills: JavaScript<br>Languages: English, Hindi<br>Location: Chennai, Tamil Nadu<br>Experience: 0-3 years<br><br>Work history: Part of one of the new products that provides WFM (Work Force Management) solutions using dimensions and Dell Boomi integration. | Passionate Full Stack Developer adept at crafting elegant solutions across the entire web development stack. Proficient in React.js, Node.js, Redux, Express</code>	<code>0.3333333333333333</code>

• Loss: <code>CoSENTLoss</code> with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "pairwise_cos_sim"
  }
  

Evaluation Dataset

Unnamed Dataset

• Size: 273 evaluation samples
• Columns: <code>sentence1</code>, <code>sentence2</code>, and <code>score</code>
• Approximate statistics based on the first 100 samples:

  	sentence1	sentence2	score
  type	string	string	float
  modality	text	text
  details	<ul><li>min: 416 tokens</li><li>mean: 716.14 tokens</li><li>max: 1024 tokens</li></ul>	<ul><li>min: 32 tokens</li><li>mean: 191.44 tokens</li><li>max: 463 tokens</li></ul>	<ul><li>min: 0.0</li><li>mean: 0.29</li><li>max: 1.0</li></ul>

• Samples:

  sentence1	sentence2	score
  <code>Search for a candidate for this job: Instruct: Given a job listing, retrieve the most relevant candidate profiles that match the required skills, experience, and role.<br>Query: Title: System Administrator<br>Company: CHRM GROUP<br>Category: Sysadmin<br>Skills: Operations (Ops), Sysadmin<br>Languages: Ukrainian - Native<br>Experience: 1 year experience<br>Employment: FULL_TIME<br>Location: Ukraine<br>Domain: Telecom / Communications<br><br>Description:<br>Працюєш системним адміністратором і шукаєш стабільну офісну роботу з чіткими задачами та перспективою розвитку?<br><br>Запрошуємо System Administrator до команди, яка працює з IT-інфраструктурою <br> <br>У ваш функціонал буде входити:<br> <br>1. Технічна підтримка користувачів: вирішення базових проблем з ПК, друком, мережею, оновленнями та ПЗ.<br>2. Робота з тікет-системою: прийом і виконання заявок (дистанційно та на місці).<br>3. Перевірка справності офісного обладнання: комп’ютери, Wi-Fi, комутатори, периферія.<br>4. Діагностика та блочний ремонт техніки: заміна комплектуючих, перевстановленн...</code>	<code>Candidate Resume: Title: System Integrator<br>Seniority: Middle<br>Skills: Java<br>Languages: English, Arabic, French<br>Location: Egypt<br>Experience: 5-10 years<br><br>Summary: My job will protect the world<br>Work history: Microsoft Maintains computing environment by identifying system requirements; installing upgrades; monitoring system performance Installing/configuring new computers Repairing/upgrading PC hardware and software Maintaining inventory of equipment and supplies (cables, adapters, etc.). install and configure Dns and Dhcp in windows server 2012 Establishes system by planning and executing the selection, installation, configuration, and testing of PC and server hardware, software, LAN networks, and operating and system management systems; defining system and operational policies and procedures deal with hyper-v and Vmware basics Show less</code>	<code>0.3333333333333333</code>
  <code>Search for a candidate for this job: Instruct: Given a job listing, retrieve the most relevant candidate profiles that match the required skills, experience, and role.<br>Query: Title: Senior Backend Python Developer (Django)<br>Company: Kozak Agency<br>Category: Python<br>Skills: Development, Python<br>Languages: English - B2 - Upper Intermediate, Ukrainian - Native<br>Experience: 5 years experience<br>Employment: FULL_TIME<br>Work format: Full Remote<br>Location: <br>Domain: Other<br><br>Description:<br>We’re preferably looking for someone based in Asia, or someone who has already relocated there from Europe.<br>We’re also open to candidates in Europe who are comfortable working night shifts due to the timezone overlap requirements with the client in Australia.<br> <br>Right now we need someone ASAP for a full-time 2-week discovery phase. The key requirement is an early start and at least partial overlap with the client’s working hours.<br>After the discovery phase, the plan is to continue with a long-term full-time engagement, ideal...</code>	<code>Candidate Resume: Title: Senior Software Engineer<br>Seniority: Senior<br>Skills: Python, HTML, Shell, JavaScript<br>Languages: Russian, English, German<br>Location: Berlin<br>Experience: 0-3 years<br><br>Summary: Experienced senior engineer with 7+ years of hands-on development in software…<br>Work history: Backend Python developer | Backend Python developer | Python (Django) / JS developer | Python developer at AG Schwartz, UKB | Writing magic words in a snake language</code>	<code>0.3333333333333333</code>
  <code>Search for a candidate for this job: Instruct: Given a job listing, retrieve the most relevant candidate profiles that match the required skills, experience, and role.<br>Query: Title: Hardware Engineer<br>Company: Reintech<br>Category: Hardware Engineer<br>Skills: Hardware, Hardware Engineer<br>Languages: English - B1 - Intermediate, Ukrainian - Native<br>Experience: 5 years experience<br>Employment: FULL_TIME<br>Location: Ukraine<br>Domain: Other<br><br>Description:<br>As a Hardware Engineer, you will contribute to the development of the most advanced electronic equipment used in the UAV application area. There’s an opportunity to join the exceptionally skilled cross- functional team capable of creating advanced system-level solutions from scratch.<br> <br>Responsibilities:<br>— participation in product and prototype development;<br>— design, develop, and review PCBs and their sub-components;<br>— drive resolution of different technical issues, including those related to architecture (performance, power consumption, thermal behavior)...</code>	<code>Candidate Resume: Title: QA Engineer<br>Seniority: Middle<br>Languages: English, Ukrainian<br>Location: Lviv, Lviv Oblast<br>Experience: 0-3 years<br><br>Summary: I have experience in E2E internal and external testing, security testing, integrations testing, experience in UAT , communication with vendor, stories and defects testing, regression testing, finding design gaps , creating defects and test cases, experience in studying colleagues in India (knowledge transfer). Also B2 – C1 level of English (upper intermediate), good knowledge of SQL. SOAP UI– intermediate , Postman – intermediate, SQL developer – intermediate, Excel – intermediate, Advanced – MS Word , Atlassian Jira – intermediate, working with browser console – intermediate, win scp – intermediate, Putty - intermediate .<br>Work history: Coursera Interactivity with JavaScript | Coursera Course Certificates Introduction to CSS3 | Coursera Course Certificates Introduction to HTML5</code>	<code>0.3333333333333333</code>

• Loss: <code>CoSENTLoss</code> with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "pairwise_cos_sim"
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• num_train_epochs: 4
• learning_rate: 2e-05
• warmup_steps: 0.1
• gradient_accumulation_steps: 4
• bf16: True
• tf32: True
• per_device_eval_batch_size: 4

All Hyperparameters

<details><summary>Click to expand</summary>

• per_device_train_batch_size: 8
• num_train_epochs: 4
• max_steps: -1
• learning_rate: 2e-05
• lr_scheduler_type: linear
• lr_scheduler_kwargs: None
• warmup_steps: 0.1
• optim: adamw_torch_fused
• optim_args: None
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• optim_target_modules: None
• gradient_accumulation_steps: 4
• average_tokens_across_devices: True
• max_grad_norm: 1.0
• label_smoothing_factor: 0.0
• bf16: True
• fp16: False
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: True
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• use_liger_kernel: False
• liger_kernel_config: None
• use_cache: False
• neftune_noise_alpha: None
• torch_empty_cache_steps: None
• auto_find_batch_size: False
• log_on_each_node: True
• logging_nan_inf_filter: True
• include_num_input_tokens_seen: no
• log_level: passive
• log_level_replica: warning
• disable_tqdm: False
• project: huggingface
• trackio_space_id: None
• trackio_bucket_id: None
• trackio_static_space_id: None
• per_device_eval_batch_size: 4
• prediction_loss_only: True
• eval_on_start: False
• eval_do_concat_batches: True
• eval_use_gather_object: False
• eval_accumulation_steps: None
• include_for_metrics: []
• batch_eval_metrics: False
• save_only_model: False
• save_on_each_node: False
• enable_jit_checkpoint: False
• push_to_hub: False
• hub_private_repo: None
• hub_model_id: None
• hub_strategy: every_save
• hub_always_push: False
• hub_revision: None
• load_best_model_at_end: False
• ignore_data_skip: False
• restore_callback_states_from_checkpoint: False
• full_determinism: False
• seed: 42
• data_seed: None
• use_cpu: False
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• dataloader_prefetch_factor: None
• remove_unused_columns: True
• label_names: None
• train_sampling_strategy: random
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• ddp_static_graph: None
• ddp_backend: None
• ddp_timeout: 1800
• fsdp: None
• fsdp_config: None
• deepspeed: None
• debug: []
• skip_memory_metrics: True
• do_predict: False
• resume_from_checkpoint: None
• warmup_ratio: None
• local_rank: -1
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

</details>

Training Logs

Training Time

• Training: 15.7 minutes

Framework Versions

• Python: 3.12.13
• Sentence Transformers: 5.6.0
• Transformers: 5.12.1
• PyTorch: 2.11.0+cu128
• Accelerate: 1.14.0
• Datasets: 4.0.0
• Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

CoSENTLoss

@article{10531646,
    author={Huang, Xiang and Peng, Hao and Zou, Dongcheng and Liu, Zhiwei and Li, Jianxin and Liu, Kay and Wu, Jia and Su, Jianlin and Yu, Philip S.},
    journal={IEEE/ACM Transactions on Audio, Speech, and Language Processing},
    title={CoSENT: Consistent Sentence Embedding via Similarity Ranking},
    year={2024},
    doi={10.1109/TASLP.2024.3402087}
}

<!-- ## Glossary *Clearly define terms in order to be accessible across audiences.* --> <!-- ## Model Card Authors *Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.* --> <!-- ## Model Card Contact *Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.* -->