roberta-base-reranker-llm-weaklabels-v1

CrossEncoder based on FacebookAI/roberta-base

This is a Cross Encoder model finetuned from FacebookAI/roberta-base on the weak-labels-wiki dataset using the sentence-transformers library. It computes scores for pairs of texts, which can be used for text reranking and semantic search.

Model Details

Model Description

• Model Type: Cross Encoder
• Base model: FacebookAI/roberta-base <!-- at revision e2da8e2f811d1448a5b465c236feacd80ffbac7b -->
• Maximum Sequence Length: 384 tokens
• Number of Output Labels: 1 label
• Training Dataset:
  • weak-labels-wiki

<!-- - **Language:** Unknown --> <!-- - **License:** Unknown -->

Model Sources

• Documentation: Sentence Transformers Documentation
• Documentation: Cross Encoder Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Cross Encoders on Hugging Face

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import CrossEncoder

# Download from the 🤗 Hub
model = CrossEncoder("cross_encoder_model_id")
# Get scores for pairs of texts
pairs = [
    ['q247925', 'linux__Watchdog_timer_P0020'],
    ['q216149', 'smartphones__Samsung_Galaxy_Z_Flip_P0003'],
    ['q174658', 'great_depression__Great_Depression_P0184'],
    ['q062615', 'barack_obama__2008_Democratic_Party_vice_presidential_candidate_selection_P0000'],
    ['q054198', 'donald_trump__Business_projects_of_Donald_Trump_in_Russia_P0007'],
]
scores = model.predict(pairs)
print(scores.shape)
# (5,)

# Or rank different texts based on similarity to a single text
ranks = model.rank(
    'q247925',
    [
        'linux__Watchdog_timer_P0020',
        'smartphones__Samsung_Galaxy_Z_Flip_P0003',
        'great_depression__Great_Depression_P0184',
        'barack_obama__2008_Democratic_Party_vice_presidential_candidate_selection_P0000',
        'donald_trump__Business_projects_of_Donald_Trump_in_Russia_P0007',
    ]
)
# [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]

<!-- ### Direct Usage (Transformers) <details><summary>Click to see the direct usage in Transformers</summary> </details> --> <!-- ### Downstream Usage (Sentence Transformers) You can finetune this model on your own dataset. <details><summary>Click to expand</summary> </details> --> <!-- ### Out-of-Scope Use *List how the model may foreseeably be misused and address what users ought not to do with the model.* --> <!-- ## Bias, Risks and Limitations *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.* --> <!-- ### Recommendations *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.* -->

Training Details

Training Dataset

weak-labels-wiki

• Dataset: weak-labels-wiki at a064a52
• Size: 2,152,512 training samples
• Columns: <code>query_id</code>, <code>pos_doc_id</code>, <code>neg_doc_id</code>, <code>neg_kind</code>, <code>sentence_0_input_ids</code>, <code>sentence_0_attention_mask</code>, <code>sentence_1_input_ids</code>, and <code>sentence_1_attention_mask</code>
• Approximate statistics based on the first 1000 samples:

  	query_id	pos_doc_id	neg_doc_id	neg_kind	sentence_0_input_ids	sentence_0_attention_mask	sentence_1_input_ids	sentence_1_attention_mask
  type	string	string	string	string	torch.Tensor	torch.Tensor	torch.Tensor	torch.Tensor
  details	<ul><li>min: 7 characters</li><li>mean: 7.0 characters</li><li>max: 7 characters</li></ul>	<ul><li>min: 17 characters</li><li>mean: 38.6 characters</li><li>max: 82 characters</li></ul>	<ul><li>min: 17 characters</li><li>mean: 40.08 characters</li><li>max: 86 characters</li></ul>	<ul><li>min: 4 characters</li><li>mean: 4.0 characters</li><li>max: 4 characters</li></ul>	<ul><li></li></ul>	<ul><li></li></ul>	<ul><li></li></ul>	<ul><li></li></ul>

• Samples:

  query_id	pos_doc_id	neg_doc_id	neg_kind	sentence_0_input_ids	sentence_0_attention_mask	sentence_1_input_ids	sentence_1_attention_mask
  <code>q187533</code>	<code>deep_learning__Deep_Learning_Super_Sampling_P0000</code>	<code>deep_learning__Neural_processing_unit_P0000</code>	<code>hard</code>	<code>tensor([ 0, 35166, 2239, 18520, 998, 2, 2, 35166, 13807, 1582,<br> 1960, 20418, 36, 26109, 8108, 43, 16, 10, 10606, 9,<br> 588, 12, 958, 1844, 2239, 2274, 25387, 8, 62, 3866,<br> 8279, 4233, 2226, 30, 18520, 14, 32, 577, 11, 10,<br> 346, 9, 569, 426, 4, 20, 724, 9, 209, 4233,<br> 16, 7, 1157, 5, 1647, 9, 5, 12774, 4116, 7,<br> 422, 23, 10, 795, 3547, 13, 1130, 819, 6, 8,<br> 172, 40182, 10, 723, 3547, 2274, 31, 42, 14, 36612,<br> 34129, 5, 276, 672, 9, 4617, 25, 114, 5, 2274,<br> 56, 57, 18728, 23, 42, 723, 3547, 4, 152, 2386,<br> 13, 723, 41806, 9629, 8, 73, 368, 5120, 1162, 13,<br> 10, 576, 4195, 3547, 6, 6122, 15, 3018, 12832, 4,<br> 404, 6808, 9, 13925, 8108, 32, 577, 15, 70, 40810,<br> 12, 20417, 3591, 31, 18520, 11, 2800, 4867, 4, 635,<br> 6, 5, 37280, 17362, 1905, 16, 129, 2800, 15, 843,<br> 651, 37658, 50, 13964, 8, 19268, 37280, 17362, 16, 129,<br> 577, 15, 654, 651, 37658, 4, 45994, 7298, 45994, 18520,<br> 20454, 13925, 8108, 25, 10, 762, 1905, 9, 5, 36988,<br> 291, 651, 3591, 77, 51, 1660, 11, 772, 199, 4,<br> 497, 2, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1])</code>	<code>tensor([1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0])</code>	<code>tensor([ 0, 35166, 2239, 18520, 998, 2, 2, 250, 26739, 5774,<br> 1933, 36, 487, 16821, 238, 67, 684, 25, 4687, 31463,<br> 50, 1844, 2239, 10655, 6, 16, 10, 1380, 9, 14120,<br> 6554, 31463, 50, 3034, 467, 1887, 7, 10107, 7350, 2316,<br> 36, 15238, 43, 8, 3563, 2239, 2975, 6, 217, 7350,<br> 26739, 4836, 8, 3034, 3360, 4, 45994, 7627, 45994, 2667,<br> 3508, 16, 1169, 7, 14146, 11189, 416, 5389, 4687, 3092,<br> 36, 179, 23861, 43, 50, 7, 2341, 4687, 3092, 4,<br> 2667, 2975, 680, 16964, 13, 20721, 6, 3742, 9, 383,<br> 6, 8, 414, 12, 28447, 50, 9626, 12, 9756, 8558,<br> 4, 252, 32, 747, 171, 7293, 50, 34999, 7191, 8,<br> 1056, 15, 614, 12, 5234, 37938, 43585, 6, 5808, 414,<br> 19322, 41885, 6, 50, 11, 12, 44290, 11730, 9388, 4,<br> 287, 9, 15294, 6, 10, 3924, 341, 13516, 1043, 11798,<br> 12, 8425, 4687, 6818, 9326, 6638, 6, 5, 18520, 289,<br> 1866, 22794, 6, 6308, 7281, 9, 6685, 9, 256, 3196,<br> 597, 3935, 29, 4, 47408, 7653, 2110, 47408, 4687, 27416,<br> 3629, 32, 341, 11, 1830, 2110, 215, 25, 1257, 14825,<br> 6, 15297, 4687, 8186, 11, 13854, 337, 8, 234, 16821,<br> 29, 6, 8820, 6, 8, 1204, 11699, 7466, 6, 8,<br> 450, 11, 171, 1257, 28630, 6, 10805, 6, 3797, 6,<br> 8, 1204, 255, 35354, 4368, 17852, 4, 243, 16, 55,<br> 682, 36, 31362, 102, 8157, 43, 2, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1])</code>	<code>tensor([1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])</code>
  <code>q248783</code>	<code>linux__64-bit_computing_P0061</code>	<code>linux__Microkernel_P0009</code>	<code>hard</code>	<code>tensor([ 0, 11828, 1322, 15826, 8, 32469, 13, 709, 6216, 2,<br> 2, 1990, 32469, 40, 422, 15, 167, 1743, 4, 20,<br> 2107, 12, 5881, 7952, 9, 18146, 33, 57, 2928, 30,<br> 1257, 11, 32469, 19963, 1243, 36, 698, 4, 996, 322,<br> 15826, 8, 144, 97, 47093, 12, 3341, 1633, 1743, 6,<br> 8, 5, 230, 8, 230, 42964, 3944, 42433, 13, 106,<br> 6, 33, 2800, 4430, 12, 5881, 17852, 13, 171, 107,<br> 4, 1876, 2975, 8, 18146, 13, 167, 4818, 32, 490,<br> 12, 17747, 2257, 6, 1982, 11, 230, 8, 230, 42964,<br> 6, 98, 14, 114, 51, 32, 4430, 12, 5881, 12,<br> 22725, 6, 51, 64, 28, 11603, 88, 4430, 12, 5881,<br> 7952, 4, 152, 1300, 12, 805, 3854, 1421, 6, 19,<br> 41, 9723, 15, 7690, 8255, 6, 817, 7265, 9, 2502,<br> 2257, 13, 167, 1633, 1743, 540, 9, 41, 696, 4,<br> 45994, 4430, 12, 5881, 414, 3092, 45994, 96, 2107, 12,<br> 5881, 1767, 6, 39715, 8, 414, 3505, 215, 25, 49074,<br> 3489, 33, 5, 276, 5933, 4, 152, 16, 45, 4784,<br> 1528, 15, 4430, 12, 5881, 6271, 4, 16038, 154, 414,<br> 3505, 11, 8326, 11991, 215, 25, 230, 8, 63, 29285,<br> 215, 25, 230, 42964, 8, 44676, 12, 347, 189, 4634,<br> 173, 15, 2107, 12, 5881, 42993, 53, 45, 15, 4430,<br> 12, 5881, 42993, 4, 96, 171, 8326, 11534, 13, 230,<br> 8, 230, 12, 38871, 11991, 15, 2, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1])</code>	<code>tensor([1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])</code>	<code>tensor([ 0, 11828, 1322, 15826, 8, 32469, 13, 709, 6216, 2,<br> 2, 11802, 12, 8056, 9439, 34751, 1170, 56, 1249, 6,<br> 1712, 1257, 18, 32469, 6, 703, 11, 5155, 6, 202,<br> 2939, 10, 9284, 34751, 373, 1577, 487, 791, 6, 61,<br> 15678, 10, 4008, 10639, 36, 11108, 21676, 43, 8192, 597,<br> 73, 134, 18, 9439, 34751, 36, 3196, 597, 20149, 262,<br> 4, 246, 34751, 43, 19, 3260, 31, 163, 6243, 2604,<br> 9482, 6, 8, 42, 34751, 16, 67, 341, 11, 6894,<br> 6, 30016, 3196, 6, 8, 1183, 3196, 4, 6039, 19815,<br> 6, 1158, 19, 19815, 155, 4, 134, 8, 3348, 19,<br> 6039, 365, 6, 2939, 10, 9284, 34751, 1521, 4, 287,<br> 9, 1125, 6, 5, 9439, 12, 805, 45928, 289, 6831,<br> 16, 67, 12628, 8, 1165, 11, 3044, 7952, 9, 10832,<br> 15826, 8, 45534, 4, 2223, 538, 173, 15, 5177, 330,<br> 47909, 56, 2743, 1249, 6, 9280, 268, 1143, 709, 4,<br> 8630, 10, 55, 26794, 1548, 7, 5, 936, 6, 217,<br> 6559, 3260, 8, 13304, 15, 5, 10655, 7, 10914, 14198,<br> 6329, 2800, 11, 2257, 669, 7, 10, 92, 651, 9,<br> 5177, 330, 47909, 19, 8617, 2782, 819, 4, 10719, 330,<br> 47909, 32, 3615, 1330, 7, 1931, 1638, 47909, 4, 252,<br> 67, 33, 203, 11, 1537, 19, 8944, 22074, 6, 53,<br> 5, 5442, 146, 117, 2026, 7, 15970, 6948, 8, 32,<br> 14120, 7, 3117, 6229, 6271, 131, 5, 226, 306, 2,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1])</code>	<code>tensor([1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])</code>
  <code>q091993</code>	<code>youtube__Amazon_Prime_Video_P0005</code>	<code>napoleon__Horrible_Histories__2009_TV_series__P0063</code>	<code>hard</code>	<code>tensor([ 0, 10836, 38, 4016, 10, 623, 1771, 3082, 6717, 15,<br> 1645, 1489, 116, 2, 2, 43232, 6, 10005, 5331, 8,<br> 10804, 14735, 7, 5, 1489, 26596, 5338, 544, 4, 374,<br> 392, 883, 6, 1125, 6, 1645, 12680, 19, 1569, 4535,<br> 22299, 12290, 7, 4615, 2213, 9, 4133, 15, 5, 544,<br> 4, 374, 502, 508, 6, 1125, 6, 1645, 585, 10,<br> 432, 19, 5768, 12, 20439, 16541, 12, 448, 19777, 7,<br> 4615, 4133, 8, 2384, 924, 15, 5, 1489, 26596, 5338,<br> 544, 4, 374, 550, 291, 6, 1125, 6, 1645, 585,<br> 10, 432, 19, 6123, 11712, 4, 10276, 7, 4615, 80,<br> 924, 20, 580, 11384, 8, 4967, 18174, 8992, 15, 1489,<br> 26596, 5338, 4, 374, 772, 204, 6, 1125, 6, 1645,<br> 1419, 10, 432, 19, 582, 12, 859, 41605, 4238, 14230,<br> 3181, 36, 8310, 684, 25, 20405, 2744, 8, 187, 494,<br> 8157, 2164, 30, 1645, 1495, 43, 7, 1905, 4133, 15,<br> 49, 5230, 544, 6, 11, 10, 517, 7, 3429, 49,<br> 11439, 3909, 4, 374, 719, 601, 6, 1125, 6, 1645,<br> 585, 10, 432, 19, 6980, 13610, 5149, 7, 4615, 80,<br> 924, 31, 27848, 6, 20, 2893, 19780, 8, 35647, 39191,<br> 4, 96, 644, 1014, 6, 1645, 1419, 10, 432, 19,<br> 83, 2744, 717, 14641, 7, 4615, 924, 31, 5, 83,<br> 947, 717, 6, 20, 6479, 10486, 5331, 6, 2, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1])</code>	<code>tensor([1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])</code>	<code>tensor([ 0, 10836, 38, 4016, 10, 623, 1771, 3082, 6717, 15,<br> 1645, 1489, 116, 2, 2, 12338, 990, 1089, 408, 18,<br> 1012, 651, 6, 8, 21, 4173, 23, 440, 4, 290,<br> 11, 10, 1122, 3107, 654, 889, 2633, 423, 5, 276,<br> 76, 30, 5331, 4934, 4, 45994, 19888, 8, 804, 8255,<br> 45994, 404, 292, 651, 9, 5, 1461, 311, 6, 2704,<br> 5, 22, 12645, 1766, 36, 725, 42032, 43, 3672, 1297,<br> 22, 500, 808, 636, 19631, 39164, 113, 359, 5, 22,<br> 597, 4070, 2650, 1234, 623, 1771, 3672, 113, 8, 22,<br> 39389, 24786, 1619, 113, 33, 57, 703, 15, 6131, 132,<br> 19888, 30, 132, 1342, 23801, 13, 5, 3295, 6, 258,<br> 15529, 8, 25, 35657, 3880, 4, 22, 39389, 24786, 31862,<br> 9023, 108, 1776, 10772, 1643, 113, 359, 5, 22, 19451,<br> 3672, 113, 33, 648, 7, 1325, 10, 184, 569, 800,<br> 4, 4028, 651, 6, 25, 157, 25, 5, 22, 12645,<br> 1766, 3672, 113, 8, 22, 19451, 3672, 1297, 32, 67,<br> 577, 13, 4016, 31, 5, 987, 14734, 1400, 4, 287,<br> 9, 902, 777, 6, 70, 7585, 31, 3265, 112, 2383,<br> 246, 58, 577, 13, 4016, 7, 470, 7768, 15, 1645,<br> 4, 175, 22, 47193, 5338, 113, 544, 4, 45994, 26317,<br> 12, 10816, 45994, 96, 1466, 6, 10, 6287, 1529, 177,<br> 311, 6, 6746, 24786, 31862, 9023, 35, 272, 4405, 3100,<br> 6, 21, 1660, 15, 6933, 3573, 4, 21371, 9212, 44953,<br> 7618, 30, 14399, 1012, 8, 7801, 14888, 6, 5, 311,<br> 21, 1029, 12, 11438, 196, 2, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1])</code>	<code>tensor([1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])</code>

• Loss: <code>main.PairwiseMarginLoss</code>

Evaluation Dataset

weak-labels-wiki

• Dataset: weak-labels-wiki at a064a52
• Size: 21,743 evaluation samples
• Columns: <code>query_id</code>, <code>pos_doc_id</code>, <code>neg_doc_id</code>, <code>neg_kind</code>, <code>sentence_0_input_ids</code>, <code>sentence_0_attention_mask</code>, <code>sentence_1_input_ids</code>, and <code>sentence_1_attention_mask</code>
• Approximate statistics based on the first 1000 samples:

  	query_id	pos_doc_id	neg_doc_id	neg_kind	sentence_0_input_ids	sentence_0_attention_mask	sentence_1_input_ids	sentence_1_attention_mask
  type	string	string	string	string	torch.Tensor	torch.Tensor	torch.Tensor	torch.Tensor
  details	<ul><li>min: 7 characters</li><li>mean: 7.0 characters</li><li>max: 7 characters</li></ul>	<ul><li>min: 17 characters</li><li>mean: 39.17 characters</li><li>max: 107 characters</li></ul>	<ul><li>min: 17 characters</li><li>mean: 40.11 characters</li><li>max: 113 characters</li></ul>	<ul><li>min: 4 characters</li><li>mean: 4.0 characters</li><li>max: 4 characters</li></ul>	<ul><li></li></ul>	<ul><li></li></ul>	<ul><li></li></ul>	<ul><li></li></ul>

• Samples:

  query_id	pos_doc_id	neg_doc_id	neg_kind	sentence_0_input_ids	sentence_0_attention_mask	sentence_1_input_ids	sentence_1_attention_mask
  <code>q247925</code>	<code>linux__Watchdog_timer_P0020</code>	<code>linux__Dd__Unix__P0017</code>	<code>hard</code>	<code>tensor([ 0, 6179, 473, 15826, 3679, 467, 12328, 8, 414, 2752,<br> 2, 2, 179, 5, 403, 9, 5, 15826, 1633, 467,<br> 6, 10, 3018, 12, 25414, 10707, 48448, 189, 1622, 3151,<br> 5, 10707, 27405, 396, 4655, 143, 3457, 4, 287, 251,<br> 25, 5, 48448, 1237, 6329, 6, 5, 467, 40, 28,<br> 4371, 136, 1473, 467, 12328, 215, 25, 10, 34751, 9810,<br> 4, 598, 10933, 540, 3814, 28853, 6, 5, 48448, 64,<br> 3008, 3457, 14, 1719, 1337, 5894, 9, 5, 467, 1881,<br> 6, 217, 5799, 7265, 36, 242, 4, 571, 482, 3783,<br> 6, 2870, 14617, 6, 21032, 86, 238, 1283, 9, 421,<br> 609, 1940, 36, 242, 4, 571, 482, 467, 2955, 991,<br> 1790, 878, 6, 2167, 6773, 145, 1455, 50, 4752, 238,<br> 27169, 1295, 6, 8, 1546, 1940, 4, 12630, 6953, 9,<br> 10, 1447, 1296, 6, 5, 3034, 189, 2120, 7, 3008,<br> 10, 13931, 9, 31378, 2163, 223, 2257, 797, 6, 29681,<br> 19, 10, 2257, 12, 179, 4933, 1070, 18660, 4, 318,<br> 5, 2257, 10578, 7, 32550, 10, 18660, 6, 5, 6554,<br> 10707, 35809, 93, 114, 577, 93, 40, 25386, 8, 32550,<br> 10, 6554, 18821, 4, 96, 1683, 6, 42, 16, 10,<br> 7268, 661, 1580, 10707, 35809, 11, 61, 5, 2257, 16755,<br> 5, 78, 8, 5, 6554, 305, 23858, 5, 507, 1289,<br> 4, 96, 2, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1])</code>	<code>tensor([1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0])</code>	<code>tensor([ 0, 6179, 473, 15826, 3679, 467, 12328, 8, 414, 2752,<br> 2, 2, 241, 397, 4086, 4, 13021, 543, 21675, 6790,<br> 5585, 10, 27443, 4594, 3175, 5936, 1887, 7, 13140, 8,<br> 31328, 24300, 358, 6500, 8, 34949, 4745, 9, 10, 1305,<br> 4, 85, 189, 67, 173, 13, 103, 2705, 12, 4897,<br> 6790, 36, 39837, 6790, 322, 287, 9, 193, 6, 24,<br> 473, 45, 173, 15, 10478, 7462, 6790, 3486, 15, 27443,<br> 6282, 7462, 6180, 4, 520, 577, 6, 42, 16, 258,<br> 3845, 87, 634, 47821, 6, 8, 55, 2823, 4, 374,<br> 15826, 6271, 24, 16, 6500, 1241, 5, 1368, 43923, 4526,<br> 5936, 18, 480, 15506, 12, 254, 3175, 12, 15477, 16325,<br> 1973, 4, 20, 27373, 586, 1523, 1533, 42674, 39651, 6,<br> 25, 157, 25, 55, 2823, 43762, 9, 1736, 6773, 4,<br> 47408, 5423, 2752, 47408, 5423, 2752, 6890, 2600, 31, 10,<br> 1305, 19, 103, 1667, 2905, 34949, 4, 20, 5936, 16,<br> 10, 205, 2564, 19, 42, 633, 19, 63, 9538, 26756,<br> 36, 42876, 43, 8, 97, 614, 12, 4483, 9629, 4,<br> 20, 21857, 47821, 6, 959, 6, 16, 38734, 7, 304,<br> 25, 5, 3018, 34, 7, 1166, 5, 5849, 3731, 8,<br> 24704, 15756, 5, 3806, 14, 64, 28, 1166, 4, 20,<br> 881, 1803, 1836, 67, 4971, 5, 17227, 42664, 9, 5,<br> 2, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1])</code>	<code>tensor([1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])</code>
  <code>q216149</code>	<code>smartphones__Samsung_Galaxy_Z_Flip_P0003</code>	<code>smartphones__Samsung_Galaxy_Z_Fold_4_P0000</code>	<code>hard</code>	<code>tensor([ 0, 23242, 1851, 5, 806, 639, 14789, 868, 7466, 2,<br> 2, 5632, 10, 4136, 10490, 1122, 7, 5, 5325, 41303,<br> 6, 13918, 30, 3797, 19, 3183, 31, 1811, 5229, 5680,<br> 6, 61, 16, 22, 25617, 634, 41, 18420, 4945, 609,<br> 7, 6292, 63, 8243, 8, 28327, 1297, 8, 22993, 19,<br> 10, 22, 19423, 1468, 62, 7, 41, 15120, 5581, 7,<br> 3042, 10, 4292, 46743, 25718, 9164, 12627, 4699, 10352, 16,<br> 341, 13, 5, 124, 9217, 4, 20, 525, 14782, 16,<br> 5, 78, 14789, 868, 4368, 7, 304, 10, 4049, 2332,<br> 6, 150, 986, 14789, 868, 4247, 215, 25, 5, 23034,<br> 21965, 338, 8, 5, 5325, 41303, 33, 341, 4136, 8612,<br> 4, 8630, 10, 4049, 2332, 775, 11, 10, 55, 18300,<br> 2441, 6, 8, 13458, 5, 2441, 8633, 3175, 11, 5,<br> 29556, 477, 4, 20, 33503, 9562, 16, 13813, 19, 38874,<br> 32902, 1887, 7, 489, 8402, 66, 131, 3797, 5211, 5,<br> 14789, 9562, 25, 3117, 62, 7, 1878, 6, 151, 2939,<br> 4, 20, 2187, 606, 11, 155, 8089, 13, 5, 20066,<br> 1732, 61, 32, 15187, 21706, 6, 15187, 1378, 8, 15187,<br> 2610, 4, 85, 67, 606, 11, 132, 8089, 13, 5,<br> 195, 534, 1732, 61, 32, 42929, 2, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1])</code>	<code>tensor([1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])</code>	<code>tensor([ 0, 23242, 1851, 5, 806, 639, 14789, 868, 7466, 2,<br> 2, 133, 3797, 5325, 525, 41303, 204, 36, 620, 4360,<br> 1538, 25, 3797, 5325, 525, 41303, 306, 6, 1088, 25,<br> 3797, 5325, 41303, 204, 11, 1402, 13560, 43, 16, 10,<br> 14789, 868, 4368, 14, 16, 233, 9, 5, 3797, 5325,<br> 525, 651, 4, 85, 21, 585, 23, 5, 830, 8157,<br> 5403, 9, 5325, 1890, 21330, 2863, 5, 5325, 525, 14782,<br> 204, 4, 85, 21, 703, 8960, 15, 830, 564, 6,<br> 8157, 6, 25, 5, 10359, 7, 5, 5325, 525, 41303,<br> 155, 4, 45994, 38212, 45994, 47408, 7438, 47408, 20, 525,<br> 41303, 204, 18, 15705, 2332, 8, 124, 2798, 304, 12627,<br> 4699, 10352, 41269, 687, 30787, 11187, 5, 14789, 868, 8725,<br> 2332, 16, 156, 9, 3797, 18, 14101, 22, 45611, 12,<br> 11329, 179, 10352, 113, 19, 80, 11775, 21817, 4136, 13171,<br> 4631, 24, 6, 5, 299, 9, 61, 16, 10, 3190,<br> 868, 2441, 32747, 4, 20, 525, 41303, 204, 34, 41,<br> 6442, 1000, 398, 21691, 5224, 2591, 691, 13, 514, 5910,<br> 6, 19, 8402, 5910, 45, 145, 5211, 4, 20, 15705,<br> 5120, 16, 11236, 31, 9757, 6, 22472, 25, 128, 47936,<br> 37280, 108, 30, 3797, 4, 20, 3797, 5325, 525, 41303,<br> 204, 16, 577, 11, 237, 8089, 35, 30099, 2, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1])</code>	<code>tensor([1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])</code>
  <code>q174658</code>	<code>great_depression__Great_Depression_P0184</code>	<code>great_depression__The_Great_Depression__America__1929_1941_P0003</code>	<code>hard</code>	<code>tensor([ 0, 19065, 23384, 5984, 1915, 998, 2, 2, 38261, 9,<br> 1005, 6, 37708, 2383, 1646, 3416, 36, 43587, 43, 47408,<br> 315, 532, 8, 896, 47408, 8639, 7864, 6, 6227, 4,<br> 15387, 11, 5, 2933, 4832, 10, 4106, 750, 9, 5,<br> 2860, 23384, 36, 23301, 43, 804, 10310, 154, 5, 25900,<br> 1554, 35, 26476, 8, 33262, 9, 5, 1505, 33967, 13,<br> 25900, 15773, 4011, 4, 6056, 4, 26873, 2383, 1646, 3079,<br> 4, 504, 33505, 19553, 36, 134, 2233, 322, 497, 5,<br> 6338, 26844, 9, 663, 6, 589, 9, 663, 40071, 3672,<br> 42121, 4, 4537, 15571, 3432, 6, 610, 12394, 6, 20,<br> 2860, 30522, 6, 32638, 36, 1646, 4283, 238, 1406, 804,<br> 2610, 6712, 6, 1738, 6, 20, 2860, 23384, 35, 20,<br> 315, 532, 11, 5, 2032, 9211, 918, 36, 44808, 43,<br> 5076, 6, 871, 6, 7978, 31, 18019, 35, 20, 470,<br> 1806, 11, 23384, 8, 1771, 6, 32638, 12, 45391, 36,<br> 17472, 43, 1509, 14563, 4468, 6, 2668, 6, 8, 2431,<br> 20582, 4, 20, 2860, 23384, 32638, 2383, 1646, 3170, 36,<br> 46207, 154, 121, 4, 104, 4, 7298, 43, 36, 24789,<br> 43, 804, 6, 13, 1692, 1304, 4, 5275, 6, 8397,<br> 687, 4, 23384, 1502, 1829, 35, 1740, 188, 24636, 149,<br> 188, 10979, 6, 32638, 2383, 1646, 4006, 36, 1646, 3706,<br> 238, 204, 5379, 33906, 482, 10675, 1953, 9, 5, 121,<br> 4, 104, 4, 866, 804, 1223, 354, 6, 9317, 83,<br> 4, 20, 2860, 23384, 8, 5, 188, 10979, 4832, 730,<br> 18, 866, 11, 1486, 36, 22748, 43, 13, 5929, 1304,<br> 4, 804, 11881, 9063, 6, 83, 4, 381, 4, 20,<br> 1563, 2, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1])</code>	<code>tensor([1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0])</code>	<code>tensor([ 0, 19065, 23384, 5984, 1915, 998, 2, 2, 42425, 49,<br> 1503, 7, 17800, 50, 5, 188, 10979, 6, 1509, 717,<br> 25091, 5193, 1523, 10, 9893, 1217, 9, 5, 2860, 23384,<br> 8, 63, 913, 578, 261, 390, 25, 157, 25, 604,<br> 6, 909, 25, 157, 25, 1104, 6, 15, 1406, 2040,<br> 6, 941, 5, 822, 6, 8, 6, 144, 524, 5881,<br> 9997, 6, 15, 470, 3266, 72, 2090, 2852, 373, 5,<br> 1040, 22, 415, 683, 10, 10675, 173, 9, 10560, 6,<br> 10, 20902, 527, 6, 8, 10, 2200, 1461, 11930, 9,<br> 1966, 14, 34, 10, 205, 432, 9, 8708, 21623, 72,<br> 20, 1040, 21, 566, 5, 78, 7, 304, 1406, 2040,<br> 6, 941, 822, 6, 25, 41, 505, 5799, 11, 2969,<br> 5, 6711, 9, 10, 86, 4, 20, 1040, 34, 4711,<br> 5861, 11, 5780, 187, 63, 5362, 4, 83, 200, 5403,<br> 21, 1027, 11, 9095, 6, 24634, 8231, 19, 5, 799,<br> 12, 7755, 24098, 2384, 651, 6, 20, 2860, 23384, 6,<br> 13, 61, 42, 1040, 21, 10, 538, 5799, 4, 83,<br> 564, 212, 12, 2279, 42797, 5403, 6, 19, 10, 5145,<br> 92, 7740, 12818, 5, 4215, 981, 62, 7, 5, 613,<br> 6277, 9, 2266, 19, 167, 11, 5, 18283, 29, 14,<br> 669, 7, 5, 2860, 2, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1])</code>	<code>tensor([1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,<br> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,<br> 0, 0])</code>

• Loss: <code>main.PairwiseMarginLoss</code>

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 290
• per_device_eval_batch_size: 128
• learning_rate: 1e-05
• weight_decay: 0.02
• max_grad_norm: 0.5
• num_train_epochs: 10.0
• lr_scheduler_type: cosine
• warmup_ratio: 0.03
• bf16: True
• dataloader_num_workers: 6
• remove_unused_columns: False
• load_best_model_at_end: True
• optim: adamw_torch
• dataloader_persistent_workers: True

All Hyperparameters

<details><summary>Click to expand</summary>

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: steps
• prediction_loss_only: True
• per_device_train_batch_size: 290
• per_device_eval_batch_size: 128
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 1e-05
• weight_decay: 0.02
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 0.5
• num_train_epochs: 10.0
• max_steps: -1
• lr_scheduler_type: cosine
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.03
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• bf16: True
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 6
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: False
• label_names: None
• load_best_model_at_end: True
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• project: huggingface
• trackio_space_id: trackio
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: True
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: None
• hub_always_push: False
• hub_revision: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• include_for_metrics: []
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: no
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• liger_kernel_config: None
• eval_use_gather_object: False
• average_tokens_across_devices: True
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

</details>

Training Logs

<details><summary>Click to expand</summary>

The model card is truncated. Read the rest on Hugging Face.