Downloads · 30 days
81
18% of all-time downloads
Ryze-Embed-4
Fulcrum-AI/Ryze-Embed-4
Ryze-Embed-4 is a sentence similarity model from Fulcrum-AI. Use it when you need a score for how close two texts are. It is set up for transformers. The card lists the license as apache-2.0.
This is a merge of pre-trained language models created using mergekit.
All-time downloads
438
Public
Parameters
5.1B
16.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Task
- Sentence Similarity
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Aug 10, 2024
- Updated
- Aug 10, 2024
- SHA
- e98e14ff
Base models
Model card
From the Hugging Face model README
merged
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the passthrough merge method.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
dtype: bfloat16
merge_method: passthrough
slices:
- sources:
- layer_range: [0, 6]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [3, 9]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [6, 12]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [9, 15]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [12, 18]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [15, 21]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [18, 24]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [21, 27]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [24, 30]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [27, 33]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [30, 36]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [33, 39]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [36, 42]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [39, 45]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [42, 48]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [45, 51]
model: Fulcrum-AI/Ryze-Embed-3
- sources:
- layer_range: [48, 52]
model: Fulcrum-AI/Ryze-Embed-3
- Task
- Sentence Similarity
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Aug 10, 2024
- Updated
- Aug 10, 2024