Downloads · 30 days
9
21% of all-time downloads
prototype-0.4x128
bruhzair/prototype-0.4x128
prototype-0.4x128 is a text generation model from bruhzair. Use it when you need the model to write or continue text. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit.
All-time downloads
42
Public
Parameters
70.6B
141 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors141 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Jun 13, 2025
- Updated
- Jun 13, 2025
- SHA
- 3cdf46ec
Try a prompt
Model card
From the Hugging Face model README
prototype-0.4x128
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the SCE merge method using /workspace/prototype-0.4x122 as a base.
Models Merged
The following models were included in the merge:
- /workspace/cache/models--Steelskull--L3.3-Electra-R1-70b/snapshots/26c8d595ecd941ca908c49d7ae5b2dd146465341
- /workspace/cache/models--Tarek07--Legion-V2.1-LLaMa-70B/snapshots/883ac6c5dc1d5e6b90d5be6bcec882c3421fd5a5
Configuration
The following YAML configuration was used to produce this model:
models:
- model: /workspace/cache/models--Tarek07--Legion-V2.1-LLaMa-70B/snapshots/883ac6c5dc1d5e6b90d5be6bcec882c3421fd5a5
parameters:
select_topk: 0.5
- model: /workspace/cache/models--Steelskull--L3.3-Electra-R1-70b/snapshots/26c8d595ecd941ca908c49d7ae5b2dd146465341
parameters:
select_topk: 0.5
- model: /workspace/prototype-0.4x122
parameters:
select_topk: 0.65
base_model: /workspace/prototype-0.4x122
merge_method: sce
tokenizer:
source: base
chat_template: llama3
int8_mask: true
dtype: float32
out_dtype: bfloat16
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Jun 13, 2025
- Updated
- Jun 13, 2025