Downloads · 30 days
10
31% of all-time downloads
llama_onto_qwen_lambda-0
moe-dtoks/llama_onto_qwen_lambda-0
llama_onto_qwen_lambda-0 is a machine learning model from moe-dtoks. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This model is a result of parameter averaging (Model Soup) across 2 models.
All-time downloads
32
Public
Parameters
1.9B
3.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.8 GB · 100%
At a glance
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Feb 16, 2026
- Updated
- Feb 16, 2026
- SHA
- 4fdb0a62
Model card
From the Hugging Face model README
Merged Model: llama_onto_qwen_lambda-0
This model is a result of parameter averaging (Model Soup) across 2 models.
Merged Models
The following models were included in the merge:
- toksuite/Qwen-Qwen3-8B
- toksuite/meta-llama-Llama-3.2-1B
Merging Configuration
- Method: Weighted Parameter Averaging
- Weights: Simple average with merging lambda = 0.0.
- Excluded Layers: Embeddings and LM Head were kept from the host model (toksuite/Qwen-Qwen3-8B).
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("moe-dtoks/llama_onto_qwen_lambda-0")
tokenizer = AutoTokenizer.from_pretrained("moe-dtoks/llama_onto_qwen_lambda-0")
- Type
- llama
- License
- mit
- Created
- Feb 16, 2026
- Updated
- Feb 16, 2026