Downloads · 30 days
41
8% of all-time downloads
Llama-3.2-Instruct-3B-TIES
vhab10/Llama-3.2-Instruct-3B-TIES
Llama-3.2-Instruct-3B-TIES is a text generation model from vhab10. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
The Llama-3.2-Instruct-3B-TIES model is a result of merging three versions of Llama-3.2-3B models using the TIES merging method, facilitated by mergekit. This merge combines a base general-purpose language model with…
All-time downloads
521
Public
Parameters
3.3B
2.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.2 GB · 100%
Parameter types
How the weights are stored.
U82.9B · 88%
Try a prompt
Base models
Model card
From the Hugging Face model README
Llama-3.2-Instruct-3B-TIES
Overview
The Llama-3.2-Instruct-3B-TIES model is a result of merging three versions of Llama-3.2-3B models using the TIES merging method, facilitated by mergekit. This merge combines a base general-purpose language model with two instruction-tuned models to create a more powerful and versatile model capable of handling diverse tasks.
Model Details
Model Description
- Models Used:
- Merging Tool: Mergekit
- Merge Method: TIES
- Data Type: float16 (FP16) precision
- License: MIT License
Configuration
The following YAML configuration was used to produce this model:
models:
- model: meta-llama/Llama-3.2-3B
# Base model
- model: meta-llama/Llama-3.2-3B-Instruct
parameters:
density: 0.5
weight: 0.5
- model: unsloth/Llama-3.2-3B-Instruct
parameters:
density: 0.5
weight: 0.3
merge_method: ties
base_model: meta-llama/Llama-3.2-3B
parameters:
normalize: true
dtype: float16
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Languages
- en
- Created
- Oct 6, 2024
- Updated
- Oct 7, 2024