Downloads · 30 days
19
14% of all-time downloads
Llama-3.2-1B-DeepSeek67B-Distilled
enesarda22/Llama-3.2-1B-DeepSeek67B-Distilled
Llama-3.2-1B-DeepSeek67B-Distilled is a text generation model from enesarda22. Use it when you need the model to write or continue text. It is set up for transformers.
This model is distilled from deepseek-ai/deepseek-llm-67b-base, a 67B parameter model available on Hugging Face. It is based on the meta-llama/Llama-3.2-1B architecture.
All-time downloads
138
Public
Parameters
1.2B
5 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors4.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Mar 14, 2025
- Updated
- Mar 15, 2025
- SHA
- 57dbd0dd
Try a prompt
Datasets
Model card
From the Hugging Face model README
Llama-3.2-1B-DeepSeek-Distilled
Model Overview
This model is distilled from deepseek-ai/deepseek-llm-67b-base, a 67B parameter model available on Hugging Face. It is based on the meta-llama/Llama-3.2-1B architecture.
Evaluation Scores
- XTREME - XNLI - en: Accuracy: 0.365
- SuperGLUE - BoolQ: Accuracy: 0.721
- GLUE - SST-2: Accuracy: 0.924
- SQuAD:
- Exact Match: 61.5
- F1 Score: 74.1
Usage
Load the model and tokenizer from the Hugging Face Hub:
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("enesarda22/Llama-3.2-1B-DeepSeek67B-Distilled")
tokenizer = AutoTokenizer.from_pretrained("enesarda22/Llama-3.2-1B-DeepSeek67B-Distilled")
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Mar 14, 2025
- Updated
- Mar 15, 2025