Skip to content

yang31210999

Llama3.1-1B-Neo-BAAI-1000k

yang31210999/Llama3.1-1B-Neo-BAAI-1000k

Llama3.1-1B-Neo-BAAI-1000k is a text generation model from yang31210999. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

We prune the Llama-3.1-8B-Instruct to 1.4B and fine-tune it with LLM-Neo method,which combines LoRA and KD in one. Training data is sampling from BAAI/Infinity-Instruct for 1 Million lines.

Downloads · 30 days

11

3% of all-time downloads

All-time downloads

411

Public

Parameters

1.9B

7.7 GB on disk

Likes

2

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors7.7 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
llama
Access
Public
Created
Sep 10, 2024
Updated
Feb 28, 2025
SHA
be281914

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
llama
License
apache-2.0
Created
Sep 10, 2024
Updated
Feb 28, 2025