Skip to content

DiscoResearch

Llama3-DiscoLeo-Instruct-8B-v0.1-4bit-awq

DiscoResearch/Llama3-DiscoLeo-Instruct-8B-v0.1-4bit-awq

Llama3-DiscoLeo-Instruct-8B-v0.1-4bit-awq is a text generation model from DiscoResearch. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.

This model is a 4 bit quantization of DiscoResearch/Llama3DiscoLeoInstruct8Bv0.1 created using AutoAWQ with a custom bilingual calibration dataset and quantconfig = {"zeropoint": True, "qgroupsize": 128, "wbit": 4, "v…

Downloads · 30 days

8

1% of all-time downloads

All-time downloads

938

Public

Parameters

8B

5.7 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors5.7 GB · 100%

Parameter types

How the weights are stored.

I327B · 87%

Task
Text Generation
Library
transformers
Type
llama
License
llama3
Languages
de, en
Created
May 24, 2024
Updated
Sep 10, 2024