Skip to content

mikudev

Llama-3-Lumimaid-8B-v0.1-GTPQ

mikudev/Llama-3-Lumimaid-8B-v0.1-GTPQ

Llama-3-Lumimaid-8B-v0.1-GTPQ is a text generation model from mikudev. Use it when you need the model to write or continue text. It is set up for transformers.

This is a GPTQ 4-bit quantized version of Llama-3-Lumimaid-8B-v0.1 This was quantized using for 8192 seqlen using the AutoGPTQ wikitext2 example

Downloads · 30 days

20

2% of all-time downloads

All-time downloads

1.2K

Public

Repo size

11.5 GB

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors5.7 GB · 100%

At a glance

Task
Text Generation
Library
transformers
Model type
llama
Access
Public
Created
May 8, 2024
Updated
May 13, 2024
SHA
9b64c438

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
Created
May 8, 2024
Updated
May 13, 2024