Skip to content

sardukar

openbuddy-llama3-8b-v21.1-8k-g128-q4-gemm-awq

sardukar/openbuddy-llama3-8b-v21.1-8k-g128-q4-gemm-awq

openbuddy-llama3-8b-v21.1-8k-g128-q4-gemm-awq is a text generation model from sardukar. Use it when you need the model to write or continue text. It is set up for transformers.

AWQ g128 4-bit version of OpenBuddy/openbuddy-llama3-8b-v21.1-8k

Downloads · 30 days

3

6% of all-time downloads

All-time downloads

54

Public

Parameters

8B

5.7 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors5.7 GB · 100%

Parameter types

How the weights are stored.

I327B · 87%

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
Created
May 20, 2024
Updated
May 20, 2024