Skip to content

mobiuslabsgmbh

Llama-2-13b-hf-4bit_g64-HQQ

mobiuslabsgmbh/Llama-2-13b-hf-4bit_g64-HQQ

Llama-2-13b-hf-4bit_g64-HQQ is a text generation model from mobiuslabsgmbh. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.

This is a version of the LLama-2-13B-hf model quantized to 4-bit via Half-Quadratic Quantization (HQQ): https://mobiusml.github.io/hqqblog/

Downloads · 30 days

16

3% of all-time downloads

All-time downloads

474

Public

Repo size

7.6 GB

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.pt7.6 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
llama2
Model type
llama
Access
Public
Created
Nov 22, 2023
Updated
Feb 5, 2025
SHA
2e670081

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
License
llama2
Created
Nov 22, 2023
Updated
Feb 5, 2025