Skip to content

mobiuslabsgmbh

Llama-2-7b-hf-4bit_g64-HQQ

mobiuslabsgmbh/Llama-2-7b-hf-4bit_g64-HQQ

Llama-2-7b-hf-4bit_g64-HQQ is a text generation model from mobiuslabsgmbh. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.

This is a version of the LLama-2-7B-hf model quantized to 4-bit via Half-Quadratic Quantization (HQQ): https://mobiusml.github.io/hqqblog/

Downloads · 30 days

19

3% of all-time downloads

All-time downloads

589

Public

Repo size

4.1 GB

Likes

2

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.pt4.1 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
llama2
Model type
llama
Access
Public
Created
Nov 20, 2023
Updated
Feb 5, 2025
SHA
1fbe6bed

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
License
llama2
Created
Nov 20, 2023
Updated
Feb 5, 2025