Skip to content

mobiuslabsgmbh

Llama-2-7b-chat-hf-4bit_g64-HQQ

mobiuslabsgmbh/Llama-2-7b-chat-hf-4bit_g64-HQQ

Llama-2-7b-chat-hf-4bit_g64-HQQ is a text generation model from mobiuslabsgmbh. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.

This is a version of the LLama-2-7B-chat-hf model quantized to 4-bit via Half-Quadratic Quantization (HQQ): https://mobiusml.github.io/hqqblog/

Downloads · 30 days

11

2% of all-time downloads

All-time downloads

584

Public

Repo size

4.1 GB

Likes

3

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.pt4.1 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
llama2
Model type
llama
Access
Public
Created
Nov 26, 2023
Updated
Feb 5, 2025
SHA
d2ca5379

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
License
llama2
Created
Nov 26, 2023
Updated
Feb 5, 2025