Skip to content

mobiuslabsgmbh

Llama-2-70b-chat-hf-2bit_g16_s128-HQQ

mobiuslabsgmbh/Llama-2-70b-chat-hf-2bit_g16_s128-HQQ

Llama-2-70b-chat-hf-2bit_g16_s128-HQQ is a text generation model from mobiuslabsgmbh. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.

This is a version of the LLama-2-70B-chat-hf model quantized to 2-bit via Half-Quadratic Quantization (HQQ): https://mobiusml.github.io/hqqblog/

Downloads · 30 days

12

2% of all-time downloads

All-time downloads

667

Public

Repo size

26.9 GB

Likes

3

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.pt26.9 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
llama2
Model type
llama
Access
Public
Created
Nov 25, 2023
Updated
Feb 5, 2025
SHA
3fc412b4

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
License
llama2
Created
Nov 25, 2023
Updated
Feb 5, 2025