Downloads · 30 days
9
26% of all-time downloads
Llama-2-7b-hf_1bit_int
Heisenger/Llama-2-7b-hf_1bit_int
Llama-2-7b-hf_1bit_int is a machine learning model from Heisenger. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Training method based on BitDistiller Paper
All-time downloads
34
Public
Parameters
6.7B
27 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt13.5 GB · 50%
At a glance
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Mar 23, 2025
- Updated
- Mar 23, 2025
- SHA
- 5bcc8bbc
Base models
Model card
From the Hugging Face model README
Metrics
| PPL | arc_easy | arc_challenge | piqa | winogrande | hellaswag | mmlu | QA Avg |
|---|---|---|---|---|---|---|---|
| 4082.93 | 26.26 ± 0.90 | 22.44 ± 1.22 | 52.45 ± 1.17 | 51.78 ± 1.40 | 25.88 ± 0.44 | - | 35.76 |
Training method based on BitDistiller Paper
- License: mit
- Finetuned from: TinyLlama/TinyLlama_v1.1
- Type
- llama
- License
- mit
- Languages
- en
- Created
- Mar 23, 2025
- Updated
- Mar 23, 2025