Downloads · 30 days
21
38% of all-time downloads
Kiwi-1.0-0.7B-32k-Instruct
empirischtech/Kiwi-1.0-0.7B-32k-Instruct
Kiwi-1.0-0.7B-32k-Instruct is a machine learning model from empirischtech. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-4.0.
Developed by: EmpirischTech/ChaperoneAI Backbone Model: Kiwi-1.0-0.7B-32k Parameters: 700m Context Window: 32k Language(s): English Library: HuggingFace Transformers
All-time downloads
55
Public
Parameters
703M
8.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt2.8 GB · 66%
At a glance
- License
- cc-by-4.0
- Model type
- qwen2
- Access
- Public
- Created
- Mar 16, 2025
- Updated
- Mar 17, 2025
- SHA
- cd0a577a
Base models
Model card
From the Hugging Face model README
Kiwi-1.0-0.7B-32k-Instruct
Instruction-Tuned Model
- Developed by: EmpirischTech/ChaperoneAI
- Backbone Model: Kiwi-1.0-0.7B-32k
- Parameters: 700m
- Context Window: 32k
- Language(s): English
- Library: HuggingFace Transformers
- License: Creative Common Attribute 4.0 (CCA-4.0)
- Contact: For questions and comments about the model, please email contact-us
Main Message
Here is the instruction-tuned version of the pretrained Kiwi-1.0-0.7B model. As can been seen in the table below, the results are at paar with the SOTA Qwen2.5-0.5B.
Evaluation Results
The performance evaluation is based on the tasks being evaluated on the Open LLM Leaderboard.
The model is evaluated on three benchmark datasets, which include ARC-Challenge, HellaSwag, MMLU, IFEval and GPQA.
The library used is lm-evaluation-harness repository
Main Results
| Metric | Qwen2.5-05B-Instruct | Kiwi-1.0-0.7B-32k-Instruct |
|---|---|---|
| ARC | 33.45 | 32.34 |
| HellaSwag | 52.37 | 48.59 |
| MMLU-PRO | 14.03 | 12.89 |
| IFEval | 37.53 | 27.1 |
| GPQA (Diamond)<br>(Zero-shot CoT) | 12.27 | 17.17 |
| Average | 29,93 | 27,27 |
- Type
- qwen2
- License
- cc-by-4.0
- Created
- Mar 16, 2025
- Updated
- Mar 17, 2025