Downloads · 30 days
15
1% of all-time downloads
sqft-mistral-7b-v0.3-base-gptq
IntelLabs/sqft-mistral-7b-v0.3-base-gptq
sqft-mistral-7b-v0.3-base-gptq is a text generation model from IntelLabs. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- Source Model: mistralai/Mistral-7B-v0.3 - Quantization: GPTQ-INT4
All-time downloads
2.2K
Public
Parameters
7.2B
4.2 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors4.2 GB · 100%
Parameter types
How the weights are stored.
I327B · 96%
Try a prompt
Model card
From the Hugging Face model README
SQFT Base Model: sqft-mistral-7b-v0.3-base-gptq
- Source Model: mistralai/Mistral-7B-v0.3
- Quantization: GPTQ-INT4
Model Sources
Repository: https://github.com/IntelLabs/Hardware-Aware-Automated-Machine-Learning/tree/main/SQFT
Paper:
- SQFT: Low-cost Model Adaptation in Low-precision Sparse Foundation Models
- Low-Rank Adapters Meet Neural Architecture Search for LLM Compression
Citation
@inproceedings{munoz-etal-2024-sqft,
title = "{SQFT}: Low-cost Model Adaptation in Low-precision Sparse Foundation Models",
author = "Munoz, Juan Pablo and
Yuan, Jinjie and
Jain, Nilesh",
editor = "Al-Onaizan, Yaser and
Bansal, Mohit and
Chen, Yun-Nung",
booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2024",
month = nov,
year = "2024",
address = "Miami, Florida, USA",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2024.findings-emnlp.749",
pages = "12817--12832",
}
License
Apache-2.0
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Languages
- en
- Created
- Sep 23, 2024
- Updated
- Feb 12, 2025