Downloads · 30 days
8
11% of all-time downloads
TinyLlama-1.1B-intermediate-step-955k-token-2T-2bit-32rank
smallsuper/TinyLlama-1.1B-intermediate-step-955k-token-2T-2bit-32rank
TinyLlama-1.1B-intermediate-step-955k-token-2T-2bit-32rank is a feature extraction model from smallsuper. Use it when you need embeddings to search or compare text. It is set up for transformers.
This is a bare model without any output layer or classification head. It has been quantized to be used for feature extraction tasks.
All-time downloads
76
Public
Parameters
1B
4.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.1 GB · 98%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Feb 23, 2024
- Updated
- May 1, 2024
- SHA
- f6f9f0a7
Model card
From the Hugging Face model README
Overview
This is a bare model without any output layer or classification head. It has been quantized to be used for feature extraction tasks.
Usage
This model is intended to be used as a base for training on downstream tasks. In order to use it for predictions and inference, it should be fine-tuned on a specific task with an appropriate output layer or classification head added.
Quantization
The model has been quantized using the following parameters:
Lora alpha: 16
Lora rank: 32
Lora target modules: all-linear
bits: 4
LoftQ iterations: 5
- Task
- Feature Extraction
- Library
- transformers
- Type
- llama
- Created
- Feb 23, 2024
- Updated
- May 1, 2024