Downloads · 30 days
0
ExLlamaV2-Measurements
LoneStriker/ExLlamaV2-Measurements
ExLlamaV2-Measurements is a machine learning model from LoneStriker. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Measurement files used to quantize models uploaded here. Depending on the model type one of the following datasets is used for calibration: General chat or instruct model: ThePile 0007.parquet
Access
Public
Updated Nov 28, 2023
Repo size
103 MB
Likes
13
Public
Repo makeup
Click a slice to open those files.
.json555 MB · 84%
At a glance
- Access
- Public
- Created
- Nov 2, 2023
- Updated
- Nov 28, 2023
- SHA
- b37d89c6
Model card
From the Hugging Face model README
ExLlamaV2 Measurements
Measurement files used to quantize models uploaded here. Depending on the model type one of the following datasets is used for calibration:
- General chat or instruct model: ThePile 0007.parquet
- Coding model: WizardLM_evol_instruct_V2_196k
- RP model: pippa.parquet (from Undi of TheBloke Discord)
- Japanese model: filtered text from file Japanese Wiki file jawikibooks-20231023-cirrussearch
- Created
- Nov 2, 2023
- Updated
- Nov 28, 2023