Downloads · 30 days
14
47% of all-time downloads
RichardErkhov/Chickaboo_-_ChickaQ-V2-Large-Beta-awq
Chickaboo_-_ChickaQ-V2-Large-Beta-awq is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
14
47% of all-time downloads
All-time downloads
30
Public
Parameters
3.1B
2.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.5 GB · 99%
How the weights are stored.
I322.4B · 80%
From the Hugging Face model README
Quantization made by Richard Erkhov.
ChickaQ-V2-Large-Beta - AWQ
base_model:
ChickaQ (0.5B)
ChickaQ-Large (1.8B)
ChickaQ-V2-Beta (0.9B)
ChickaQ-V2-Large-Beta (3B)
This is a merge of pre-trained language models created using mergekit.
This model was merged using the passthrough merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
slices:
- sources:
- model: Qwen/Qwen1.5-1.8B-Chat
layer_range: [0, 24]
- sources:
- model: vilm/Quyen-mini-v0.1
layer_range: [0, 24]
merge_method: passthrough
dtype: bfloat16