Downloads · 30 days
13
50% of all-time downloads
RichardErkhov/Chickaboo_-_ChickaQ-V2-Large-Beta-8bits
Chickaboo_-_ChickaQ-V2-Large-Beta-8bits is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
13
50% of all-time downloads
All-time downloads
26
Public
Parameters
3.1B
3.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.7 GB · 100%
How the weights are stored.
I82.4B · 80%
From the Hugging Face model README
Quantization made by Richard Erkhov.
ChickaQ-V2-Large-Beta - bnb 8bits
base_model:
ChickaQ (0.5B)
ChickaQ-Large (1.8B)
ChickaQ-V2-Beta (0.9B)
ChickaQ-V2-Large-Beta (3B)
This is a merge of pre-trained language models created using mergekit.
This model was merged using the passthrough merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
slices:
- sources:
- model: Qwen/Qwen1.5-1.8B-Chat
layer_range: [0, 24]
- sources:
- model: vilm/Quyen-mini-v0.1
layer_range: [0, 24]
merge_method: passthrough
dtype: bfloat16