Downloads · 30 days
8
2% of all-time downloads
L3-8B-Stheno-v3.2-GPTQ
mikudev/L3-8B-Stheno-v3.2-GPTQ
L3-8B-Stheno-v3.2-GPTQ is a machine learning model from mikudev. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Original Model: https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2
All-time downloads
383
Public
Parameters
8B
5.7 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors5.7 GB · 100%
Parameter types
How the weights are stored.
I327B · 87%
Base models
Model card
From the Hugging Face model README
Original Model: https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2
Quantized with AutoGPTQ 128g wikitext2, using the script from https://aphrodite.pygmalion.chat/pages/quantization/quantization-methods.html#gptq
- Type
- llama
- Languages
- en
- Created
- Sep 12, 2024
- Updated
- Sep 12, 2024