Downloads · 30 days
6
19% of all-time downloads
RogerS-01/Impish_Mind_8B-awq-asym
Impish_Mind_8B-awq-asym is a machine learning model from RogerS-01. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Original: https://huggingface.co/SicariusSicariiStuff/ImpishMind8B
Downloads · 30 days
6
19% of all-time downloads
All-time downloads
32
Public
Repo size
5.7 GB
Likes
0
Public
Click a slice to open those files.
.bin5.7 GB · 100%
From the Hugging Face model README
Original: https://huggingface.co/SicariusSicariiStuff/Impish_Mind_8B
Created with LLM Compressor https://github.com/vllm-project/llm-compressor
Doesn't seem to work with SGLang, only vLLM and Aphrodite engine.