Downloads · 30 days
11
13% of all-time downloads
jsyeom/llama-2-13b-hf-sensitivity-sorted
llama-2-13b-hf-sensitivity-sorted is a machine learning model from jsyeom. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model has sensitivity-based channel sorting applied. No quantization has been applied.
Downloads · 30 days
11
13% of all-time downloads
All-time downloads
86
Public
Parameters
13B
26 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors26 GB · 100%
From the Hugging Face model README
This model has sensitivity-based channel sorting applied. No quantization has been applied.
| Parameter | Value |
|---|---|
| Base model | meta-llama/Llama-2-13b-hf |
| Method | Sensitivity-based full channel sorting |
| Sorting order | Ascending (low sensitivity → high) |
| Quantization | None (sorting only) |
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("jsyeom/sensitivity_sorted_models/llama-2-13b-hf-sensitivity-sorted")
tokenizer = AutoTokenizer.from_pretrained("jsyeom/sensitivity_sorted_models/llama-2-13b-hf-sensitivity-sorted")
dst_ids.pt contains the full permutation indices for reference.sort_config.json contains metadata about the sorting configuration.