Downloads · 30 days
0
NorthernTribe-Research/UMSR-Reasoner-7B-INT8
UMSR-Reasoner-7B-INT8 is a machine learning model from NorthernTribe-Research. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
8-bit bitsandbytes runtime quantization profile.
Downloads · 30 days
0
Access
Public
Updated Feb 23, 2026
Repo size
—
Likes
0
Public
Click a slice to open those files.
Other1.5 KB · 51%
From the Hugging Face model README
8-bit bitsandbytes runtime quantization profile.
https://huggingface.co/NorthernTribe-Research/UMSR-Reasoner-7Bhttps://huggingface.co/NorthernTribe-Research/UMSR-Reasoner-7B-INT8https://huggingface.co/datasets/NorthernTribe-Research/UMSR-v1int8bitsandbytes int8FalseThis variant repository is a profile card. Load weights from the source model id.
from transformers import AutoTokenizer, AutoModelForCausalLM, BitsAndBytesConfig
model_id = "NorthernTribe-Research/UMSR-Reasoner-7B"
bnb_config = BitsAndBytesConfig(load_in_8bit=True)
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
device_map="auto",
quantization_config=bnb_config,
)
<final_answer>...</final_answer>