Downloads · 30 days
35
6% of all-time downloads
RichardErkhov/aloobun_-_Reyna-Mini-1.8B-v0.1-gguf
aloobun_-_Reyna-Mini-1.8B-v0.1-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
35
6% of all-time downloads
All-time downloads
608
Public
Repo size
19.8 GB
Likes
0
Public
Click a slice to open those files.
.gguf23.4 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Reyna-Mini-1.8B-v0.1 - GGUF
| Name | Quant method | Size |
|---|---|---|
| Reyna-Mini-1.8B-v0.1.Q2_K.gguf | Q2_K | 0.79GB |
| Reyna-Mini-1.8B-v0.1.Q3_K_S.gguf | Q3_K_S | 0.89GB |
| Reyna-Mini-1.8B-v0.1.Q3_K.gguf | Q3_K | 0.95GB |
| Reyna-Mini-1.8B-v0.1.Q3_K_M.gguf | Q3_K_M | 0.95GB |
| Reyna-Mini-1.8B-v0.1.Q3_K_L.gguf | Q3_K_L | 0.98GB |
| Reyna-Mini-1.8B-v0.1.IQ4_XS.gguf | IQ4_XS | 1.01GB |
| Reyna-Mini-1.8B-v0.1.Q4_0.gguf | Q4_0 | 1.04GB |
| Reyna-Mini-1.8B-v0.1.IQ4_NL.gguf | IQ4_NL | 1.05GB |
| Reyna-Mini-1.8B-v0.1.Q4_K_S.gguf | Q4_K_S | 1.08GB |
| Reyna-Mini-1.8B-v0.1.Q4_K.gguf | Q4_K | 1.13GB |
| Reyna-Mini-1.8B-v0.1.Q4_K_M.gguf | Q4_K_M | 1.13GB |
| Reyna-Mini-1.8B-v0.1.Q4_1.gguf | Q4_1 | 1.13GB |
| Reyna-Mini-1.8B-v0.1.Q5_0.gguf | Q5_0 | 1.22GB |
| Reyna-Mini-1.8B-v0.1.Q5_K_S.gguf | Q5_K_S | 1.24GB |
| Reyna-Mini-1.8B-v0.1.Q5_K.gguf | Q5_K | 1.28GB |
| Reyna-Mini-1.8B-v0.1.Q5_K_M.gguf | Q5_K_M | 1.28GB |
| Reyna-Mini-1.8B-v0.1.Q5_1.gguf | Q5_1 | 1.31GB |
| Reyna-Mini-1.8B-v0.1.Q6_K.gguf | Q6_K | 1.47GB |
| Reyna-Mini-1.8B-v0.1.Q8_0.gguf | Q8_0 | 1.82GB |
license_name: tongyi-qianwen-research license_link: https://huggingface.co/Qwen/Qwen1.5-1.8B-Chat/raw/main/LICENSE library_name: transformers license: other datasets:

<|im_start|>system
{system}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
| Avg. | Arc | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
|---|---|---|---|---|---|---|
| 41.46 | 35.24 | 60.42 | 45.37 | 41.4 | 60.85 | 5.46 |
from transformers import AutoModelForCausalLM, AutoTokenizer, TextStreamer, StoppingCriteria
import torch
class MyStoppingCriteria(StoppingCriteria):
def __init__(self, target_sequence, prompt):
self.target_sequence = target_sequence
self.prompt=prompt
def __call__(self, input_ids, scores, **kwargs):
generated_text = tokenizer.decode(input_ids[0])
generated_text = generated_text.replace(self.prompt,'')
if self.target_sequence in generated_text:
return True
return False
def __len__(self):
return 1
def __iter__(self):
yield self
modelpath="aloobun/Reyna-Mini-1.8B-v0.1"
model = AutoModelForCausalLM.from_pretrained(
modelpath,
torch_dtype=torch.bfloat16,
device_map="cuda",
trust_remote_code=True,
)
tokenizer = AutoTokenizer.from_pretrained(
modelpath,
trust_remote_code=True,
use_fast=False,
)
prompt = "<|im_start|>system\nYou are a helpful assistant.<|im_end|>\n<|im_start|>user\nReflect on a real-world scenario where understanding probability theory could make a significant difference in decision-making.\n<|im_start|>assistant\n"
encoded_input = tokenizer(prompt, return_tensors='pt')
input_ids=encoded_input['input_ids'].cuda()
streamer = TextStreamer(tokenizer=tokenizer, skip_prompt=True)
op = model.generate(
input_ids,
streamer=streamer,
pad_token_id=tokenizer.eos_token_id,
do_sample=True,
temperature=0.6,
top_p=0.8,
max_new_tokens=512,
stopping_criteria=MyStoppingCriteria("<|im_end|>", prompt)
)
One real-world scenario where understanding probability theory can make a significant difference in decision-making is in the field of finance. Financial institutions, such as banks and investment firms, must make decisions about lending money to individuals or businesses, and how much risk they should take on. In this case, understanding probability theory would help financial analysts and investors make more informed decisions by providing them with information about the likelihood of different outcomes. For example, if an investor wants to invest in a particular stock, they might want to understand the probability that it will perform well over time, based on historical data and market trends. They might also be interested in understanding the probability of defaulting on a loan, which would help them evaluate whether it's worth taking on that risk. Probability theory provides valuable insights into how events are likely to occur and what factors contribute to those probabilities. By using statistical models and simulations, financial professionals can estimate the likelihood of different scenarios and make better-informed decisions about how to allocate their resources. This can lead to increased profits for financial institutions and improved customer satisfaction for individual investors.<|im_end|>