Downloads · 30 days
147
3% of all-time downloads
RichardErkhov/minghaowu_-_Qwen1.5-0.5B-OpenHermes-2.5-gguf
minghaowu_-_Qwen1.5-0.5B-OpenHermes-2.5-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
147
3% of all-time downloads
All-time downloads
4.9K
Public
Repo size
7.8 GB
Likes
0
Public
Click a slice to open those files.
.gguf9 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Qwen1.5-0.5B-OpenHermes-2.5 - GGUF
license: other base_model: Qwen/Qwen1.5-0.5B tags:
This model is a fine-tuned version of Qwen/Qwen1.5-0.5B on the teknium/OpenHermes-2.5 dataset.
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline
model_id = "minghaowu/phi-2-OpenHermes-2.5"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.bfloat16, device_map="auto")
pipe = pipeline("text-generation", model=model, tokenizer=tokenizer, device_map="auto")
your_instruction = <your_instruction>
infer_prompt = f"### USER: {your_instruction} <|endoftext|>\n### ASSISTANT:"
output = pipe(infer_prompt, do_sample=True, max_new_tokens=256)[0]["generated_text"]
print(output)