Downloads · 30 days
0
ZBKC6H4O2/llama3-3b-neko-lora-finetuned
llama3-3b-neko-lora-finetuned is a machine learning model from ZBKC6H4O2. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is a LoRA fine-tuned version of Llama3.2-3B on https://huggingface.co/datasets/liumindmind/NekoQA-10K.
Downloads · 30 days
0
Access
Public
Updated Aug 22, 2025
Repo size
601 MB
Likes
0
Public
Click a slice to open those files.
.pt389 MB · 65%
From the Hugging Face model README
This is a LoRA fine-tuned version of Llama3.2-3B on https://huggingface.co/datasets/liumindmind/NekoQA-10K.
messages = [
{"role" : "user", "content" : "摸摸"}
]
text = tokenizer.apply_chat_template(
messages,
tokenize = False,
add_generation_prompt = True,
)
from transformers import TextStreamer
_ = model.generate(
**tokenizer(text, return_tensors = "pt").to("cuda"),
max_new_tokens = 1500,
temperature = 1.0, top_p = 0.8, top_k = 20,
streamer = TextStreamer(tokenizer, skip_prompt = True),
)