Downloads · 30 days
52
30% of all-time downloads
Ryu-m0m/16bit-japanese-finetuned-mistral-7b-v0
16bit-japanese-finetuned-mistral-7b-v0 is a text generation model from Ryu-m0m. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
52
30% of all-time downloads
All-time downloads
172
Public
Repo size
29 GB
Likes
1
Public
Click a slice to open those files.
.bin14.5 GB · 100%
From the Hugging Face model README
日本語で質問すると、日本語で回答を得られます。<br>
This is a fine-tuned unsloth/mistral-7b-v0.3-bnb-4bit for Japanese.<br> You can ask in Japanese to get the answers in Japanese.<br> Made possible thanks to a detailed notebook from Unsloth. <br>
from transformers import pipeline
pipe = pipeline("text-generation", model="Ryu-m0m/16bit-japanese-finetuned-mistral-7b-v0")
instruction = "侍の歴史を簡単に教えてください。" # Can you give us a brief history of the Samurai?
response = pipe(
instruction,
max_length=150, # Controls the length of the output
temperature=0.7, # Controls randomness; lower is more deterministic
top_k=50, # Limits sampling pool to top 50 tokens
top_p=0.9, # Nucleus sampling, considering tokens up to 90% cumulative probability
num_return_sequences=1 # Generates only one response
)
print(response[0]['generated_text'])
Any questions or quality issues found in the model, please feel free to contact me.
This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.