Downloads · 30 days
0
vietphuon/Llama-3.2-1B-Instruct-bnb-4bit-alpaca-then-quizgen-241016-1
Llama-3.2-1B-Instruct-bnb-4bit-alpaca-then-quizgen-241016-1 is a machine learning model from vietphuon. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
FINAL BENCHMARKING ------------------------------ - Time to First Token (TTFT): 0.001s - Time Per Output Token (TPOT): 41.83ms/token - Throughput (token/s): 24.35token/s - Average Token Latency (ms/token): 41.92ms/tok…
Downloads · 30 days
0
Access
Public
Updated Oct 24, 2024
Repo size
45.1 MB
Likes
1
Public
Click a slice to open those files.
.safetensors45.1 MB · 83%
From the Hugging Face model README
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.