Downloads · 30 days
128
45% of all-time downloads
mu2solutions/Llama-3.1-Tulu-3.1-8B-GGUF
Llama-3.1-Tulu-3.1-8B-GGUF is a text generation model from mu2solutions. Use it when you need the model to write or continue text. The card lists the license as llama3.1.
GGUF conversion of allenai/Llama-3.1-Tulu-3.1-8B, published by Mu2 Solutions.
Downloads · 30 days
128
45% of all-time downloads
All-time downloads
287
Public
Repo size
13.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf13.5 GB · 100%
From the Hugging Face model README
GGUF conversion of allenai/Llama-3.1-Tulu-3.1-8B, published by Mu2 Solutions.
Converted with llama.cpp build b9859 (4fc4ec554) using the official Hugging Face to GGUF converter, then quantized with llama-quantize. This is the first GGUF release of this model.
llama3.1 (Meta Llama Community License) — this model is derived from Llama 3.1 weights via Allen Institute for AI's Tulu 3.1 training recipe. The license of the base model applies. See the source model card for details.
| File | Quant | Size |
|---|---|---|
Llama-3.1-Tulu-3.1-8B-Q4_K_M.gguf | Q4_K_M | 4.6 GB |
Llama-3.1-Tulu-3.1-8B-Q8_0.gguf | Q8_0 | 8.0 GB |
Q4_K_M is the recommended default for most use. Q8_0 for near-lossless quality with more RAM.
# llama-server (OpenAI-compatible)
llama-server -m Llama-3.1-Tulu-3.1-8B-Q4_K_M.gguf -c 8192 -ngl 99
# one-shot completion
llama-completion -m Llama-3.1-Tulu-3.1-8B-Q4_K_M.gguf -p "Your prompt here" -n 256
# interactive chat
llama-cli -m Llama-3.1-Tulu-3.1-8B-Q4_K_M.gguf -c 8192 -ngl 99
<|user|> / <|assistant|>)