Downloads · 30 days
2
3% of all-time downloads
llama3.1_8b_sft-solo-attn-v2-k24
doupari/llama3.1_8b_sft-solo-attn-v2-k24
llama3.1_8b_sft-solo-attn-v2-k24 is a machine learning model from doupari. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repo bundles LLOPA/TRI inference with minimal friction.
All-time downloads
64
Public
Repo size
64.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin32.1 GB · 50%
At a glance
- Model type
- llama
- Access
- Public
- Created
- Apr 27, 2026
- Updated
- Apr 27, 2026
- SHA
- cbd35112
Model card
From the Hugging Face model README
LLOPA Model
This repo bundles LLOPA/TRI inference with minimal friction.
from transformers import AutoTokenizer, AutoModelForCausalLM
tok = AutoTokenizer.from_pretrained("your-repo")
model = AutoModelForCausalLM.from_pretrained("your-repo", trust_remote_code=True)
out = model.llopa_generate(
tokenizer=tok,
system="You are a helpful assistant.",
document="...",
question="...",
K=4,
prefill_mode="lower",
prefill_attn="causal",
)
print(out)
- Type
- llama
- Created
- Apr 27, 2026
- Updated
- Apr 27, 2026