Downloads · 30 days
5
11% of all-time downloads
GATEAU-3k-10k
ssz1111/GATEAU-3k-10k
GATEAU-3k-10k is a machine learning model from ssz1111. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
A simple demo for the deployment of the model:
All-time downloads
45
Public
Repo size
13.5 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin13.5 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Sep 11, 2024
- Updated
- Dec 13, 2024
- SHA
- b8a55cfb
Model card
From the Hugging Face model README
GATEAU-LLaMA-7B-3K-10K
A simple demo for the deployment of the model:
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
tokenizer = AutoTokenizer.from_pretrained("ssz1111/GATEAU-3k-10k", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("ssz1111/GATEAU-3k-10k", torch_dtype=torch.bfloat16, trust_remote_code=True, device_map="auto")
model = model.eval()
query = "\n\n Hello."
response, history = model.chat(tokenizer, query, history=[], max_new_tokens=512, temperature=1)
print(response)
- Type
- llama
- License
- apache-2.0
- Created
- Sep 11, 2024
- Updated
- Dec 13, 2024