Downloads · 30 days
0
divjotst/llama_integration_EWS
llama_integration_EWS is a machine learning model from divjotst. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as llama3.
Downloads · 30 days
0
Access
Public
Updated Sep 4, 2024
Repo size
—
Likes
0
Public
Click a slice to open those files.
.txt5.8 KB · 75%
From the Hugging Face model README
import transformers import torch
model_id = "meta-llama/Meta-Llama-3.1-8B"
pipeline = transformers.pipeline( "text-generation", model=model_id, model_kwargs={"torch_dtype": torch.bfloat16}, device_map="auto" )
pipeline("Hey how are you doing today?")