Downloads · 30 days
45
10% of all-time downloads
krishkpatil/legal_llm
legal_llm is a machine learning model from krishkpatil. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: krishkpatil - License: apache-2.0 - Finetuned from model : unsloth/llama-3-8b-bnb-4bit
Downloads · 30 days
45
10% of all-time downloads
All-time downloads
452
Public
Parameters
8B
21.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.2 GB · 77%
From the Hugging Face model README
from llama_cpp import Llama
llm = Llama.from_pretrained(
repo_id="krishkpatil/legal_llm",
filename="unsloth.Q4_K_M.gguf", # Replace with the actual GGUF filename if different
)
response = llm.create_chat_completion(
messages = [
{
"role": "user",
"content": "Explain the concept of judicial review in India."
}
]
)
print(response['choices'][0]['message']['content'])
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.