Downloads · 30 days
11
13% of all-time downloads
sailesh-duddupudi-nutanix/nanollama
nanollama is a text generation model from sailesh-duddupudi-nutanix. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
A compact Llama-based language model optimized for efficient inference and deployment.
Downloads · 30 days
11
13% of all-time downloads
All-time downloads
86
Public
Parameters
294M
1.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1.2 GB · 100%
From the Hugging Face model README
A compact Llama-based language model optimized for efficient inference and deployment.
NanoLlama is a small-scale language model based on the Llama architecture, designed for lightweight applications and resource-constrained environments. This model provides a good balance between performance and computational efficiency.
This model can be used for:
The model can be fine-tuned for specific tasks such as:
from transformers import AutoTokenizer, AutoModelForCausalLM
# Load the model and tokenizer
model_name = "sailesh-duddupudi-nutanix/nanollama"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name)
# Generate text
input_text = "Hello, how are you?"
inputs = tokenizer(input_text, return_tensors="pt")
outputs = model.generate(**inputs, max_length=100, temperature=0.7)
generated_text = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(generated_text)
The model uses the standard Llama architecture with:
If you use this model, please cite:
@misc{nanollama2024,
title={NanoLlama: A Compact Llama-based Language Model},
author={sailesh-duddupudi-nutanix},
year={2024},
url={https://huggingface.co/sailesh-duddupudi-nutanix/nanollama}
}
For questions or issues, please contact: sailesh-duddupudi-nutanix