Downloads · 30 days
31
18% of all-time downloads
tinyllama-for-abalone-RAG
LoneWolfgang/tinyllama-for-abalone-RAG
tinyllama-for-abalone-RAG is a text generation model from LoneWolfgang. Use it when you need the model to write or continue text. It is set up for transformers.
This is a toy model fine-tuned specifically for the Abalone RAG App. A dataset was developed to finetune this model:
All-time downloads
174
Public
Parameters
1.1B
4.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Dec 6, 2025
- Updated
- Dec 14, 2025
- SHA
- e161dd87
Try a prompt
Model card
From the Hugging Face model README
TinyLlama for Abalone RAG
This is a toy model fine-tuned specifically for the Abalone RAG App. A dataset was developed to finetune this model:
- Questions were suggested by GPT-5.
- Passages were retrieved from a small index created for the app.
- Responses were generated by prompting GPT-5 with the query, the retrieved context, and instructions to produce concise answers referencing the context.
TinyLlama was finetuned on this dataset, resulting in a dedicated TinyLlama model for Abalone RAG. This model is designed to provide concise, context-aware answers about abalone for use in the RAG application.
These are the hyperparamters that were used, and they were not optimized:
- Epochs: 3
- Batch Size: 2
- Gradient Accumulation Steps: 8
- Learning Rate: 2e-4
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Dec 6, 2025
- Updated
- Dec 14, 2025