Downloads · 30 days
16
0% of all-time downloads
Qllama-.5B-Base-Wiki-Chat-RAG
Josephgflowers/Qllama-.5B-Base-Wiki-Chat-RAG
Qllama-.5B-Base-Wiki-Chat-RAG is a text generation model from Josephgflowers. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Llamafyd version of Qwen .5B further fine tuned on wiki, math, science, and chat datasets. Based on Cinder data. This model should be fine tuned on further rag, function calling, programing, or assistant datasets for…
All-time downloads
4K
Public
Parameters
464M
931 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors928 MB · 98%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- May 3, 2024
- Updated
- May 4, 2024
- SHA
- 4e98e3a8
Try a prompt
Model card
From the Hugging Face model README
Llamafyd version of Qwen .5B further fine tuned on wiki, math, science, and chat datasets. Based on Cinder data. This model should be fine tuned on further rag, function calling, programing, or assistant datasets for best performance. Next model will have a focus on rag.
This model is ok at rag. It is very verbose from being trained on wikipedia Q and A with a whole article as the answer. Tiny-textbooks and Cosmopedia 100k, all very long responses. It was also trained with normal RAG datasets, as well as a medical rag dataset I put together. Most of the common math chat datasets. Conversation datasets like hermes 1, fastchat, synthia, capybara, cinder, puffin, ect. I will work on putting together the full list and posting.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- May 3, 2024
- Updated
- May 4, 2024