Downloads · 30 days
270
3% of all-time downloads
RichardErkhov/Josephgflowers_-_Qllama-.5B-Base-Wiki-Chat-RAG-gguf
Josephgflowers_-_Qllama-.5B-Base-Wiki-Chat-RAG-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
270
3% of all-time downloads
All-time downloads
10.1K
Public
Repo size
6.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf7 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Qllama-.5B-Base-Wiki-Chat-RAG - GGUF
Llamafyd version of Qwen .5B further fine tuned on wiki, math, science, and chat datasets. Based on Cinder data. This model should be fine tuned on further rag, function calling, programing, or assistant datasets for best performance. Next model will have a focus on rag.
This model is ok at rag. It is very verbose from being trained on wikipedia Q and A with a whole article as the answer. Tiny-textbooks and Cosmopedia 100k, all very long responses. It was also trained with normal RAG datasets, as well as a medical rag dataset I put together. Most of the common math chat datasets. Conversation datasets like hermes 1, fastchat, synthia, capybara, cinder, puffin, ect. I will work on putting together the full list and posting.