Downloads · 30 days
12
21% of all-time downloads
ScikitLLM-Model-exl2
probabl-ai/ScikitLLM-Model-exl2
ScikitLLM-Model-exl2 is a text generation model from probabl-ai. Use it when you need the model to write or continue text. It is set up for transformers.
ScikitLLM is an LLM finetuned on writing references and code for the Scikit-Learn documentation.
All-time downloads
56
Public
Repo size
3 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- mistral
- Access
- Public
- Created
- Apr 1, 2024
- Updated
- Apr 1, 2024
- SHA
- 0703160b
Try a prompt
Model card
From the Hugging Face model README
ScikitLLM is an LLM finetuned on writing references and code for the Scikit-Learn documentation.
Features of ScikitLLM includes:
- Support for RAG (three chunks)
- Sources and quotations using a modified version of the wiki syntax ("<ref>")
- Code samples and examples based on the code quoted in the chunks.
- Expanded knowledge/familiarity with the Scikit-Learn concepts and documentation.
Training
ScikitLLM is based on Mistral-OpenHermes 7B, a pre-existing finetune version of Mistral 7B. OpenHermes already include many desired capacities for the end use, including instruction tuning, source analysis, and native support for the chatML syntax.
As a fine-tune of a fine-tune, ScikitLLM has been trained with a lower learning rate than is commonly used in fine-tuning projects.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- Created
- Apr 1, 2024
- Updated
- Apr 1, 2024