Downloads · 30 days
23
24% of all-time downloads
ScikitLLM-Model
probabl-ai/ScikitLLM-Model
ScikitLLM-Model is a text generation model from probabl-ai. Use it when you need the model to write or continue text. It is set up for transformers.
ScikitLLM is an LLM finetuned on writing references and code for the Scikit-Learn documentation.
All-time downloads
94
Public
Parameters
7.2B
14.5 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- mistral
- Access
- Public
- Created
- Mar 24, 2024
- Updated
- Mar 24, 2024
- SHA
- a37aa59e
Try a prompt
Model card
From the Hugging Face model README
ScikitLLM is an LLM finetuned on writing references and code for the Scikit-Learn documentation.
Features of ScikitLLM includes:
- Support for RAG (three chunks)
- Sources and quotations using a modified version of the wiki syntax ("<ref>")
- Code samples and examples based on the code quoted in the chunks.
- Expanded knowledge/familiarity with the Scikit-Learn concepts and documentation.
Training
ScikitLLM is based on Mistral-OpenHermes 7B, a pre-existing finetune version of Mistral 7B. OpenHermes already include many desired capacities for the end use, including instruction tuning, source analysis, and native support for the chatML syntax.
As a fine-tune of a fine-tune, ScikitLLM has been trained with a lower learning rate than is commonly used in fine-tuning projects.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- Created
- Mar 24, 2024
- Updated
- Mar 24, 2024