Downloads · 30 days
21
4% of all-time downloads
Lucie-7B-Baby-Instruct-GGUF
Volko76/Lucie-7B-Baby-Instruct-GGUF
Lucie-7B-Baby-Instruct-GGUF is a machine learning model from Volko76. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
testtransformersgguf.py: Test GGUF model with transformers package (WARNING: loading the model is long)
All-time downloads
572
Public
Repo size
40.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf40.8 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Nov 28, 2024
- Updated
- Nov 28, 2024
- SHA
- 84893722
Model card
From the Hugging Face model README
Test in python
- test_transformers_gguf.py: Test GGUF model with
transformerspackage (WARNING: loading the model is long)
Test with ollama
- Download and install Ollama
- Download the GGUF model
- Copy the
Modelfile, adpating if necessary the path to the GGUF file (line starting withFROM). - Run in a shell:
ollama create -f Modelfile Lucieollama run Lucie
- Once ">>>" appears, type your prompt(s) and press Enter.
- Optionally, restart a conversation by typing "
/clear" - End the session by typing "
/bye".
Useful for debug:
- License
- apache-2.0
- Created
- Nov 28, 2024
- Updated
- Nov 28, 2024