Downloads · 30 days
81
6% of all-time downloads
jpacifico/French-Alpaca-Phi-3-mini-4k-instruct-v1.0-GGUF
French-Alpaca-Phi-3-mini-4k-instruct-v1.0-GGUF is a machine learning model from jpacifico. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
May 2024 : currently the fastest and most efficient version of French-Alpaca, the general SLM in French 4k tokens of window context
Downloads · 30 days
81
6% of all-time downloads
All-time downloads
1.3K
Public
Repo size
2.3 GB
Likes
2
Public
Click a slice to open those files.
.gguf2.3 GB · 100%
From the Hugging Face model README
May 2024 : currently the fastest and most efficient version of French-Alpaca, the general SLM in French
4k tokens of window context
French-Alpaca is a 3.82B params Small Language Model (SLM) based on microsoft/Phi-3-mini-4k-instruct,
fine-tuned from the original French-Alpaca-dataset entirely generated with OpenAI GPT-3.5-turbo.
The fine-tuning method is inspired from https://crfm.stanford.edu/2023/03/13/alpaca.html
This quantized q4_k_m GGUF version can be used on a CPU device, compatible llama.cpp
Now supported architecture by LM Studio.
Ready for Raspberry Pi 5 8Gb
Usage
ollama run jpacifico/french-alpaca-3b
Ollama Modelfile best example I tested yet:
FROM ./french-alpaca-phi-3-mini-4k-instruct-Q4-v1.gguf
TEMPLATE """{{ if .System }}<|system|>
{{ .System }}<|end|>
{{ end }}{{ if .Prompt }}<|user|>
{{ .Prompt }}<|end|>
{{ end }}<|assistant|>
{{ .Response }}<|end|>
"""
PARAMETER num_keep 4
PARAMETER stop "<|user|>"
PARAMETER stop "<|assistant|>"
PARAMETER stop "<|system|>"
PARAMETER stop "<|end|>"
PARAMETER stop "<|endoftext|>"
PARAMETER stop "###"
PARAMETER stop "<|fin|>"
Limitations :
The French-Alpaca models family is a quick demonstration that a small LM ( < 8B params )
can be easily fine-tuned to specialize in a particular language. It does not have any moderation mechanisms.
Developed by: Jonathan Pacifico, 2024
Model type: LLM
Language(s) (NLP): French
License: MIT
Finetuned from model : microsoft/Phi-3-mini-4k-instruct