Downloads · 30 days
3
6% of all-time downloads
samantha-phi-3-4k-mini
jlorenz/samantha-phi-3-4k-mini
samantha-phi-3-4k-mini is a text generation model from jlorenz. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
samantha-phi-3-4k-mini is a SFT model made with AutoSloth by macadeliccc
All-time downloads
52
Public
Repo size
15.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin7.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Jul 23, 2024
- Updated
- Jul 23, 2024
- SHA
- 261b51db
Try a prompt
Model card
From the Hugging Face model README
samantha-phi-3-4k-mini
samantha-phi-3-4k-mini is a SFT model made with AutoSloth by macadeliccc
Process
-
Original Model: unsloth/Phi-3-mini-4k-instruct
-
Datatset: macadeliccc/opus_samantha
-
Learning Rate: 1.41e-05
-
Steps:
-
Warmup Steps:
-
Per Device Train Batch Size: 2
-
Gradient Accumulation Steps 1
-
Optimizer: paged_adamw_8bit
-
Max Sequence Length: 4096
-
Max Prompt Length: 2048
-
Max Length: 2048
💻 Usage
!pip install -qU transformers
from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline
model = "jlorenz/samantha-phi-3-4k-mini"
tokenizer = AutoTokenizer.from_pretrained(model)
# Example prompt
prompt = "Your example prompt here"
# Generate a response
model = AutoModelForCausalLM.from_pretrained(model)
pipeline = pipeline("text-generation", model=model, tokenizer=tokenizer)
outputs = pipeline(prompt, max_length=50, num_return_sequences=1)
print(outputs[0]["generated_text"])
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Created
- Jul 23, 2024
- Updated
- Jul 23, 2024