Downloads · 30 days
10
20% of all-time downloads
xenith-3b
XeroCodes/xenith-3b
xenith-3b is a text generation model from XeroCodes. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
Xenith-3B is a fine-tuned language model based on the microsoft/Phi-3-mini-4k-instruct model. It has been specifically trained on the AlignmentLab-AI/alpaca-cot-collection dataset, which focuses on chain-of-thought re…
All-time downloads
51
Public
Parameters
3.8B
7.8 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors7.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Aug 11, 2024
- Updated
- Aug 11, 2024
- SHA
- 93a5841b
Try a prompt
Base models
Model card
From the Hugging Face model README
Xenith-3B
Xenith-3B is a fine-tuned language model based on the microsoft/Phi-3-mini-4k-instruct model. It has been specifically trained on the AlignmentLab-AI/alpaca-cot-collection dataset, which focuses on chain-of-thought reasoning and instruction following.
Model Overview
- Model Name: Xenith-3B
- Base Model: microsoft/Phi-3-mini-4k-instruct
- Fine-Tuned On: AlignmentLab-AI/alpaca-cot-collection
- Model Size: 3 Billion parameters
- Architecture: Transformer-based LLM
Training Details
- Objective: Fine-tune the base model to enhance its performance on tasks requiring complex reasoning and multi-step problem-solving.
- Training Duration: 10 epochs
- Batch Size: 8
- Learning Rate: 3e-5
- Optimizer: AdamW
- Hardware Used: 2x NVIDIA L4 GPUs
Performance
Xenith-3B excels in tasks that require:
- Chain-of-thought reasoning
- Instruction following
- Contextual understanding
- Complex problem-solving
The model has shown significant improvements in these areas compared to the base model.
- Task
- Text Generation
- Library
- peft
- Type
- mistral
- License
- apache-2.0
- Languages
- en
- Created
- Aug 11, 2024
- Updated
- Aug 11, 2024