Downloads · 30 days
14
3% of all-time downloads
llama-3-neural-chat-v1-8b-AWQ
solidrust/llama-3-neural-chat-v1-8b-AWQ
llama-3-neural-chat-v1-8b-AWQ is a text generation model from solidrust. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
- Model creator: Locutusque - Original model: llama-3-neural-chat-v1-8b
All-time downloads
417
Public
Parameters
8B
5.7 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors5.7 GB · 100%
Parameter types
How the weights are stored.
I327B · 87%
Try a prompt
Base models
Model card
From the Hugging Face model README
Locutusque/llama-3-neural-chat-v1-8b AWQ
- Model creator: Locutusque
- Original model: llama-3-neural-chat-v1-8b
Model Summary
I fine-tuned llama-3 8B on an approach similar to Intel's neural chat language model. I have slightly modified the data sources so it is stronger in coding, math, and writing. I use both SFT and DPO.
This model has great performance in writing and coding.
Training Data
- Open-Orca/SlimOrca-Dedup
- jondurbin/airoboros-3.2
- microsoft/orca-math-word-problems-200k
- m-a-p/Code-Feedback
- MaziyarPanahi/WizardLM_evol_instruct_V2_196k
- mlabonne/orpo-dpo-mix-40k
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Created
- Apr 20, 2024
- Updated
- Sep 3, 2024