Downloads · 30 days
6
29% of all-time downloads
mathstral-neuron
nithiyn/mathstral-neuron
mathstral-neuron is a machine learning model from nithiyn. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Mathstral compiled for Neuron It has been compiled to run on an inf2.24xlarge instance on AWS. Note that while the inf2.24xlarge has 12 cores, this compilation uses 12.
All-time downloads
21
Public
Repo size
27.3 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.neff26.7 MB · 91%
At a glance
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Oct 8, 2024
- Updated
- Oct 16, 2024
- SHA
- 11c76843
Model card
From the Hugging Face model README
Mathstral compiled for Neuron It has been compiled to run on an inf2.24xlarge instance on AWS. Note that while the inf2.24xlarge has 12 cores, this compilation uses 12.
SEQUENCE_LENGTH = 4096
BATCH_SIZE = 4
NUM_CORES = 12
PRECISION = "bf16"
- Type
- mistral
- License
- apache-2.0
- Created
- Oct 8, 2024
- Updated
- Oct 16, 2024