Downloads · 30 days
4
18% of all-time downloads
Mistral-Large-Instruct-2407-neuron
nithiyn/Mistral-Large-Instruct-2407-neuron
Mistral-Large-Instruct-2407-neuron is a machine learning model from nithiyn. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository contains AWS Inferentia2 and neuronx compatible checkpoints for Mistral-Large-Instruct. You can find detailed information about the base model on its Model Card.
All-time downloads
22
Public
Repo size
19 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.neff18.5 MB · 87%
At a glance
- Model type
- mistral
- Access
- Public
- Created
- Oct 8, 2024
- Updated
- Oct 10, 2024
- SHA
- b3f523ab
Model card
From the Hugging Face model README
This repository contains AWS Inferentia2 and neuronx compatible checkpoints for Mistral-Large-Instruct. You can find detailed information about the base model on its Model Card.
This model has been exported to the neuron format using specific input_shapes and compiler parameters detailed in the paragraphs below.
It has been compiled to run on an inf2.48xlarge instance on AWS. Note that while the inf2.48xlarge has 24 cores, this compilation uses 24.
SEQUENCE_LENGTH = 4096
BATCH_SIZE = 4
NUM_CORES = 24
PRECISION = "bf16"
license: other license_name: mrl license_link: LICENSE language:
- en base_model:
- mistralai/Mistral-Large-Instruct-2407 pipeline_tag: text-generation
- Type
- mistral
- Created
- Oct 8, 2024
- Updated
- Oct 10, 2024