Downloads · 30 days
17
5% of all-time downloads
Mixtral_AI_TinyTronVision-AWQ
solidrust/Mixtral_AI_TinyTronVision-AWQ
Mixtral_AI_TinyTronVision-AWQ is a text generation model from solidrust. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
- Model creator: LeroyDyer - Original model: MixtralAITinyTronVision
All-time downloads
318
Public
Parameters
248M
226 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors226 MB · 99%
Parameter types
How the weights are stored.
I32182M · 74%
Try a prompt
Base models
Model card
From the Hugging Face model README
LeroyDyer/Mixtral_AI_TinyTronVision AWQ
- Model creator: LeroyDyer
- Original model: Mixtral_AI_TinyTronVision
Model Summary
ADD HEAD
print('Add Vision...')
# ADD HEAD
# Combine pre-trained encoder and pre-trained decoder to form a Seq2Seq model
Vmodel = VisionEncoderDecoderModel.from_encoder_decoder_pretrained(
"google/vit-base-patch16-224-in21k", "LeroyDyer/Mixtral_AI_Tiny"
)
_Encoder_ImageProcessor = Vmodel.encoder
_Decoder_ImageTokenizer = Vmodel.decoder
_VisionEncoderDecoderModel = Vmodel
# Add Pad tokems
LM_MODEL.VisionEncoderDecoder = _VisionEncoderDecoderModel
# Add Sub Components
LM_MODEL.Encoder_ImageProcessor = _Encoder_ImageProcessor
LM_MODEL.Decoder_ImageTokenizer = _Decoder_ImageTokenizer
LM_MODEL
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- mit
- Languages
- en
- Created
- Apr 19, 2024
- Updated
- Sep 3, 2024