Downloads · 30 days
443
1% of all-time downloads
MobileLLaMA-1.4B-Base
mtgv/MobileLLaMA-1.4B-Base
MobileLLaMA-1.4B-Base is a text generation model from mtgv. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
MobileLLaMA-1.4B-Base is a Transformer with 1.4B billon paramters. We downscale LLaMA to facilitate the off-the-shelf deployment. To make our work reproducible, all the models are trained on 1.3T tokens from the RedPa…
All-time downloads
49.4K
Public
Repo size
5.5 GB
Likes
21
Public
Repo makeup
Click a slice to open those files.
.bin2.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Dec 28, 2023
- Updated
- Dec 29, 2023
- SHA
- c7d8472e
Try a prompt
Model card
From the Hugging Face model README
Model Summery
MobileLLaMA-1.4B-Base is a Transformer with 1.4B billon paramters. We downscale LLaMA to facilitate the off-the-shelf deployment. To make our work reproducible, all the models are trained on 1.3T tokens from the RedPajama v1 dataset only. This benefits further research by enabling controlled experiments.
We extensively assess our models on two standard natural language benchmarks, for language understanding and common sense reasoning respectively. Experimental results show that our MobileLLaMA 1.4B is on par with the most recent opensource models.
Model Sources
- Repository: https://github.com/Meituan-AutoML/MobileVLM
- Paper: https://arxiv.org/abs/2312.16886
How to Get Started with the Model
Model weights can be loaded with Hugging Face Transformers. Examples can be found at Github.
Training Details
please refer to our paper in section 4.1: MobileVLM: A Fast, Strong and Open Vision Language Assistant for Mobile Devices.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Dec 28, 2023
- Updated
- Dec 29, 2023