Downloads · 30 days
0
Zhoues/MineDreamer-7B
MineDreamer-7B is a machine learning model from Zhoues. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Downloads · 30 days
0
Access
Public
Updated Apr 6, 2024
Repo size
27.3 GB
Likes
2
Public
Click a slice to open those files.
.bin27.3 GB · 100%
From the Hugging Face model README
MineDreamer is an instructable embodied agent for simulated control and it is developed on top of recent advances in Multimodal Large Language Models (MLLMs) and diffusion models!
<p align="center"> <img src="https://cdn-uploads.huggingface.co/production/uploads/63f08dc79cf89c9ed1bb89cd/S62I1Tn5qz5qJ3IkgMHH8.png" width=93%> <p>MineDreamer can follow instructions steadily by employing a Chain-of-Imagination (CoI) mechanism to envision the step-by-step process of executing instructions and translating imaginations into more precise visual prompts tailored to the current state; subsequently, it generates keyboard-and-mouse actions to efficiently achieve these imaginations,
<p align="center"> <img src="https://cdn-uploads.huggingface.co/production/uploads/63f08dc79cf89c9ed1bb89cd/LJxBMChCFng_RkXwUotfk.png" width=93%> <p>This repo is used for hosting MineDreamer's Imaginator checkpoints.
For more details or tutorials see https://github.com/Zhoues/MineDreamer.