Downloads · 30 days
0
MineDreamer-InstructPix2Pix-Unet
Zhoues/MineDreamer-InstructPix2Pix-Unet
MineDreamer-InstructPix2Pix-Unet is a machine learning model from Zhoues. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Access
Public
Updated Apr 6, 2024
Repo size
3.4 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin3.4 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Apr 1, 2024
- Updated
- Apr 6, 2024
- SHA
- baf4b58d
Datasets
Model card
From the Hugging Face model README
Model Card for MineDreamer 🔥
<!-- Provide a quick summary of what the model is/does. -->
MineDreamer is an instructable embodied agent for simulated control and it is developed on top of recent advances in Multimodal Large Language Models (MLLMs) and diffusion models!
<p align="center"> <img src="https://cdn-uploads.huggingface.co/production/uploads/63f08dc79cf89c9ed1bb89cd/S62I1Tn5qz5qJ3IkgMHH8.png" width=93%> <p>MineDreamer can follow instructions steadily by employing a Chain-of-Imagination (CoI) mechanism to envision the step-by-step process of executing instructions and translating imaginations into more precise visual prompts tailored to the current state; subsequently, it generates keyboard-and-mouse actions to efficiently achieve these imaginations,
<p align="center"> <img src="https://cdn-uploads.huggingface.co/production/uploads/63f08dc79cf89c9ed1bb89cd/LJxBMChCFng_RkXwUotfk.png" width=93%> <p>This repo is used for hosting MineDreamer's InstructPix2Pix checkpoints, which are not only the baseline checkpoints but the training stage 2 checkpoints for Imaginator as well.
For more details or tutorials see https://github.com/Zhoues/MineDreamer.
- License
- apache-2.0
- Languages
- en, zh
- Created
- Apr 1, 2024
- Updated
- Apr 6, 2024