SenseNova-U1-8B-MoT-Infographic-V3

SenseNova-U1-8B-MoT-Infographic-V3

<p align="center"> <strong>English</strong> | <a href="https://huggingface.co/sensenova/SenseNova-U1-8B-MoT-Infographic-V3/blob/main/README_CN.md">简体中文</a> </p> <p align="center"> <a href="https://arxiv.org/abs/2605.12500"><img src="https://img.shields.io/badge/arXiv-2605.12500-b31b1b.svg" alt="arXiv"></a> <a href="https://huggingface.co/collections/sensenova/sensenova-u1"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20HuggingFace-Model-yellow" alt="HuggingFace Model"></a> <a href="https://modelscope.cn/collections/SenseNova/SenseNova-U1"><img src="https://img.shields.io/badge/%F0%9F%A4%96%20ModelScope-模型-purple" alt="ModelScope-模型"></a> <a href="https://unify.light-ai.top/"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20SenseNova_U1-Demo-Green" alt="SenseNova-U1 Demo"></a> <a href="https://github.com/OpenSenseNova/SenseNova-U1/blob/main/LICENSE"><img src="https://img.shields.io/badge/License-Apache%202.0-blue.svg" alt="License"></a> <a href="https://discord.com/invite/BuTXPHmQub"><img src="https://img.shields.io/badge/Discord-Join-5865F2?logo=discord&logoColor=white" alt="Discord"></a> </p> <p align="center"> <img src="docs/assets/teaser.webp" alt="SenseNova-U1" width="900"> </p>

📣 Updated News

• [2026.07.16] Release SenseNova-U1-8B-MoT-Infographic-V3 📊, designed for integrated infographic generation and editing. It retains strong text-to-image (T2I) capabilities while significantly enhancing infographic editing, supporting localized text and content editing, global style editing, and global layout editing. See ✨ U1 Infographic Model Series for model details and benchmark results.

<details> <summary>✨ Click to expand older news</summary>

• [2026.06.29] Release SenseNova-U1-8B-MoT-Infographic-V2 📊, an upgraded infographic model with improved dense small-text rendering with sharper text edges, stronger complex dense-layout generation, and better overall visual aesthetics and harmony, plus a fix for the black-background issue. Model details and visual examples are available in ✨ U1 Infographic Model Series.

• [2026.06.12] Release SenseNova-U1-8B-MoT-Infographic-LoRA-8step-V1.0 for faster infographic generation. Please see the example script.

• [2026.06.11] Release SenseNova-U1-8B-MoT-Interleaved 📖, specially optimized for interleaved image-text generation, with notably improved narrative coherence, character and style consistency, and text-image alignment in multi-page content.

• [2026.05.21] Release the full-parameter fine-tuning training code for SenseNova-U1.

• [2026.05.15] Release SenseNova-U1-8B-MoT-Infographic 📊 model for improved infographic generation. See U1 Infographic Model Series for details, and ✨ Infographic Showcases for 100 generated examples.

• [2026.05.10] Release 🔥SenseNova-U1 Technical Report🔥 and the weights for SenseNova-U1-A3B-MoT-SFT & SenseNova-U1-A3B-MoT.

• [2026.05.08] Add GGUF quantized checkpoints and layer-offload VRAM modes for low-VRAM single-GPU inference. See Memory-efficient inference. GGUF weights for SenseNova-U1-8B-MoT-Merger are available at 🤗 smthem/SenseNova-U1-8B-MoT-Merger-gguf — many thanks to @smthem for contributing the quantized weights.

• [2026.05.06] Release SenseNova-U1-8B-MoT-LoRA-8step-V1.0. Please see the example script.

• [2026.04.30] Release the preview version of the 8-step inference model SenseNova-U1-8B-MoT-8step-preview. In most cases, the image generation quality of this model closely matches that of the base model (see comparison and existing issues). To test this model, you can use the inference scripts, but with the following parameters: --cfg_scale 1.0 --num_steps 8 .

• [2026.04.27] Initial release of the weights for SenseNova-U1-8B-MoT-SFT and SenseNova-U1-8B-MoT.

• [2026.04.27] Initial release of the inference code for SenseNova-U1.

</details>

🌟 Overview

🚀 SenseNova U1 is a new series of native multimodal models that unifies multimodal understanding, reasoning, and generation within a monolithic architecture. It marks a fundamental paradigm shift in multimodal AI: from modality integration to true unification. Rather than relying on adapters to translate between modalities, SenseNova U1 models think-and-act across language and vision natively.

<details> <summary>✨ Click to expand architecture details</summary>

Unifying visual understanding and generation in an end-to-end architecture from pixel to word opens tremendous possibilities, enabling highly efficient and strong understanding, generation, and interleaved reasoning in a natively multimodal manner.

<p align="center"> <img src="docs/assets/teaser_1.webp" alt="radar plot" width="900"> </p>

🏗️ Key Pillars:

At the core of SenseNova U1 is NEO-unify, a novel architecture designed from the first principles for multimodal AI: It eliminates both Visual Encoder (VE) and Variational Auto-Encoder (VAE) where pixel-word information are inherently and deeply correlated. Several important features are as follows:

• 🔗 Model language and visual information end-to-end as a unified compound.
• 🖼️ Preserve semantic richness while maintaining pixel-level visual fidelity.
• 🧠 Reason across modalities with high efficiency & minimal conflict via native MoTs.

</details>

Powered by this new core architecture, SenseNova-U1-8B-MoT-Infographic-V3 is the recommended release for an integrated infographic generation-and-editing workflow. It retains strong text-to-image (T2I) capability while adding image editing (IT2I) within the same unified model.

<p align="center"> <img src="docs/assets/image_editing_benchmark_performance.png" alt="SenseNova-U1-8B-MoT-Infographic-V3 Image Editing Benchmark Performance" width="100%"> </p>

• Benchmark Performance: V3 reaches an Overall Total of 50.23 on Qwen-Image-Bench, improving by 2.23 over V2's 48.00. It also achieves an Average of 5.89 on WeEdit and an overall score of 7.89 on GEdit-Bench, ranking first among the open-source models included in both editing evaluations.
• Generation and Editing Quality: V3 supports both region-marked precise changes and natural-language-only editing. It handles localized text edits, local content insertion, removal, and replacement, as well as global style and layout editing, while preserving unedited regions whenever possible.

<details> <summary>✨ Click to expand Benchmark Details</summary>

WeEdit (Image Editing)

_{Note: Higher is better. Group-best scores are bolded. Average is the arithmetic mean of the three metrics. V3 ranks first by Average among the open-source models included in this evaluation.}

GEdit-Bench (Image Editing)

_{Note: Higher is better. Group-best scores are bolded. V3 delivers the best overall performance among the open-source models included in this evaluation.}

Qwen-Image-Bench (Text-to-Image)

_{Note: Higher is better. Column-best scores and the V3 model name are bolded. V3 reaches an Overall Total of 50.23, improving by 2.23 over V2's 48.00.}

Historical Infographic Generation Benchmarks

<details> <summary><b>Expand for complete BizGenEval, IGenBench, and OneIG results</b></summary>

_{Note: V3 is the current release and is pinned to the first row of the open-source section. IGenBench scores are reported as percentages; the remaining commercial and open-source models are sorted separately by the average of BizGenEval hard/easy and IGenBench Q-ACC/I-ACC. OneIG is included as a general generation reference.}

V2 and V3 are independently trained from the same base model with different task and data mixtures. V3 jointly trains infographic text-to-image generation and image editing with a lower proportion of IGenBench-related training data than V2, resulting in lower IGenBench scores than the generation-focused V2. At the same time, V3 remains broadly comparable to V2 on BizGenEval, improves the broader Qwen-Image-Bench score from 48.00 to 50.23, and adds infographic image-editing capability.

</details> </details> ## SenseNova-U1-8B-MoT-Infographic-V3 Showcase

The following V3 examples are organized around integrated infographic generation-and-editing capabilities. They cover T2I generation and IT2I editing scenarios, including four major editing capability groups: local text editing, local content editing, global style editing, and global layout editing, and demonstrate precise dense-text repair and consistency preservation in non-edited regions.

Local Text Editing

Region-Marked Precise Editing

<table width="100%" style="table-layout: fixed;"> <tr> <th width="28%" align="left">Instruction</th> <th width="36%" align="left">Before Edit</th> <th width="36%" align="left">After Edit</th> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">将蓝色框中的屋顶变为红色，将红框中的标题改为比较简短的格式，将绿框中的屋子改为红色屋顶的咖啡屋，将紫色框中改为共享自行车站，将粉色框中的内容改为书柜，将右下角青色框中的内容改为，室内植物玻璃房</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/bbc1e512-b947-4a7f-a2bf-219716b57e47" alt="V3 edit showcase 26 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/ec2479e2-3aa4-4b8a-850b-64c6ccd5e73d" alt="V3 edit showcase 26 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">把红色框的“经典·从容·每一刻”换成经典时尚手表，蓝色框换成“100米防水”，橙色框换成电池寿命约10年</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/05802591-b36b-49fc-93aa-e625ca29af8e" alt="V3 edit showcase 03 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/7eb76c56-af18-4025-aec4-1feb6417d164" alt="V3 edit showcase 03 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">修复红框内模糊标题为“量子互联网的第一条链路”，去掉红框，其余不动。</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/d7bc06a3-db7e-4fd2-802c-71a7489bde7a" alt="V3 edit showcase 04 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/08631c76-390c-448c-81fd-5d087b0fa7fd" alt="V3 edit showcase 04 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">请在图像中红色边界框标出的空白区域内插入指定内容，并使新增内容与真实环境的材质、透视、光照和空间关系自然融合。<br>目标区域：<br>“画面左下角主面板下方的空白深色区域，位于左侧四个数据卡片下方、底部图表左侧的红色边界框内部”<br>需要插入的文字或内容为：<br>“年度结余目标：120,000元”<br>请严格将新增内容限制在红框内部。完成插入后，需要彻底去除红色边界框，使最终图像中不再显示任何红线、控制点、箭头或编辑标记。<br>在插入内容之前，请先分析目标区域的实际环境，包括：<br>深色金融仪表盘背景的平面方向；<br>目标区域的矩形仪表盘面板边界；<br>玻璃拟态卡片、深色渐变背景和细线边框材质；<br>光源方向和亮度；<br>环境阴影与微弱高光；<br>字体应该像金融仪表盘中的数字标签和状态卡片，而不是普通贴纸文字。<br>新增文字必须按照目标表面的透视自然放置。由于目标区域是正面仪表盘平面，文字应保持水平排版、居中或左对齐，并与原有卡片网格对齐。<br>新增内容的颜色、亮度和清晰度必须符合环境光照。建议使用浅色文字配合绿色或金色强调数字，使其与原图“储蓄率 41%”“目标完成 76%”等数据卡片风格一致。不能使用与场景完全无关的纯白贴字，也不能让文字看起来悬浮在表面前方。<br>如果目标区域是仪表盘卡片：<br>文字应在红框内部合理居中；<br>保留原有深色面板边缘、微弱发光和阴影；<br>不得覆盖相邻卡片、图表或边框；<br>可以根据原有设计加入适当内边距和小型图标。<br>插入的文字必须完整、清晰、无乱码、无错别字。字体风格应与金融仪表盘和数据卡片用途相符，不得使用与场景冲突的字体。<br>除红框内部区域和红框本身之外，图像中的其他内容必须保持完全不变。不得移动标题“个人年度财务仪表盘”、左侧数据卡、现金流图、储蓄仪表、支出分类图、目标追踪列表或任何其他物体，不得改变整体光照、颜色和构图。<br>不得扩大目标区域，不得把新增内容放到红框外，也不得保留红框作为最终设计元素。<br>最重要的是，新增内容必须像原本就存在于该金融仪表盘中，而不是后来粘贴上去。最终画面应具有正确的材质融合、环境光照、卡片层级和自然对齐关系。</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/fd54835f-44fe-46a3-948e-27f974553a90" alt="V3 edit showcase 05 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/f5b9dfc2-0aa2-40eb-98fe-136efd49c850" alt="V3 edit showcase 05 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">将原西班牙语标题替换为英文“STOP USING SHOWER SPONGES!”和副标题“YOUR SKIN DESERVES BETTER”，移除红框，框外所有文字、人物、颜色和布局完全不变。</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/95f80cb9-0784-4b6b-bacf-9861fa9bb274" alt="V3 edit showcase 06 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/a1569284-f926-488c-a6c9-c9fe2c72b79f" alt="V3 edit showcase 06 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">翻译红框中的内容</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/fd532f0a-12ac-4eb8-9cb9-99c755f54596" alt="V3 edit showcase 07 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/5c347441-83e7-4bca-9812-3c2febddd670" alt="V3 edit showcase 07 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">把红色框的“我不见，黄河之水地下来”替换成“君不见，黄河之水天上来”，把蓝色框的“我不见，高堂明镜悲白发”替换成“君不见，高堂明镜悲白发”。</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/da548cba-72bc-474f-8dbb-1b14d84e8c68" alt="V3 edit showcase 08 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/38d4121e-44b2-4c6d-bb1b-d0307720937e" alt="V3 edit showcase 08 output" width="100%"></td> </tr> </table>

Natural-Language Prompt Editing

<table width="100%" style="table-layout: fixed;"> <tr> <th width="28%" align="left">Instruction</th> <th width="36%" align="left">Before Edit</th> <th width="36%" align="left">After Edit</th> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">主题风格换成漫画风格，需要进行以下修改：<br>第一项修改：将原图中的文字：“STYLE”替换为：“时尚杂志”<br>第二项修改：将原图中的文字：“FORWARD”替换为：“美丽的补充力”</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/d828ad2e-dc25-41dc-b4fa-09c6430cf602" alt="V3 edit showcase 01 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/886a00d5-8b33-405d-84a1-0d6b1ec466fc" alt="V3 edit showcase 01 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;"><br>第一项修改：将原图中的文字：“不够高级“替换为：“DESIGN！OR DIE！”第二项修改：将原图中的文字：“没有惊喜感”，换成“缺乏设计感会导致”</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/6668849d-6200-4bdd-bd0f-9c942a5858a9" alt="V3 edit showcase 09 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/a6bb0c48-7f53-4978-8cfe-06c0a96e879a" alt="V3 edit showcase 09 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;"><br>第一项修改：将原图中的文字：“城市低碳生活地图”替换为：“城市绿色出行地图”第二项修改：将原图中的文字：“绿色出行 42%”替换为：“绿色出行 56%”第三项修改：将位于画面右上角卡片中的“节能建筑 36栋”，调整为“低碳建筑 48栋”。第四项修改：删除文字“社区回收 18站”中的“社区”，保留为“回收 18站”，并确保删除后语句自然、排版完整。第五项修改：修正原图中的数据：“公共绿地 128公顷”修改为“公共绿地 156公顷”。</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/12d33583-2451-43b0-bf81-96059e2eaf3e" alt="V3 edit showcase 10 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/09d654dd-f43c-4a44-91bb-8aff15663b0c" alt="V3 edit showcase 10 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">把“主要航海壮举”换成“主要事件”，把“地理大发现时代”换成“！！地理大发现时期！！”，把“克里斯托弗·哥伦布”，换成“Cristóbal Colón”</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/611832d7-a8c7-44e1-9370-15b8f2d888ce" alt="V3 edit showcase 18 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/f5465b9a-6ef6-42b9-aaad-ab5ae50e50c7" alt="V3 edit showcase 18 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">把“人类进化史”换成“人类——我们的故事”，把“概述”换成“总结”，把“主要进化阶段”换成“演化路径”。</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/12dd48dc-1a75-41ca-a6b5-e33bf5cd75ed" alt="V3 edit showcase 19 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/eadbd53f-65ae-43a6-80f8-6556ed0da8d7" alt="V3 edit showcase 19 output" width="100%"></td> </tr> </table>

Local Content Editing

<table width="100%" style="table-layout: fixed;"> <tr> <th width="28%" align="left">Instruction</th> <th width="36%" align="left">Before Edit</th> <th width="36%" align="left">After Edit</th> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">删除海面下的塑料袋、塑料瓶和吸管，将中央口号改为白色手写体“SAVE OUR OCEAN”，把右侧海龟移到文字下方并在底部新增回收标志，保持海洋分层结构清晰。</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/3c6b175d-5319-4086-b557-9494b9957f41" alt="V3 edit showcase 02 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/7bc71122-4daa-4d26-bd9a-c6ef7d3cf6fa" alt="V3 edit showcase 02 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">透明杯壁上加入“CURLY &amp; PROUD”，文字需随杯面弧度自然变形，并呈现透过玻璃与茶水后的透明度和色偏。</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/6415a2b5-be35-4a26-8ab1-d2ad1dad2b8f" alt="V3 edit showcase 11 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/e6c5c364-9e43-4f3b-918a-404f68aa713c" alt="V3 edit showcase 11 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">复古电脑屏幕内加入绿色单色像素字“DESIGN MODE: ON”，匹配屏幕透视、颗粒噪点与玻璃反光；</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/1051f104-7155-4744-aede-a4d8d91f4a29" alt="V3 edit showcase 12 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/dc63618b-375c-458d-958c-ba553443483e" alt="V3 edit showcase 12 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">将四代员工使用个人AI工具的比例依次改为：Gen Z 92%、Millennials 81%、Gen X 68%、Boomers 55%，并同步调整四根彩色柱子的高度。保留人物插画、英文标题、配色纹理、来源和品牌信息不变。</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/627f4998-cadd-4890-b265-46ece2c5b52b" alt="V3 edit showcase 13 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/00320589-4760-44b1-b52f-e77b6dd4b867" alt="V3 edit showcase 13 output" width="100%"></td> </tr> <tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">在顶部蓝色标题区右上角自然加入一枚金黄色奖杯徽章，奖杯内写“TOP GROWTH”，采用与原图一致的扁平矢量风格、粗线条和蓝黄配色，并添加少量庆祝星光装饰。调整徽章大小避免遮挡“2023 HIGHLIGHTS”，其他文字、数据、插画和布局保持不变。</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/83ef4291-4b31-4aff-bd64-a211cbe7d7cd" alt="V3 edit showcase 16 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/1d6ecedc-838b-4daf-b16d-5cbe51277c92" alt="V3 edit showcase 16 output" width="100%"></td> </tr> </table>

Global Style Editing

<table width="100%" style="table-layout: fixed;"> <tr> <th width="28%" align="left">Instruction</th> <th width="36%" align="left">Before Edit</th> <th width="36%" align="left">After Edit</th> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">主题风格换成乐高风格。将原图中的文字：“2022“替换为：“2025”第二项修改：将原图中的文字：“FINESTBUSINESSTRENDS”换成“HELLO！ WORLD！”</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/9a4889be-ba56-4952-bc84-682f31bd86c7" alt="V3 edit showcase 17 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/6a4c1a30-cb2b-40d7-a26e-ff46a4628999" alt="V3 edit showcase 17 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">把图片风格换成乐高风格和中国春节风格，所有文字换成像素字体。</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/bee3637e-a452-40bf-b610-bfa7561e6975" alt="V3 edit showcase 20 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/8370e414-1be9-482b-8fce-24f3ddcf438e" alt="V3 edit showcase 20 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">将顶部主标题“城市应急避险指挥图”替换为“城市防汛应急联动图”。风格换成赛博朋克风格。</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/d5b2191f-44e6-494e-aa02-9451c4a406c5" alt="V3 edit showcase 21 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/2d2437ff-ffd3-4e94-bd13-8c75b50db2aa" alt="V3 edit showcase 21 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">把图片风格换成中国传统风格。字体换成宋体</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/8e9254a7-041b-4591-b624-23121fd9a5e5" alt="V3 edit showcase 22 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/652069f7-65f5-4479-9279-c51f2bb250ff" alt="V3 edit showcase 22 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">保持内容不变，迁移为亮色风格</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/6d0595cc-7c75-43ed-8f7a-f59f9dba70f2" alt="V3 edit showcase 23 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/f7b2310a-fc49-411d-be5f-242b586ad6f0" alt="V3 edit showcase 23 output" width="100%"></td> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">风格换成复古羊皮纸地图风；保留全部文字、数据与版式。</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/7d53cde2-f182-487d-acf1-7eba7b0aa117" alt="V3 edit showcase 24 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/39ed9c3f-1756-4389-a472-6ffd47f0e2ac" alt="V3 edit showcase 24 output" width="100%"></td> </tr> </table>

Global Layout Editing

<table width="100%" style="table-layout: fixed;"> <tr> <th width="28%" align="left">Instruction</th> <th width="36%" align="left">Before Edit</th> <th width="36%" align="left">After Edit</th> </tr> <tr> <td valign="top" width="28%"><details><summary><b>Instruction</b></summary><div style="margin-top: 8px; font-size: 0.9em; line-height: 1.5;">信息大致不变，对布局进行美化</div></details></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/28ac52b2-1518-4234-ab76-26884dc9f8cd" alt="V3 edit showcase 25 input" width="100%"></td> <td valign="top" width="36%"><img src="https://github.com/user-attachments/assets/0338f4ff-5f76-4f8c-91b2-71087bb503f9" alt="V3 edit showcase 25 output" width="100%"></td> </tr> </table>

🛠️ Quick Start

🌐 Use with SenseNova-Studio

The fastest way to experience SenseNova-U1 is through SenseNova-Studio — a 🆓 free online playground where you can try the model directly in your browser, no installation or GPU required.

Note: To serve more users, U1-Fast has undergone step and CFG distillation, and is dedicated to infographic generation.

🦞 Use with SenseNova-Skills (OpenClaw)

The easiest way to integrate SenseNova-U1 into your own agent or application is through our companion repository SenseNova-Skills (OpenClaw) 🦞, which ships SenseNova-U1 as a ready-to-use skill with a unified tool-calling interface.

Refer to the SenseNova-Skills README for installation and usage details.

<details open> <summary>✨ Click to collapse and view interesting cases made through Skills and Studio</summary> <p align="center"> <img src="docs/assets/showcases/t2i_infographic/u1-case2.webp" alt="Skill Cases"> </p> </details>

🤗 Run with transformers (Default)

Setup: Follow the Installation Guide to clone the repo and install dependencies with uv.

🌟 Generate High-Quality Infographics

For generating complex infographics, we highly recommend using the following parameters: --cfg_scale 4.0, --timestep_shift 3.0, and --num_steps 50.

python examples/t2i/inference.py \
  --model_path sensenova/SenseNova-U1-8B-MoT-Infographic-V3 \
  --prompt "该信息图以复古漫画/动漫风格为主题设计，整体背景为深蓝色星空背景（带有颗粒质感），由多个带有技术网格线和星座线图案装饰的模块围绕中心主题呈海报式上下左右分布布局。中心是一个由两位角色与驾驶舱构成的主体视觉区域，内部包含主标题“SENSETIME”（带星星装饰的黄色大号粗体字），副标题“2026 走向未来！”（蓝色文字），下方有左上角信息框和文字“任务编号：K-2026-ALPHA | 发布日期：2026.06.27 | 保密等级：公开”。中心上方有散落的黄色星星与星座线图案装饰。 信息图共分为六个主要部分，编号1至6，分布在中心周围： **1. 顶部区域（标题与信息框模块）** - **主标题**（黄色大号粗体字带星星装饰）：“SENSETIME”。 - **副标题**（蓝色文字）：“2026 走向未来！”。 - **左上角信息框**（信息标签）：包含“任务编号：K-2026-ALPHA”、“发布日期：2026.06.27”、“保密等级：公开”。 **2. 中心主视觉（角色与装备展示模块）** 以三位角色及驾驶舱按顺序排列，标签连接： - **左侧男性角色**（戴护目镜、红围巾、弹药带，手持武器，帅气姿态动作）：标签文字“左轮手枪”（指向枪套），描述文字“标准配备｜口径：.45｜弹容量：6发｜重量：1.1kg”。 - **中心女性角色**（戴护目镜、红围巾、条纹衫，弹奏白色空心电吉他，吉他上有“KATAO”字样，优美姿态）：标签文字“格雷奇”（指向角色），描述文字“装备型号：G-77电吉他｜频率范围：80Hz-12kHz｜输出功率：50W”。 - **背景右侧角色**（驾驶舱内两名角色，女性调整护目镜，男性戴护目镜看前方）：驾驶舱标签“驾驶舱控制面板｜导航系统：GPS-2025｜通讯频道：CH-77”。 **3. 左侧边栏（任务简报模块）** 包含一段说明文字：“任务简报” 下方配有五项核心指标列表： - 目标：探索未知领域 - 时间：2025年启动 - 地点：黑空 - 队员：精英组 - 装备：未来科技武装 **4. 右侧边栏（成员档案模块）** 包含一段说明文字：“探险队成员档案” 下方配有五名成员及技能列表： - 队长：经验丰富的领航员 - 副队长：技术专家 - 成员A：武器专家 - 成员B：通讯专员 - 特殊技能：时空导航、能量操控、战术分析 **5. 右下角区域（批次规格模块）** 包含一个金色警长星徽图案，内文：“活力 编号01 未来”。 - **大标题**（醒目文字）：“ETB-77”。 - **描述文字**：“这是将分配给未来探险任务的批次。” - **详细信息框**（下方数据框）：“批次规格｜成员数量：2人｜任务时长：365天｜装备清单：完整｜能源补给：充足｜目标区域：未定”。 **6. 底部横幅与背景装饰（标语与元素模块）** 包含一段说明文字：“KATAO探险队｜连接过去与未来｜探索无限可能｜官方网站：www.SENSETIME.com｜联系我们：SENSETIME” 下方配有背景元素装饰：散落的黄色星星、星座线图案、技术网格线装饰。 整体视觉风格复古、结构清晰，通过鲜艳色彩与颗粒质感增强视觉冲击力和未来感，强调在未来探险任务中遵循精英组队、装备未来科技武装，并通过时空导航与能量操控达成探索无限可能的目标。所有文本均为中文（保留特定英文标识），语言简洁硬核，适合用于科幻探险主题的复古漫画风格海报宣传场景。" \
  --width 2720 --height 1536 \
  --cfg_scale 4.0 --cfg_norm none --timestep_shift 3.0 --num_steps 50 \
  --output output.png --profile

Default resolution is 2048×2048 (1:1). See supported resolution buckets for other aspect ratios.

For high-quality infographic generation, it is recommended to apply prompt enhancement before generating images.

✏️ Edit Infographics

python examples/editing/inference.py \
  --model_path sensenova/SenseNova-U1-8B-MoT-Infographic-V3 \
  --prompt "Change the main title to 'SenseNova-U1 V3' while preserving the remaining content and layout." \
  --image docs/assets/showcases/t2i_infographic/0004.webp \
  --cfg_scale 4.0 --img_cfg_scale 1.0 --cfg_norm none \
  --timestep_shift 3.0 --num_steps 50 \
  --output edited_infographic.png --profile --compare

💾 Memory-efficient inference (GGUF + VRAM modes)

For users running on a single consumer GPU, two complementary features lower the VRAM footprint of the transformers path. They can be combined freely.

--vram_mode: single-GPU layer offload

Pass --vram_mode to keep the language-model layers resident on CPU pinned memory and stream them onto the GPU on-demand during forward, freeing weight VRAM while keeping activations on-device.

python examples/t2i/inference.py \
  --model_path sensenova/SenseNova-U1-8B-MoT-Infographic-V3 \
  --vram_mode balanced \
  --prompt "..." --output output.png

--gguf_checkpoint and --vram_mode compose: a Q4 GGUF + balanced is the recommended setup for ~10–12 GB consumer cards.

⚡ Run with LightLLM + LightX2V (Recommended)

For production serving, we co-design a dedicated inference stack on top of LightLLM (understanding) and LightX2V (generation). The two engines are disaggregated so that each path can use its own parallelism and resource budget, with a low-overhead transfer channel in between.

On a single node with TP2 + CFG2, this stack delivers roughly ~0.15 s/step and ~9 s end-to-end for a 2048×2048 image on H100 / H200, with a ~2.4–3.2× prefill speedup from our FA3-based hybrid-mask attention over the Triton baseline. Full per-GPU performance are reported in docs/inference_infra.md.

An official docker image is provided for one-command deployment:

docker pull lightx2v/lightllm_lightx2v:20260407

⚙️ Deployment guide (Docker, launch flags, modes, quantization, API test): see docs/deployment.md.

📖 Full design and performance profiling: see docs/inference_infra.md.

<!-- ## 🖊️ Citation ```bibtex ``` -->

🌐 Join the Community!

Join our growing community to share feedback, get support, and stay updated on the latest SenseNova-U1 developments — we'd love to hear from you!

<div align="center"> <table> <tr> <td align="center"><b><a href="https://discord.com/invite/BuTXPHmQub">Discord</a></b></td> <td align="center"><b>WeChat Group</b></td> </tr> <tr> <td align="center"><a href="https://discord.com/invite/BuTXPHmQub"><img src="docs/assets/discord_qr.webp" width="160"/></a></td> <td align="center"><img src="docs/assets/wechat_qr.webp" width="160"/></td> </tr> </table> </div>

⚖️ License

This project is released under the Apache 2.0 License.