·★ MEMBER·PAPER·8 min read

Paper Explained: SenseNova-U1.5 — One Model That Both Sees and Draws, With No Encoder and No VAE

SenseNova-U1.5 is an 8B unified model that learns straight from pixels and words, with no vision encoder for understanding and no VAE for generation. We walk through its seam-free spatial decoder and its 'train specialists separately, then distill them into one' post-training, following the paper itself.

Key points

  • SenseNova-U1.5 is an 8B-MoT native unified multimodal model that understands, reasons about, and generates visual content, built without any vision encoder or VAE.
  • Most image AI systems today use two translators: a vision encoder that turns images into meaning, and a VAE that turns meaning back into images.
  • U1.5 cuts the image into 32×32-pixel blocks and treats each block as a single token, so a 1024×1024 image becomes 1,024 tokens.
  • U1 used a small MLP to turn each token back into a patch independently, so colors and textures drifted apart at the borders, worse at high resolution.
  • U1.5 lays the tokens back out as a 2D map and lets neighbors exchange information before any pixel is finalized.
ModalityimageTaskgeneration

SenseNova-U1.5: Towards Native Unified Visual Intelligence

Primary source — what this article is built on

undefined2026-09-10→undefined2026-09-261 mo later

SenseNova-U1.5: Towards Native Unified Visual IntelligenceHaiwen Diao, Jiahao Wang, Chenjing Ding et al. · 2026-09-10 · v1arXiv:2609.11929Paper page·PDF
undefined

We launch SenseNova-U1.5, an 8B-MoT native unified multimodal model that understands, reasons about, and generates visual content within an encoder-free and VAE-free architecture. We strengthen its visual interface through spatially coherent patch reconstruction and scale its training with carefully curated generation and editing data, improved task formulation, structural prompt enhancement, and native resolutions of up to 4K. For post-training, we optimize specialized experts for visual aesthetics, bilingual text rendering, infographic generation, and image editing, and consolidate their capabilities through multi-expert on-policy distillation. Across extensive evaluations, SenseNova-U1.5 largely advances image fidelity, text rendering, complex composition, multi-reference editing, and interleaved generation, while improving instruction following and preserving subject identity, geometry, and unmodified regions. Despite limited exposure to structured formats in its generation data, SenseNova-U1.5 generalizes effectively to long, complex, and structured visual instructions, further proving that multimodal understanding can transfer to visual planning and creation. Together, these findings position native unified modelling as a promising path towards systems that perceive, reason and create within a fully end-to-end framework. We will open-source training code, including supervised fine-tuning, reinforcement learning, and on-policy distillation.


Merging the "viewer" and the "illustrator" into one person

The paper is "SenseNova-U1.5: Towards Native Unified Visual Intelligence" (arXiv:2609.11929, published September 10, 2026).

Here is what the abstract says. SenseNova-U1.5 is an 8B-MoT (Mixture-of-Transformers) native unified multimodal model that understands, reasons about, and generates visual content, built without any vision encoder or VAE. The authors strengthen its visual interface with spatially coherent patch reconstruction, and scale training with curated generation and editing data, better task formulation, structured prompt enhancement, and native resolutions up to 4K. In post-training they optimize separate experts for aesthetics, bilingual (Chinese/English) text rendering, infographic generation, and image editing, then consolidate them through multi-expert on-policy distillation. They report large gains in image fidelity, text rendering, complex composition, multi-reference editing, and interleaved text-image generation, along with better instruction following and better preservation of subject identity, geometry, and unedited regions. Although structured formats are rare in its generation data, the model generalizes to long, complex, structured visual instructions, which the authors read as evidence that multimodal understanding can transfer to visual planning and creation. Training code for SFT, RL, and on-policy distillation is announced for release.

Most image AI systems today employ two translators. One turns images into meaning (a vision encoder); the other turns meaning back into images (a VAE). They work from different dictionaries, so every time the model draws what it understood, something has to be looked up again. That is the paper's starting point (§1): understanding lives in a space tuned for semantic abstraction, generation in a space tuned for pixel fidelity.

SenseNova-U1.5 is the latest in a line of models that drop the translators and hire one person who reads and writes pixels and words directly. Its predecessor, SenseNova-U1, showed the approach was feasible. U1.5 fixes two of its weaknesses: visible seams between patches, and the way different skills interfere with each other when trained under a single policy.

Intuition: a 32×32 block is one word

U1.5 cuts the image into 32×3232\times 32-pixel blocks and treats each block as a single token, one "word" from the model's point of view (§3.1). Two convolutions shrink the image by 16× and then 2× to get there. A 1024×1024 image becomes 32×32 = 1,024 tokens. Because there is no encoder in the way, the authors argue, the image becomes a short sequence while losing almost nothing.

The trouble was at the exit. U1 used a small MLP to turn each token back into a 32×32 RGB patch on its own. A patch decided its colors without knowing what its neighbor would do, so colors and textures drifted apart at the borders. The paper describes this as seams, grid artifacts, and texture breaks that get worse at high resolution (§1, §3.1).

JPEG has the same kind of problem. It splits the image into 8×8 blocks and processes each one independently, so heavy compression makes the block edges show. Lower the quality in the figure below and watch them appear.

FIG 1Process blocks independently, strip away information, and the borders start to show. U1's "decode each patch on its own" exit had the same kind of seam

U1.5's fix is to lay the tokens back out as a 2D map and let neighbors exchange information before any pixel is finalized.

The backbone's output is reshaped into a 2D grid with height and width (§3.1). is the batch size and the length of each token's vector. Put simply, the row of words goes back to where each word sat in the picture.…

What's behind this

§

Members-only from here

449 walkthroughs, 42 textbook chapters, 48 student units and 6 close readings — all included for $4.99/mo, with about three new explainers a day on average. Cancel any time; access runs to the end of the period.

Already a member? Sign in to keep reading

References

  1. Haiwen Diao, Jiahao Wang, Chenjing Ding, Hanming Deng et al.. (2026-09-10) SenseNova-U1.5: Towards Native Unified Visual Intelligence. arXiv:2609.11929Paper page·PDF

This article is written from the source paper above. Where they differ, the original is authoritative.

Published by TechAthletes · Editorial policy · How we cite · Corrections

Comments

Sign in to comment