DreamX-Creator 1.0 is a research framework for native joint audio-video generation. Given a first frame and a text prompt, its implemented base generator jointly models modality-specialized video and audio streams, using Gated Cross-Modal Attention and Progressive Joint Training to enable bidirectional audio-video interaction.
The broader system combines Audio-Video Reinforcement Learning with Modality-Aware Multimodal Feedback to improve visual and audio quality, semantic consistency, and fine-grained audio-video synchronization. Autoregressive 1-Step 2K Refinement then upgrades the generated video to high-quality 2K output while preserving content, motion, and audio-aligned timing.
- Sep 1, 2026: Initialized the DreamX-Creator project repository with its overview and release roadmap.
- ✔️ Initialize the DreamX-Creator project repository.
- ✔️ Release the DreamX-Creator 1.0 technical report.
- Release validated model weights, inference code, configurations, and evaluation tools.
If you find DreamX-Creator useful in your research, please consider citing our technical report:
@misc{zhu2026dreamxcreatordemocratizingnativeaudiovideo,
title={DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolution},
author={Jiashu Zhu and Yanhao Zheng and Ruitian Tian and Rujing Dang and Shen Zhang and Bingze Song and Jiachen Lei and Ruimin Lin and Jiahong Wu and Xiangxiang Chu},
year={2026},
eprint={2608.31106},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2608.31106},
}This project is licensed under the Apache License 2.0. See LICENSE for details.
We would like to thank the Wan Team and the OpenMOSS Team for their outstanding open-source work on Wan and MOVA, respectively.
