[SIGGRAPH Asia 2025] Topology-Aware Optimization of Gaussian Primitives for Human-Centric Volumetric Videos

Yuheng Jiang, Chengcheng Guo, Yize Wu, Yu Hong, Shengkun Zhu, Zhehao Shen, Yingliang Zhang, Shaohui Jiao, Zhuo Su, Lan Xu, Marc Habermann, Christian Theobalt
| Webpage | Full Paper | Video | Dataset |

Overview

Official implementation of TaoGS (Topology-Aware Optimization of Gaussian Primitives for Human-Centric Volumetric Videos)

We propose a novel motion-to-appearance Gaussian representation for robust tracking and high-fidelity rendering of general 4D scenes with topological changes. We track sparse motion Gaussians and incorporate new candidate Gaussians through a spatial-temporal tracker and error map to model new observations. The motion Gaussians are then transformed into a Gaussian Look-Up Table (GLUT), activating corresponding appearance Gaussians, which can be packed into 2D attribute maps for efficient video codec compression.

Our work is built upon 3DGS, DualGS, and Reperformer.

Show/Hide

Citation

If you find this work useful for your research, please cite these works using the following BibTeX entry.

@misc{jiang2025topology,
    title={Topology-Aware Optimization of Gaussian Primitives for Human-Centric Volumetric Videos}, 
    author={Yuheng Jiang and Chengcheng Guo and Yize Wu and Yu Hong and Shengkun Zhu and Zhehao Shen and Yingliang Zhang and Shaohui Jiao and Zhuo Su and Lan Xu and Marc Habermann and Christian Theobalt},
    year={2025},
    eprint={2509.07653},
    archivePrefix={arXiv},
    primaryClass={cs.GR},
    url={https://arxiv.org/abs/2509.07653}, 
}

@article{jiang2024robust,
    title={Robust dual gaussian splatting for immersive human-centric volumetric videos},
    author={Jiang, Yuheng and Shen, Zhehao and Hong, Yu and Guo, Chengcheng and Wu, Yize and Zhang, Yingliang and Yu, Jingyi and Xu, Lan},
    journal={ACM Transactions on Graphics (TOG)},
    volume={43},
    number={6},
    pages={1--15},
    year={2024},
    publisher={ACM New York, NY, USA}
}

@InProceedings{Jiang2025reperformer,
    author={Jiang, Yuheng and Shen, Zhehao and Guo, Chengcheng and Hong, Yu and Su, Zhuo and Zhang, Yingliang and Habermann, Marc and Xu, Lan},
    title={RePerformer: Immersive Human-centric Volumetric Videos from Playback to Photoreal Reperformance},
    booktitle={Proceedings of the Computer Vision and Pattern Recognition Conference (CVPR)},
    month={June},
    year={2025},
    pages={11349-11360}
}

@Article{kerbl3Dgaussians,
    author       = {Kerbl, Bernhard and Kopanas, Georgios and Leimk{\"u}hler, Thomas and Drettakis, George},
    title        = {3D Gaussian Splatting for Real-Time Radiance Field Rendering},
    journal      = {ACM Transactions on Graphics},
    number       = {4},
    volume       = {42},
    month        = {July},
    year         = {2023},
    url          = {https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/}
}

Coming soon~