Publications, code and data

PUBLICATIONS

Conference Publications

JOG3R: Towards 3D-Consistent Video Generators

C. H. Huang, N. Mitra, H. Jeong, J. Yoon, D. Ceylan

BMVC, 2025, project website, preprint

Boosting Camera Motion Control for Video Diffusion Transformers

S. Y. Cheong, D. Ceylan, A. Mustafa, A. Gilbert, C. H. Huang

BMVC, 2025, preprint

HUMOTO: A 4D Dataset of Mocap Human Object Interactions

J. Lu, C. H. Huang, U. Bhattacharya, Q. Huang, Y. Zhou

ICCV, 2025, project website, preprint

VideoHandle: Editing 3D Object Compositions in Videos Using Video Generative Priors

J. Koo, P. Guerrero, C.-H. Huang, D. Ceylan, M. Sung

CVPR, 2025, project website, preprint

Shape My Moves: Text-Driven Shape-Aware Synthesis of Human Motions

T.-H. Liao, Y. Zhou, Y. Shen, C.-H. Huang, S. Mitra, J.-B. Huang, U. Bhattacharya

CVPR, 2025, project website, preprint

Track4Gen: Teaching Video Diffusion Models to Track Points Improves Video Generation

H. Jeong, C. H. Huang, J. C. Ye, N. Mitra, D. Ceylan

CVPR, 2025, project website, preprint

MatAtlas: Text-driven Consistent Geometry Texturing & Material Assignment

D. Ceylan, V. Deschaintre, T. Groueix, R. Martin, C. H. Huang, R. Rouffet, V. Kim, G. Lassagne

arXiv preprint, 2024, preprint

ActAnywhere: Subject-Aware Video Background Generation

B. Pan, Z. Xu, C. H. Huang, K. K. Singh, Y. Zhou, L. Guibas, J. Yang,
NeurIPS 2024, project website, preprint

Synergistic Global-space Camera and Human Reconstruction from Videos
Y. Zhao, T. Y. Wang, B. Raj, M. Xu, J. Yang, C. H. Huang
CVPR 2024, project website, preprint

Generative Rendering: Controllable 4D-Guided Video Generation with 2D Diffusion Models
S. Cai, D. Ceylan, M. Gadelha, C. H. Huang, T. Wang, G. Wetzstein
CVPR 2024, project website

BLiSS: Bootstrapped Linear Shape Space
S. Muralikrishnan, C. H. Huang, D. Ceylan, N. J. Mitra
3DV 2024, preprint, project website

Pix2Video: Video Editing using Image Diffusion
D. Ceylan*, C. H. Huang*, N. J. Mitra (*: equal contribution).
ICCV 2023, preprint, project website, media coverage

Blowing in the Wind: CycleNet for Human Cinemagraphs from Still Images
H. Bertiche, N. J. Mitra, K. Kulkarni, C. H. Huang, T. Y. Wang, M. Madadi, S. Escalera, D. Ceylan,
CVPR 2023, preprint, project website

MIME: Human-Aware 3D Scene Generation
H. Yi, C. H. Huang, S. Tripathi, L. Hering, J. Thies, M. J. Black
CVPR 2023, preprint, project website, code,

Reconstructing Signing Avatars From Video Using Linguistic Priors
M.-P. Forte, P. Kulits, C. H. Huang, V. Choutas, D. Tzionas, K. J. Kuchenbecker, M. J. Black,
CVPR 2023, preprint, project website, code

3D Human Pose Estimation via Intuitive Physics
S. Tripathi, L. Müller, C. H. Huang, O. Taheri, M. J. Black, D. Tzionas
CVPR 2023, preprint, project website, dataset

SmartMocap: Joint Estimation of Human and Camera Motion using Uncalibrated RGB Cameras
N. Saini, C. H. Huang, M. J. Black, A. Ahmad
IEEE RAL 2023, preprint, code, video

Capturing and Inferring Dense Full-Body Human-Scene Contact
C. H. Huang, H. Yi, M. Höschle, M. Safroshkin, T. Alexiadis, S. Polikovsky, D. Scharstein, M. J. Black
CVPR 2022, pdf, video, project website

Human-Aware Object Placement for Visual Environment Reconstruction
H. Yi, C. H. Huang, D. Tzionas, M. Kocabas, M. Hassan, S. Tang, J. Thies, M. J. Black
CVPR 2022, pdf, video, code, project website

Accurate 3D Body Shape Regression using Metric and Semantic Attributes
V. Choutas, L. Müller, C. H. Huang, S. Tang, D. Tzionas, M. J. Black
CVPR 2022 (oral, best-paper candidate 33/8k), pdf, video, code, website

SPEC: Seeing People with an Estimated Camera
M. Kocabas, C. H. Huang, J. Tesch, L. Müller, O. Hilliges, M. J. Black
ICCV 2021, pdf, video, code, project website, poster

PARE: Part Attention Regressor for 3D Human Body Estimation
M. Kocabas, C. H. Huang, O. Hilliges, M. J. Black,
ICCV 2021, pdf, video, code, project website, poster

On Self-Contact and Human Pose
L. Müller, A. A. A. Osman, S. Tang, C. H. Huang, M. J. Black
CVPR 2021 (oral, best-paper candidate), pdf, video, project website, poster

code: Self-contact lib, SMPLify-XMC, TUCH

AGORA: Avatars in Geography Optimized for Regression Analysis
P. Patel, C. H. Huang, J. Tesch, D. T. Hoffmann, S. Tripathi, M. J. Black
CVPR 2021, pdf, video, code, poster, project website, evaluation server

Volumetric 3D Tracking by Detection
C. H. Huang*, B. Allain*, J.-S. Franco, N. Navab, S. Ilic, and E. Boyer
CVPR 2016 (spotlight oral, *: equal contribution), pdf, video, results

Repeatable Local Coordinate Frame for 3D Human Motion Tracking: from Rigid to Non-Rigid
C. H. Huang, F. Tombari, N. Navab
3DV 2015, pdf

Toward User-specific Tracking by Detection of Human Shapes in Multi-Camera
C. H. Huang, E. Boyer, B. do Canto Angonese, N. Navab, and S. Ilic
CVPR 2015, pdf, video

RGB-D/C-arm Calibration and Application in Medical Augmented Reality
Xiang Wang, S. Habert, Ma Meng, C. H. Huang, P. Fallavollita, N. Navab, ISMAR 2015

Human Body Shape and Pose Tracking using Keyframes
C. H. Huang, E. Boyer, N. Navab, and S. Ilic
CVPR 2014, pdf, video

Robust Human Body Shape and Pose Tracking
C. H. Huang, E. Boyer, and S. Ilic
3DV 2013 (best paper award runner up), pdf, video, results

Recognizing Actions across Cameras by Exploring the Correlated Subspace
C. H. Huang, Y. R. Yeh, and Y. C. Wang,
ECCV the 4th VECTaR workshop 2012, pdf, slides

Depth Maps Interpolation From Existing Pairs of Keyframes and Depth Maps for 3D Video Generation
H. M. Wang, C. H. Huang and J. F. Yang
IEEE ISCAS 2010

Journal Publications

C. H. Huang, B. Allain, E. Boyer, J.-S. Franco, F. Tombari, N. Navab, and S. Ilic, “Tracking-by-Detection of 3D Human Shapes: from Surfaces to Volumes,” TPAMI, 2017. (pdf, video)
C. H. Huang, C. Cagniart, E. Boyer, and S. Ilic, “A Bayesian Approach to Multi-view 4D Modelling,” IJCV, 2016 (equal contribution with the second author). (pdf, code)
Xiang Wang, S. Habert, Ma Meng, C. H. Huang, P. Fallavollita, N. Navab, “Precise 3D/2D calibration between a RGB-D sensor and a C-arm fluoroscope,” International Journal of Computer Assisted Radiology and Surgery, 2016
Y. R. Yeh, C. H. Huang, and Y. C. Wang, “Heterogeneous Domain Adaptation and Classification by Exploiting the Correlation Subspace,” IEEE TIP, vol. 23, no. 5, pp. 2009-2018, May. 2014. (pdf, code)
H. M. Wang, C. H. Huang and J. F. Yang, “Block-based Depth Maps Interpolation for Efficient Multi-view Content Generation,” IEEE TCSVT, vol. 21, no. 12, pp. 1847-1858, Dec. 2011.