About ME

Jiawei Liu (刘佳玮)

jiawei.liu@u.nus.edu
Google Scholar
Curriculum Vitae
Github

I am currently a final-year PhD candidate in Show Lab, National University of Singapore, advised by Prof. Mike Zheng Shou and Prof. Jussi Keppo. I am working on Multi-Modal 3D/4D/Video Dynamic Scene Reconstruction, Generation, and Perception.

I am actively looking for full-time positions and postdoc positions. Please send me an email if you are interested!

News

  • 2024.10. Two papers (1 Spotlight) are accepted to NeurIPS 2024. Congratulations!

  • 2024.10. Show-1 is accepted to International Journal of Computer Vision (IJCV). Congratulations!

  • 2024.08. I am awarded with Doctoral Consortium at ECCV 2024, "4D-Video Dynamic Scene Reconstruction, Editing, and Generation". Congratulations!

  • 2024.07. Our paper "MotionDirector: Motion Customization of Text-to-Video Diffusion Models." is accepted to ECCV 2024 (oral). Congratulations!

  • 2024.04. Our paper "Instant3D: Instant Text-to-3D Generation." is accepted to International Journal of Computer Vision (IJCV). Congratulations!

  • 2024.02. Six papers DynVideo-E, Ego-Exo4D, MagicAnimate, X-Adapter, VideoSwap, and VideoLLM-online are accepted to Computer Vision and Pattern Recognition (CVPR), 2024. Congratulations!

  • 2023.12. I am awarded with SINGAPORE DATA SCIENCE CONSORTIUM (SDSC) DISSERTATION RESEARCH FELLOWSHIP 2023, recognized as 1 out of 10 most innovative and impactful PhD students focusing on Data Science in Singapore in 2023. Congratulations!

  • 2023.07. Two papers HOSNeRF and STPrivacy are accepted to International Conference on Computer Vision (ICCV), 2023. Congratulations!

  • 2022.10. I am awarded with NeurIPS 2022 Scholar Award and will attend NeurIPS 2022 conference. Welcome to approach me and chat!

  • 2022.09. Our paper "DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes." is accepted by Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS), 2022.

  • 2021.01. I am awarded with President's Graduate Fellowship (PGF) and start my PhD career in National University of Singapore.

  • 2020.06. I am awarded with Outstanding Graduate, which is awarded to TOP 8% students in Tsinghua University.

  • 2019.10. I am awarded with Scholarship of Second Prize in Tsinghua University, which is awarded to TOP 5% students in Tsinghua University.

  • 2019.08. Our paper "An efficient multibody dynamic model of three-dimensional meshing contacts in helical gear-shaft system and its solution." is accepted by Mechanism and Machine Theory (SCI source, Q1).

  • 2019.02. Our paper "Dynamic characteristics of helical gear based on Arbitrary Lagrangian Eulerian formulation." is accepted by ECCOMAS 2019 Multibody Dynamic Conference.

  • 2018.01. I start to work as a Research Assistant in Multibody Dynamics Laboratory, Tsinghua University (THU), China, supervised by Prof. Gexue Ren, until my graduation in THU.

Education

Doctor of Philosophy in National University of Singapore (NUS), Singapore, 2021.01 - Present

Institute of Data Science, NUS Graduate School for Integrative Sciences and Engineering. Research topic: Multi-Modal 3D/4D/Video Dynamic Scene Reconstruction, Generation, and Perception. Main Advisor: Prof. Mike Zheng Shou, Co-advisor: Prof. Jussi Keppo.

Master of Science in Tsinghua University (THU), China, 2018.09 - 2020.07

Department of Engineering Mechanics, Advisor: Prof. Gexue Ren. Cumulative GPA: 3.70/4.0.


Bachelor in Northwestern Polytechnical University (NWPU), China, 2014.09 - 2018.06

Honors College. Cumulative GPA: 3.80/4.0 (91.84/100), Rank: 2/145, Major GPA: 3.88/4.0 (93.96/100).


Selected Preprints

Selected Publications

DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editing.

Jia-Wei Liu, Yan-Pei Cao, Jay Zhangjie Wu, Weijia Mao, Yuchao Gu, Rui Zhao, Jussi Keppo, Ying Shan, Mike Zheng Shou.
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024.
PDF BibTex Project Code (Coming Soon!)

HOSNeRF: Dynamic Human-Object-Scene Neural Radiance Fields from a Single Video.

Jia-Wei Liu, Yan-Pei Cao, Tianyuan Yang, Zhongcong Xu, Jussi Keppo, Ying Shan, Xiaohu Qie, Mike Zheng Shou.
Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) 2023.
PDF BibTex Project Code

DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes.

Jia-Wei Liu, Yan-Pei Cao, Weijia Mao, Wenqiao Zhang, David Junhao Zhang, Jussi Keppo, Ying Shan, Xiaohu Qie, Mike Zheng Shou.
Advances in Neural Information Processing Systems (NeurIPS) 2022.
PDF BibTex Project Code

Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation.

David Junhao Zhang*, Jay Zhangjie Wu*, Jia-Wei Liu*, Rui Zhao, Lingmin Ran, Yuchao Gu, Difei Gao, Mike Zheng Shou. (* equal contribution)
International Journal of Computer Vision, 2024.
PDF BibTex Project Code


MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model.

Zhongcong Xu, Jianfeng Zhang, Jun Hao Liew, Hanshu Yan, Jia-Wei Liu, Chenxu Zhang, Jiashi Feng, Mike Zheng Shou.
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024.
PDF BibTex Project Code

MotionDirector: Motion Customization of Text-to-Video Diffusion Models.

Rui Zhao, Yuchao Gu, Jay Zhangjie Wu, David Junhao Zhang, Jia-Wei Liu, Weijia Wu, Jussi Keppo, Mike Zheng Shou.
European Conference on Computer Vision (ECCV) 2024, oral.
PDF BibTex Project Code

An efficient multibody dynamic model of three-dimensional meshing contacts in helical gear-shaft system and its solution.

Jia-Wei Liu, Jia-Peng Liu, Xuan-Bo Shu, Aki Mikkola, Ge-Xue Ren.
Mechanism and Machine Theory (SCI source, Q1).
PDF BibTex

Dynamic characteristics of helical gear based on Arbitrary Lagrangian Eulerian formulation.

Jia-Wei Liu, Jia-Peng Liu, Jia-Lun Yao, Ge-Xue Ren.
ECCOMAS 2019 Multibody Dynamic Conference, Duisburg, Germany.
PDF BibTex


Work Experiences

2018.01 - 2020.07: Research Assistant in Multibody Dynamics Laboratory, Tsinghua University.

  • I had a wonderful time with these people! The memory and time with them are mostly cherished!
  • I was contributed to the research of efficient numerical algorithms in multibody dynamics, with applications on mechanical systems.

Awards

  • Doctoral Consortium at ECCV 2024, "4D-Video Dynamic Scene Reconstruction, Editing, and Generation", 2024

  • SINGAPORE DATA SCIENCE CONSORTIUM (SDSC) DISSERTATION RESEARCH FELLOWSHIP 2023 (10000 S$) (1 out of 10 most innovative and impactful PhD students focusing on Data Science in Singapore in 2023), 2023

  • Show Lab Annual Award (4000 S$), National University of Singapore, 2023

  • Research Incentive Award, National University of Singapore, 2023

  • NeurIPS 2022 Scholar Award, 2022

  • President's Graduate Fellowship (PGF), National University of Singapore, 2021

  • Outstanding Graduate, Tsinghua University (Awarded to top 8% students), 2020

  • Scholarship of Second Prize in Tsinghua University (Awarded to top 5% students), 2019

  • Scholarship of Innovation and Entrepreneurship in Honors College, 2018

  • Second Prize of C++ Programming in Northwestern Polytechnical University, 2017

  • Third Prize of National English Contest for College Student, 2017

  • 2*Second Prize of Mathematical Modeling in Northwestern Polytechnical University, 2015, 2016

  • 3*Scholarship of First Prize in Honors College, 2015, 2016, 2017

  • 3*Scholarship of Outstanding Student in Northwestern Polytechnical University, 2015, 2016, 2017

  • National Scholarship (Awarded to top 1% students in Honors College), 2015

Academic Attendance and Services

  • Attendance: NeurIPS 2022@New Orleans, Meta Ego4D Meetup 2023@New York, ICCV 2023@Paris, Meta Research Summit 2024@Seattle, CVPR 2024@Seattle, ECCOMAS 2019@Duisburg.

  • Reviewer: CVPR 2023-2024, ICCV 2023, ECCV 2024, SIGGRAPH 2024, MICCAI 2024, ACMMM 2023, IEEE TNNLS.

  • PC Member: SOICT 2023.