Research Interests

I have been working extensively on computational imaging, computer vision, computer graphics, and bioinformatics, including:

  • Imaging: coded aperture/shutter/flash/pixel cameras; plenoptic imaging systems and theories
  • Modeling: material and shape acquisitions; neural representations for shape and appearance; shape generation
  • Rendering: image-based rendering; neural rendering; neural rendering hardware
  • Embodied AI: human-object interactions; motion control and generation; robot sensing

Education

  • Ph.D., Electrical Engineering and Computer Science, August, 2005, Massachusetts Institute of Technology
  • M.S., Electrical Engineering and Computer Science, February, 2003, Massachusetts Institute of Technology
  • B.S., Applied Mathematics/Computer Science, June, 2000, with Honor, California Institute of Technology

Awards and Recognition

Recent Publications

Letsgo Letsgo: Large-scale garage modeling and rendering via lidar-assisted gaussian primitives
ACM Transactions on Graphics (TOG) 43 (6), 1-18
V^3 V^3: Viewing Volumetric Videos on Mobiles via Streamable 2D Dynamic Gaussians
ACM Transactions on Graphics (TOG) 43 (6), 1-13
CLAY CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets
ACM Transactions on Graphics (TOG) 43 (4), 1-20
Dresscode Dresscode: Autoregressively sewing and generating garments from text guidance
ACM Transactions on Graphics (TOG) 43 (4), 1-13

Broad Audience Talks

Professional Activities

  • Member, World Economic Forum's Global Future Council
  • Executive Dean, the School of Information Science and Technology, ShanghaiTech University 2020-2024
  • Deputy Director, Technical Committee on Computer Vision of China Computer Federation (CCF-CV) 2020-2024
  • Board Member, QST Corporation Limited 2022 - present
  • Co-founded and Chief Scientist, DGene (on virtual and augmented reality, investor: Alibaba and GSR) 2015 - present
  • Faculty mentor, Deemos (on digital human creation, investor: Sequoia), Stereye (on digital city, investor: GSR), NeuDim (on neural rendering engine, investor: Sequoia)
  • Full Professor, Computer and Information Science, joint appoint at ECE and BME, University of Delaware, 2005 - 2015
  • Papers Chair:
    • Program Co-Chair, IEEE International Conference on Computer Vision (ICCV), 2027
    • General Co-Chair, IEEE International Conference on Computer Vision (ICCV), 2025
    • Program Co-Chair, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021
    • Program Co-Chair, IEEE Winter Conference on Applications of Computer Vision (WACV), 2021
    • Program Co-Chair, International Conference on Pattern Recognition (ICPR), 2020
    • Program Co-Chair, the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry (VRCAI), 2016
    • Program Co-Chair, IEEE Conference on Computational Photography (ICCP), 2016
    • Program Co-Chair, the 2nd Workshop on Light Field for Computer Vision (LF4CV '17) in conjunction with CVPR 2017
    • Program Co-Chair, the 4th Workshop on Computational Cameras and Displays (CCD '15) in conjunction with CVPR 2015
    • Program Co-Chair, the 1st Workshop on Light Field for Computer Vision (LF4CV '14) in conjunction with ECCV 2014
    • Program Co-Chair, the 11th Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras in conjunction with ICCV 2011 (OMNIVIS '11)
    • General Co-Chair, IEEE Workshop on Projector-Camera Systems (PROCAMS '09) in conjunction with CVPR 2009
  • Editor:
    • Founding Associate Editor-in-Chief, Springer Visual Intelligence (2022 - present)
  • Associate Editor:
    • Associate Editor, IEEE Transactions on Pattern Analysis and Machine Intelligence (2013 - 2020)
    • Associate Editor, IEEE Transaction on Image Processing (2018 - 2024)
    • Associate Editor, Elsevier Computer Vision and Image Understanding (2017 - present)
    • Associate Editor, Journal of Machine Vision and Applications (MVA) (2012 - 2017)
    • Associate Editor, The Visual Computer (2012 - 2017)
  • Papers Program Committees:
    • Program Committee Member, ACM SIGGRAPH (2024, 2025)
    • Area Chair/Senior Area Chair, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016, 2017, 2019, 2022, 2023, 2024)
    • Area Chair/Senior Area Chair, IEEE International Conference on Computer Vision (ICCV 2011, 2015, 2017, 2019, 2023)
    • Area Chair/Senior Area Chair, European Conference on Computer Vision (ECCV 2006, 2010, 2012, 2020, 2024)
    • Area Chair/Senior Area Chair, Neural Information Processing Symposium (NeurIPS 2015, 2017, 2018, 2024, 2025)
    • Program Committee, ACM Interactive 3D Graphics (I3D, 2009 - 2014)
    • Program Committee, Pacific Graphics (PG 2009 - 2019)
    • Steering Committee: International Conference on Computational Photography

Recent Courses At ShanghaiTech

  • CS276, Computational photography and imaging (Spring 2015-2016)
  • CS271, Computer Graphics (Fall 2015-2016)
  • CS240, Algorithm Design and Analysis (Spring 2016-2017)
  • CS276, Computational photography and imaging (Spring 2017-2018)
  • CS271, Computer Graphics II (Fall 2017-2018)
  • CS276, Computational Imaging (Spring 2022-2023, 2023-2024)

Jingyi Yu's Bio

Jingyi Yu is the Inaugural Chair Professor at ShanghaiTech University, where he serves as Vice Provost and Dean of the School of Information Science and Technology (SIST). He holds dual BS degrees in Computer Science and Applied Mathematics from Caltech, as well as an M.S. and Ph.D. in Computer Science from MIT. Before joining ShanghaiTech, he was a full professor at the University of Delaware, with joint appointments in Computer and Information Sciences, Electrical and Computer Engineering, and Biomedical Engineering.

Yu's research spans computational photography, computer vision, and computer graphics. His contributions include foundational theories on image formation, advanced camera models, and innovative approaches to neural rendering. His current work focuses on new geometry and appearance representations, advanced imaging techniques, and embodied AI. Yu's early innovations in image-based rendering and light field cameras have significantly advanced the field of visual information processing. He has also mentored students who went on to found notable startups, such as Deemos (AIGC, funded by Bytedance and Sequoia) and DGene (smart cities, funded by Alibaba and IDG).

A Fellow of both IEEE and Optica, Yu has received numerous prestigious awards, including the NSF CAREER Award and the AFOSR YIP Award. His work has earned multiple best paper awards and honorable mentions at top conferences, including two at ACM SIGGRAPH and one at the ACM/IEEE Design and Automation Conference (DAC). In 2024, SIST, under his leadership, won seven best paper awards at leading conferences, including AMMAS, MICCAI, and IEEE VIS.

Yu is a member of the World Economic Forum's Global Future Council and serves as a curator for the Metaverse Transformation Map. He has held editorial roles as an Associate Editor for IEEE TPAMI, IEEE TIP, Elsevier CVIU, and Springer TVCJ, and is the inaugural Associate Editor-in-Chief for Springer Visual Intelligence. He has chaired numerous top conferences, including IEEE ICCP 2016, ICPR 2020, WACV 2021, and IEEE CVPR 2021. He will serve as General Chair for ICCV 2025 and Program Chair for ICCV 2027.

Imaging: coded aperture/shutter/flash/pixel cameras; plenoptic imaging systems and theories
Modeling: material and shape acquisitions; neural representations for shape and appearance; shape generation
Rendering: physically-based rendering; neural rendering; neural rendering hardware
Embodied AI: human-object interactions; motion control and generation; beyond visual sensing for robots

Publications

See my Google Scholar for a complete list.

Projects

Project details to be added.