Jason Ren (original) (raw)

I'm a research scientist at Apple working on computer vision and machine learning. I am particularly interested in topics such as generative modeling, 3D vision, efficient ML, and LLMs.

I received my Ph.D in CS from the University of Illinois at Urbana-Champaign (UIUC), where I was advised by Alex Schwing and closely collaborated with Shenlong Wang. I received my M.Sc in CS from UC Davis working with Yong Jae Lee, and B.Eng from Sun Yat-sen University (中山大学).

During my graduate studies, I was very fortunate to have spent summer 2023 at Apple with Fangchang Ma and Edward Zhang; summer 2022 and 2021 at Adobe Research with Aseem Agarwala, Bryan Russell, and Oliver Wang; summer 2020 at Fundamental AI Research (FAIR), Meta with Rohit Girdhar and Ishan Misra; summer 2019 and 2018 at NVIDIA Research with Zhiding Yu, Xiaodong Yang, Ming-Yu Liu, and Jan Kautz. I worked as machine learning researcher at EgoVid with Michael Ryoo in 2017.

My research wouldn't be possible without support made by Yee Memorial Fund Fellowship, Yunni & Maxine Pao Memorial Fellowship, Amazon AWS, UC Davis, and UIUC. Thanks so much!

Apple Intelligence Foundation Language Models
Apple (Tom Gunter, ..., Zhongzheng Ren)
arXiv, 2024
PDF | Blog | Apple Intelligence | WWDC'24

PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generation
Shaowei Liu,Zhongzheng Ren, Saurabh Gupta*,Shenlong Wang*
European Conference on Computer Vision (ECCV), 2024
PDF | BIBTEX | Project

GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Mesh
Jing Wen, Xiaoming Zhao,Zhongzheng Ren, Alexander G. Schwing,Shenlong Wang
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
PDF | BIBTEX | Project

NeRFDeformer: NeRF Transformation from a Single View via 3D Scene Flows
Zhenggang Tang,Zhongzheng Ren, Xiaoming Zhao, Bowen Wen, Jonathan Tremblay, Stan Birchfield,Alexander G. Schwing
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
PDF | BIBTEX | Project

StableDreamer: Taming Noisy Score Distillation Sampling for Text-to-3D
Pengsheng Guo, Hans Hao, Adam Caccavale,Zhongzheng Ren, Edward Zhang, Qi Shan, Aditya Sankar,Alexander G. Schwing, Alex Colburn, Fangchang Ma
arXiv, 2023
PDF | BIBTEX | Project

Occupancy Planes for Single-view RGB-D Human Reconstruction
Xiaoming Zhao, Yuan-Ting Hu, Zhongzheng Ren, Alexander G. Schwing
AAAI Conference on Artificial Intelligence (AAAI), 2023
PDF | BIBTEX | Project
In case you're wondering: Yes! That's me and my dog Loki :)

CASA: Category-agnostic Skeletal Animal Reconstruction
Yuefan Wu*, Zeyuan Chen*, Shaowei Liu, Zhongzheng Ren, Shenlong Wang
Neural Information Processing Systems (NeurIPS), 2022
PDF | BIBTEX | Project

Neural Volumetric Object Selection
Zhongzheng Ren, Aseem Agarwala†, Bryan Russell†, Alexander G. Schwing†,
Oliver Wang†
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022
PDF | BIBTEX | Project
Also presented at AI for Content Creation Workshop (AI4CC) and Computer Vision for AR/VR workshop (CV4ARVR) at CVPR'22

Total Variation Optimization Layers for Computer Vision
Raymond A. Yeh, Yuan-Ting Hu, Zhongzheng Ren, Alexander G. Schwing
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022
PDF | BIBTEX | Project

Class-agnostic Reconstruction of Dynamic Objects from Videos
Zhongzheng Ren*, Xiaoming Zhao*, Alexander G. Schwing
Neural Information Processing Systems (NeurIPS), 2021
PDF | BIBTEX | Project

Semantic Tracklets: An Object-Centric Representation for Visual Multi-Agent Reinforcement Learning
Iou-Jen Liu*, Zhongzheng Ren*, Raymond A. Yeh*, Alexander G. Schwing
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021
PDF | BIBTEX | Project
Also presented at ICML'21 Reinforcement Learning for Real Life Workshop

3D Spatial Recognition without Spatially Labeled 3D
Zhongzheng Ren, Ishan Misra, Alexander G. Schwing, Rohit Girdhar
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021
PDF | BIBTEX | Project

Not All Unlabeled Data are Equal: Learning to Weight Data in Semi-supervised Learning
Zhongzheng Ren*, Raymond A. Yeh*, Alexander G. Schwing
Neural Information Processing Systems (NeurIPS), 2020
PDF | BIBTEX | Project

UFO2: A Unified Framework towards Omni-supervised Object Detection
Zhongzheng Ren, Zhiding Yu, Xiaodong Yang, Ming-Yu Liu, Alexander G. Schwing, Jan Kautz
European Conference on Computer Vision (ECCV), 2020
PDF | BIBTEX | Project

Instance-aware, Context-focused, and Memory-efficient Weakly Supervised Object Detection
Zhongzheng Ren, Zhiding Yu, Xiaodong Yang, Ming-Yu Liu, Yong Jae Lee,
Alexander G. Schwing, Jan Kautz
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020
PDF | BIBTEX | Project
Also presented at CVPR'20 Visual Learning with Limited Labels Workshop

Learning to Anonymize Faces for Privacy Preserving Action Detection
Zhongzheng Ren, Yong Jae Lee, Michael S. Ryoo
European Conference on Computer Vision (ECCV), 2018
PDF | BIBTEX | Project
Also presented at CVPR'18 workshop on The Bright and Dark Sides of Computer Vision: Challenges and Opportunities for Privacy and Security

Cross-Domain Self-supervised Multi-task Feature Learning using Synthetic Imagery
Zhongzheng Ren, Yong Jae Lee
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2018
PDF | BIBTEX | Project

Who moved my cheese? Automatic Annotation of Rodent Behaviors with Convolutional Neural Networks
Zhongzheng Ren, Adriana Noronha, Annie Vogel Ciernia, Yong Jae Lee
IEEE Winter Conference on Applications of Computer Vision (WACV), 2017
PDF | BIBTEX | Project

We (mostly Alex) developed an efficient tool PDFCrop for creating Compass/Blackboard online exam from pdf files. Check out this demo video and reach out if you need access!