Yu Yin's Homepage (original) (raw)

What's New

[2025.11] Check out our newly released Awesome-Spatial-VLMs github repo, a community-maintained companion resource to our survey paper: Spatial Intelligence in Vision-Language Models: A Comprehensive Survey !
[2025.11] 1 papers accepted by AAAI 2026!
[2025.09] We have 3 papers accepted by NeurIPS 2025!
[2025.08] 3 papers accepted by EMNLP 2025 (1 main track + 2 findings).
[2025.05] 1 paper accepted by ACL 2025.
[2025.05] We will organize The 12th IEEE International Workshop on Analysis and Modeling of Faces and Gestures (AMFG) at ICCV 2025.
[2025.02] Our paper "Blur-Aware Reconstruction of Dynamic Scenes via Gaussian Splatting" is accepted by CVPR 2025. Congratulations to Yiren!
[2024.12] 1 paper accepted by AAAI 2025.
[2024.11] Our paper on multi-agent argument generation has been accepted by COLING 2025.
[2024.09] Our paper Cracking the Code of Juxtaposition has been accepted by NeurIPS 2024 as an Oral!
[2024.09] We have 1 paper accepted by EMNLP 2024.
[2024.08] I recieved the Teaching Award from the Department of Computer and Data Sciences at CWRU.
[2024.07] One paper on 3D scene editing has been accepted by ACM MM 2024.
[2024.07] Our paper on argument generation has been accepted by INLG 2024 (Oral).
[2023.09] Our paper on deepfake detection has been accepted by ICDM 2023.
[2023.05] I will be joining the Department of Computer and Data Science at Case Western Reserve University (CWRU) as a Tenure-Track Assistant Professor from Fall 2023!
[2023.04] We will organize The 11th IEEE International Workshop on Analysis and Modeling of Faces and Gestures (AMFG) at ICCV 2023.
[2023.04] I received the Dissertation Completion Fellowship from Northeastern University.
[2023.02] One paper on 3D face animation ("NeRFInvertor") has been accepted by CVPR 2023.

[...] More

Openings: I am continuously looking for highly-motivated Master students and Interns to work on computer vision and machine learning (e.g., 3D vision, VLM, VLA, generative models). Please send me your CV if interested.

Biography

I am a tenure-track assistant professor in the Department of Computer & Data Science at Case Western Reserve University. Before that I received my PH.D. degree in Computer Engineering from Northeastern University in Aug. 2023. During this time, I was under the guidance and supervision of Prof. Yun (Raymond) Fu in the SMILE Lab. I received my master degree in Electrical & Computer Engineering from Northeastern University in Dec. 2018, and B.E degree from School of Electronic Engineering, Wuhan University of Technology, China, in Jul. 2016. From Fall 2016, I was a member of the Augmented Cogniton (AClab), under the supervision of Prof. Sarah Ostadabbas. My research interest broadly includes visual synthesis and understanding, multi-modality fusion, and transfer learning. My recent research topics lie in unified representation learning, 3d modeling and animation, and a wide range of computer vision applications, including image synthesis, 3D novel-view synthesis, face restoration, forensics detection, 3D model generation and rendering, etc.


Education


Teaching


Patents


Awards


Activities


Publications

Preprints

Cracking the Code of Juxtaposition: Can AI Models Understand the Humorous Contradictions Zhe Hu*, Tuo Liang*, Jing Li, Yiren Lu, Yunlai Zhou, Yiran Qiao, Jing Ma, and Yu Yin (*co-first author) Conference on Neural Information Processing Systems (NeurIPS), 2024 [Oral] Abstract Paper arXiv Webpage Code Dataset
VIVA: A Benchmark for Vision-Grounded Decision-Making with Human Values Zhe Hu, Yixiao Ren, Jing Li, and Yu Yin Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Abstract Paper arXiv Webpage Code Dataset
Source Edited Your browser does not support the video tag. => Your browser does not support the video tag. View-consistent Object Removal in Radiance Fields Yiren Lu, Jing Ma, and Yu Yin ACM International Conference on Multimedia (ACM MM), 2024 Abstract Paper arXiv Webpage
AMERICANO: Argument Generation with Discourse-driven Decomposition and Multi-agent Interaction Zhe Hu, Hou Pong Chan, and Yu Yin ACL International Natural Language Generation Conference (INLG), 2024 [Oral] Abstract Paper arXiv Slides
Concentric Ring Loss for Face Forgery Detection Yu Yin, Yue Bai, Yizhou Wang, and Yun Fu IEEE International Conference on Data Mining (ICDM), 2023 Abstract Paper
NeRFInvertor: High Fidelity NeRF-GAN Inversion for Single-shot Real Image Animation Yu Yin, Kamran Ghasedi, HsiangTao Wu, Jiaolong Yang, Xin Tong, and Yun Fu IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR), 2023 Abstract Paper arXiv Webpage Demo Code
Expanding the Latent Space of StyleGAN for Real Face Editing Yu Yin, Kamran Ghasedi, HsiangTao Wu, Jiaolong Yang, Xin Tong, and Yun Fu Under review, 2022 Abstract arXiv
Multimodal In-bed 3D Pose and Shape Estimation under the Blankets Yu Yin, Joseph P. Robinson, and Yun Fu ACM International Conference on Multimedia (ACM MM), 2022 Abstract Paper
Generating Topological Structure of Floorplans from Room Attributes Yu Yin, Will Hutchcroft, Naji Khosravan, Ivaylo Boyadzhiev, Yun Fu, and Sing Bing Kang ACM International Conference on Multimedia Retrieval (ACM ICMR), 2022 Abstract Paper Presentation
Semi-supervised Domain Adaptive Structure Learning Can Qin, Lichen Wang, Qianqian Ma, Yu Yin, Huan Wang, and Yun Fu IEEE Transactions on Image Processing (TIP), 2022 Abstract Paper Code
Human Motion Segmentation via Velocity-Sensitive Dual-Side Auto-Encoder Yue Bai, Lichen Wang, Yunyu Liu, Yu Yin, Hang Di, and Yun Fu IEEE Transactions on Image Processing (TIP), 2022 Abstract Paper
Collaborative Attention Mechanism for Multi-Modal Time Series Classification Yue Bai, Zhiqiang Tao, Lichen Wang, Sheng Li, Yu Yin, and Yun Fu SIAM International Conference on Data Mining (SDM), 2022 Abstract Paper
SuperFront: From Low-resolution Image to High-resolution Frontal Face Sythesis Yu Yin, Joseph P. Robinson, Songyao Jiang, Yue Bai, Can Qin, and Yun Fu ACM International Conference on Multimedia (ACM MM), 2021 Abstract Paper Code Supplements
Opposite Structure Learning for Semi-supervised Domain Adaptation Can Qin, Lichen Wang, Qianqian Ma, Yu Yin, Huan Wang, and Yun Fu SIAM International Conference on Data Mining (SDM), 2021 Abstract Paper Code
Dual-Attention GAN for Large-Pose Face Frontalization Yu Yin, Songyao Jiang, Joseph P. Robinson, and Yun Fu IEEE International Conference on Automatic Face and Gesture Recognition (FG), 2020 Abstract Paper Paper Code Presentation
Joint Super-Resolution and Alignment of Tiny Faces Yu Yin, Joseph P. Robinson, Yulun Zhang, and Yun Fu AAAI Conference on Artificial Intelligence (AAAI), 2020 Abstract Paper Code
Dual-Side Auto-Encoder for High-Dimensional Time Series Segmentation Yue Bai, Lichen Wang, Yunyu Liu, Yu Yin, and Yun Fu IEEE International Conference on Data Mining (ICDM), 2020 Abstract Paper
Facial Expression and Peripheral Physiology Fusion to Decode Individualized Affective Experience Yu Yin, Mohsen Nabian, Miolin Fan, ChunAn Chou, Maria Gendron, and Sarah Ostadabbas Affective Computing Workshop of the International Joint Conferences on Artificial Intelligence (IJCAI Workshop), 2018 Abstract arXiv Code Demo Slides
A Biosignal-Specific Processing Tool for Machine Learning and Pattern Recognition Yu Yin*, Mohsen Nabian*, Athena Nouhi*, and Sarah Ostadabbas (* equal contribution) IEEE-NIH Special Topics Conference on Healthcare Innovations and Point-of-Care Technologies (HI-POCT), 2017 Abstract PDF Matlab Code Poster
In-Bed Pose Estimation: Deep Learning with Shallow Dataset Shuangjun Liu, Yu Yin, and Sarah Ostadabbas IEEE Journal of Translational Engineering in Health and Medicine (JTEHM), 2019 Abstract arXiv Code Project

More previous publications:


Created on 2019/10/01. Last update : 2025/08/25