Kyle Olszewski (original) (raw)

Volumetric Human Teleportation

Ruilong Li,Kyle Olszewski, Yuliang Xiu, Shunsuke Saito, Zeng Huang, Hao Li
SIGGRAPH Real-Time Live 2020 (Winner, Best in Show Award)

Project Paper arXiv YouTube Bibtex

@incollection{li2020monoportRTL, title={Volumetric human teleportation}, author={Li, Ruilong and Olszewski, Kyle and Xiu, Yuliang and Saito, Shunsuke and Huang, Zeng and Li, Hao}, booktitle={ACM SIGGRAPH 2020 Real-Time Live}, pages={1--1}, year={2020} }

3D VADER: AutoDecoding Latent 3D Diffusion Models

Evangelos Ntavelis, Aliaksandr Siarohin, Kyle Olszewski, Chaoyang Wang, Luc Van Gool, Sergey Tulyakov
Neural Information Processing Systems (NeurIPS 2023)

Project Paper arXiv Bibtex

@misc{ntavelis2023autodecoding, title={AutoDecoding Latent 3D Diffusion Models}, author={Evangelos Ntavelis and Aliaksandr Siarohin and Kyle Olszewski and Chaoyang Wang and Luc Van Gool and Sergey Tulyakov}, year={2023}, eprint={2307.05445}, archivePrefix={arXiv}, primaryClass={cs.CV} }

Unsupervised Volumetric Animation

Aliaksandr Siarohin, Willi Menapace, Ivan Skorokhodov, Kyle Olszewski, Hsin-Ying Lee, Jian Ren, Menglei Chai, Sergey Tulyakov
Computer Vision and Pattern Recognition (CVPR 2023)

Project Paper arXiv Code Bibtex

@inproceedings{Siarohin_2023_CVPR, author = {Siarohin, Aliaksandr and Menapace, Willi and Skorokhodov, Ivan and Olszewski, Kyle and Ren, Jian and Lee, Hsin-Ying and Chai, Menglei and Tulyakov, Sergey}, title = {Unsupervised Volumetric Animation}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, month = {June}, year = {2023}, pages = {4658-4669} }

Control-NeRF: Editable Feature Volumes for Scene Rendering and Manipulation

Verica Lazova, Vladimir Guzov, Kyle Olszewski, Sergey Tulyakov, Gerard Pons-Moll
Winter Conference on Applications of Computer Vision 2023 (WACV 2023)

Project Paper arXiv Video Bibtex

@article{lazova2022control, title={Control-NeRF: Editable Feature Volumes for Scene Rendering and Manipulation}, author={Lazova, Verica and Guzov, Vladimir and Olszewski, Kyle and Tulyakov, Sergey and Pons-Moll, Gerard}, journal={arXiv preprint arXiv:2204.10850}, year={2022} }

ScanEnts3D: Exploiting Phrase-to-3D-Object Correspondences for Improved Visio-Linguistic Models in 3D Scenes

Ahmed Abdelreheem, Kyle Olszewski, Hsin-Ying Lee, Peter Wonka, Panos Achlioptas
Winter Conference on Applications of Computer Vision 2024 (WACV 2024)

Project arXiv Bibtex

@article{abdelreheem2022scanents, author = {Abdelreheem, Ahmed and Olszewski, Kyle and Lee, Hsin-Ying and Wonka, Peter and Achlioptas, Panos}, title = {ScanEnts3D: Exploiting Phrase-to-3D-Object Correspondences for Improved Visio-Linguistic Models in 3D Scenes}, journal = Computing Research Repository (CoRR), volume = {abs/2212.06250}, year = {2022} }

Discrete Contrastive Diffusion for Cross-Modal Music and Image Generation

Ye Zhu, Yu Wu, Kyle Olszewski, Jian Ren, Sergey Tulyakov, Yan Yan
International Conference on Learning Representations (ICLR 2023)

Project Paper arXiv Code Supp Bibtex

@inproceedings{zhu2023discrete, title={Discrete Contrastive Diffusion for Cross-Modal Music and Image Generation}, author={Zhu, Ye and Wu, Yu and Olszewski, Kyle and Ren, Jian and Tulyakov, Sergey and Yan, Yan}, booktitle={International Conference on Learning Representations (ICLR)}, year={2023} }

Cross-Modal 3D Shape Generation And Manipulation

Zezhou Cheng, Menglei Chai, Jian Ren, Hsin-Ying Lee, Kyle Olszewski, Zeng Huang, Subhransu Maji, Sergey Tulyakov
European Conference on Computer Vision (ECCV 2022)

Project Paper arXiv Code Bibtex

@inproceedings{Cheng2022-edit3d, author = {Zezhou Cheng and Menglei Chai and Jian Ren and Hsin-Ying Lee and Kyle Olszewski and Zeng Huang and Subhransu Maji and Sergey Tulyakov}, title = {Cross-Modal 3D Shape Generation and Manipulation}, booktitle = {European Conference on Computer Vision (ECCV) }, year = {2022} }

R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis

Huan Wang, Jian Ren, Zeng Huang, Kyle Olszewski, Menglei Chai, Yun Fu, Sergey Tulyakov
European Conference on Computer Vision (ECCV 2022)

Project Paper arXiv Code Bibtex

@inproceedings{wang2022r2l, author = {Huan Wang and Jian Ren and Zeng Huang and Kyle Olszewski and Menglei Chai and Yun Fu and Sergey Tulyakov}, title = {R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis}, booktitle = {ECCV}, year = {2022} }

Quantized GAN for Complex Music Generation from Dance Videos

Ye Zhu, Kyle Olszewski, Yu Wu, Panos Achlioptas, Menglei Chai, Yan Yan, Sergey Tulyakov
European Conference on Computer Vision (ECCV 2022)

Project Paper arXiv Code Bibtex

@inproceedings{yezhu2022quantizedgan, title={Quantized GAN for Complex Music Generation from Dance Videos}, author={Zhu, Ye and Olszewski, Kyle and Wu, Yu and Achlioptas, Panos and Chai, Menglei and Yan, Yan and Tulyakov, Sergey}, booktitle={The European Conference on Computer Vision (ECCV)}, year={2022} }

NeROIC: Neural Rendering of Objects from Online Image Collections

Zhengfei Kuang, Kyle Olszewski, Menglei Chai, Zeng Huang, Panos Achlioptas, Sergey Tulyakov
ACM Transactions on Graphics (SIGGRAPH 2022)

Project Paper arXiv YouTube Code Bibtex

@article{zkuang2022neroic, author = {Kuang, Zhengfei and Olszewski, Kyle and Chai, Menglei and Huang, Zeng and Achlioptas, Panos and Tulyakov, Sergey}, title = {NeROIC: Neural Rendering of Objects from Online Image Collections}, year = {2022}, issue_date = {July 2022}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, volume = {41}, number = {4}, issn = {0730-0301}, url = {https://doi.org/10.1145/3528223.3530177}, doi = {10.1145/3528223.3530177}, journal = {ACM Trans. Graph.}, month = {jul}, articleno = {56}, numpages = {12}, keywords = {neural rendering, reflectance & shading models, multi-view & 3D} }

Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioning

Ligong Han, Jian Ren, Hsin-Ying Lee, Francesco Barbieri, Kyle Olszewski, Shervin Minaee, Dmitris Metaxas, Sergey Tulyakov
Computer Vision and Pattern Recognition (CVPR 2022)

Project Paper arXiv Code Dataset Bibtex

@inproceedings{han2022show, title={Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioning}, author={Han, Ligong and Ren, Jian and Lee, Hsin-Ying and Barbieri, Francesco and Olszewski, Kyle and Minaee, Shervin and Metaxas, Dimitris and Tulyakov, Sergey}, booktitle={CVPR}, year={2022} }

A Good Image Generator Is What You Need for High-Resolution Video Synthesis

Yu Tian, Jian Ren, Menglei Chai, Kyle Olszewski, Xi Peng, Dmitris Metaxas, Sergey Tulyakov
International Conference on Learning Representations (ICLR 2021)

Project Paper arXiv slides presentation Code Supp Bibtex

@inproceedings{tian2021a, title={A Good Image Generator Is What You Need for High-Resolution Video Synthesis}, author={Yu Tian and Jian Ren and Menglei Chai and Kyle Olszewski and Xi Peng and Dimitris N. Metaxa$ booktitle={International Conference on Learning Representations}, year={2021}, url={https://openreview.net/forum?id=6puCSjH3hwA} }

Flow Guided Transformable Bottleneck Networks for Motion Retargeting

Jian Ren, Menglei Chai, Oliver Woodford, Kyle Olszewski, Sergey Tulyakov
Computer Vision and Pattern Recognition (CVPR 2021)

Project Paper arXiv Supp bibtex Bibtex

@InProceedings{Ren_2021_CVPR, author = {Ren, Jian and Chai, Menglei and Woodford, Oliver J. and Olszewski, Kyle and Tulyakov, Sergey}, title = {Flow Guided Transformable Bottleneck Networks for Motion Retargeting}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, month = {June}, year = {2021}, pages = {10795-10805} }

Intuitive, Interactive Beard and Hair Synthesis with Generative Models

Kyle Olszewski, Duygu Ceylan, Jun Xing, Jose Echevarria, Zhili Chen, Weikai Chen, Hao Li
Computer Vision and Pattern Recognition (CVPR 2020, Oral Presentation)

Project Paper arXiv YouTube Video Supp Bibtex

@InProceedings{Olszewski_2020_CVPR, author = {Olszewski, Kyle and Ceylan, Duygu and Xing, Jun and Echevarria, Jose and Chen, Zhili and Chen, Weikai and Li, Hao}, title = {Intuitive, Interactive Beard and Hair Synthesis With Generative Models}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, month = {June}, year = {2020} }

Monocular Real-Time Volumetric Performance Capture

Ruilong Li*, Yuliang Xiu*, Shunsuke Saito, Zeng Huang,Kyle Olszewski, Hao Li
European Conference on Computer Vision (ECCV 2020)

Project Paper arXiv YouTube Bibtex

@inproceedings{li2020monoport, title={Monocular real-time volumetric performance capture}, author={Li, Ruilong and Xiu, Yuliang and Saito, Shunsuke and Huang, Zeng and Olszewski, Kyle and Li, Hao}, booktitle={European Conference on Computer Vision}, pages={49--67}, year={2020}, organization={Springer} }

Transformable Bottleneck Networks

Kyle Olszewski, Sergey Tulyakov, Oliver Woodford, Hao Li, Linjie Luo
International Conference on Computer Vision 2019 (ICCV 2019, Oral Presentation)

Project Paper arXiv YouTube Video Code Supp Bibtex

@InProceedings{Olszewski_2019_ICCV, author = {Olszewski, Kyle and Tulyakov, Sergey and Woodford, Oliver and Li, Hao and Luo, Linjie}, title = {Transformable Bottleneck Networks}, booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)}, month = {October}, year = {2019} }

High-Quality Facial Reflectance and Geometry Inference from an Unconstrained Image

Shugo Yamaguchi, Shunsuke Saito, Koki Nagano, Yajie Zhao, Weikai Chen, Kyle Olszewski, Shigeo Morishima, Hao Li
ACM Transactions on Graphics (SIGGRAPH 2018)

Paper YouTube Video Supp Bibtex

@article{yamaguchi2018facial, author = {Yamaguchi, Shugo and Saito, Shunsuke and Nagano, Koki and Zhao, Yajie and Chen, Weikai and Olszewski, Kyle and Morishima, Shigeo and Li, Hao}, title = {High-Fidelity Facial Reflectance and Geometry Inference from an Unconstrained Image}, year = {2018}, issue_date = {August 2018}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, volume = {37}, number = {4}, issn = {0730-0301}, url = {https://doi.org/10.1145/3197517.3201364}, doi = {10.1145/3197517.3201364}, journal = {ACM Trans. Graph.}, month = {jul}, articleno = {162}, numpages = {14}, keywords = {image-based modeling, texture synthesis and inpainting, facial modeling} }

Realistic Dynamic Facial Textures from a Single Image using GANs

Kyle Olszewski*, Zimo Li*, Chao Yang*, Yi Zhou, Ronald Yu, Zeng Huang, Sitao Xiang, Shunsuke Saito, Pushmeet Kohli, Hao Li
International Conference on Computer Vision (ICCV 2017)

Paper YouTube Video Supp Bibtex

@InProceedings{Olszewski_2017_ICCV, author = {Olszewski, Kyle and Li, Zimo and Yang, Chao and Zhou, Yi and Yu, Ronald and Huang, Zeng and Xiang, Sitao and Saito, Shunsuke and Kohli, Pushmeet and Li, Hao}, title = {Realistic Dynamic Facial Textures From a Single Image Using GANs}, booktitle = {Proceedings of the IEEE International Conference on Computer Vision (ICCV)}, month = {Oct}, year = {2017} }

High-Fidelity Facial and Speech Animation for VR HMDs

Kyle Olszewski, Joseph Lim, Shunsuke Saito, Hao Li
ACM SIGGRAPH Conference and Exhibition in Asia (SIGGRAPH Asia 2016)

Paper YouTube Video Bibtex

@article{olszewski2016high, Author = {Kyle Olszewski and Joseph J. Lim and Shunsuke Saito and Hao Li}, Title = {High-Fidelity Facial and Speech Animation for VR HMDs}, Journal = {ACM Transactions on Graphics (Proceedings SIGGRAPH Asia 2016)}, Volume = {35}, Number = {6}, Year = {2016}, Month = {December}, Publisher = {ACM}, Paddress = {New York, NY, USA} }

Rapid Photorealistic Blendshape Modeling from RGB-D Sensors

Dan Casas, Andrew Feng, Oleg Alexander, Graham Fyffe, Paul Debevec, Ryosuke Ichikari, Hao Li, Kyle Olszewski, Evan Suma, Ari Shapiro
Computer Animation and Social Agents (CASA 2016)

Paper Video Bibtex

@article{casas2016rapid, author = {Dan Casas and Andrew Feng and Oleg Alexander and Graham Fyffe and Paul Debevec and Ryosuke Ichikari and Hao Li and Kyle Olszewski and Evan Suma and Ari Shapiro}, title = {Rapid Photorealistic Blendshape Modeling From RGB-D Sensors}, journal = {Computer Animation and Virtual Worlds}, publisher = {John Wiley & Sons, Ltd}, year = {2016}, }

Facial Performance Sensing Head-Mounted Display

Hao Li*, Laura Trutoiu*, Kyle Olszewski*, Lingyu Wei*, Tristan Trutna, Pei-Lun Hsieh, Aaron Nicholls, Chongyang Ma
ACM Transactions on Graphics (SIGGRAPH 2015)

Paper YouTube Video Bibtex

@article{li2015facial, Author = {Hao Li and Laura Trutoiu and Kyle Olszewski and Lingyu Wei and Tristan Trutna and Pei-Lun Hsieh and Aaron Nicholls and Chongyang Ma}, Title = {Facial Performance Sensing Head-Mounted Display}, Journal = {ACM Transactions on Graphics (Proceedings SIGGRAPH 2015)}, Volume = {34}, Number = {4}, Year = {2015}, Month = {July}, Publisher = {ACM}, Paddress = {New York, NY, USA} }