GitHub - CVMI-Lab/PLA: (CVPR 2023) PLA: Language-Driven Open-Vocabulary 3D Scene Understanding & (CVPR2024) RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding (original) (raw)

Highlights:

• Official PLA implementation is contained in the main branch
• Official RegionPLC implementation is contained in the regionplc branch

Release

• [2024-05-05] Releasing RegionPLC implementation. Please checkout regionplc branch to try it!

Getting Started

Installation

Please refer to INSTALL.md for the installation.

Dataset Preparation

Please refer to DATASET.md for dataset preparation.

Training & Inference

Please refer to MODEL.md for training and inference scripts and pretrained models.

Citation

If you find this project useful in your research, please consider cite:

@inproceedings{ding2022language, title={PLA: Language-Driven Open-Vocabulary 3D Scene Understanding}, author={Ding, Runyu and Yang, Jihan and Xue, Chuhui and Zhang, Wenqing and Bai, Song and Qi, Xiaojuan}, booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition}, year={2023} }

@inproceedings{yang2024regionplc, title={RegionPLC: Regional point-language contrastive learning for open-world 3d scene understanding}, author={Yang, Jihan and Ding, Runyu and Deng, Weipeng and Wang, Zhe and Qi, Xiaojuan}, booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition}, year={2024} }

Acknowledgement

Code is partly borrowed from OpenPCDet, PointGroup and SoftGroup.