GitHub - graspnet/anygrasp_sdk (original) (raw)

AnyGrasp SDK

AnyGrasp SDK for grasp detection & tracking.

[arXiv] [project] [dataset] [graspnetAPI]

Update

Video

IMAGE ALT TEXT
AnyGrasp cleaning fragments of a broken pot

IMAGE ALT TEXT
AnyGrasp catching swimming robot fish

Requirements

Installation

  1. Install Pytorch. Choose the appropriate version based on your environment.
  2. Install MinkowskiEngine. We have modified MinkowskiEngine for better adpatation.

mkdir dependencies && cd dependencies conda install openblas-devel -c anaconda export CUDA_HOME=/path/to/cuda git clone git@github.com:chenxi-wang/MinkowskiEngine.git cd MinkowskiEngine

Uncomment the following line if you are using CUDA 12.x.

git checkout cuda-12-1

Uncomment the following line if you are using CUDA 12.8.

sed -i 's/\bauto __raw = __to_address(__r.get());/auto __raw = std::__to_address(__r.get());/' /usr/include/c++/11/bits/shared_ptr_base.h

python setup.py install --blas_include_dirs=${CONDA_PREFIX}/include --blas_library_dirs=${CONDA_PREFIX}/lib --blas=openblas cd ../..

  1. Install other requirements from Pip.

    pip install -r requirements.txt

  2. Install pointnet2 module.

    cd pointnet2 python setup.py install

License Registration

Due to the IP issue, currently we can only release the SDK library file of AnyGrasp in a licensed manner. Please get the feature id of your machine and fill in the form to apply for the license. See license_registration/README.md for details. If you are interested in code implementation, you can refer to our baseline version of network, or a third-party implementation of our GSNet.

We usually reply in 5 workdays. If you do not receive the reply in 5 workdays, please check the spam folder.

Demo Code

Now you can run your code that uses AnyGrasp SDK. See grasp_detection and grasp_tracking for details.

Citation

Please cite these papers in your publications if it helps your research:

@article{fang2023anygrasp,
  title={AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domains},
  author = {Fang, Hao-Shu and Wang, Chenxi and Fang, Hongjie and Gou, Minghao and Liu, Jirong and Yan, Hengxu and Liu, Wenhai and Xie, Yichen and Lu, Cewu},
  journal={IEEE Transactions on Robotics (T-RO)},
  year={2023}
}

@inproceedings{fang2020graspnet,
  title={Graspnet-1billion: A large-scale benchmark for general object grasping},
  author={Fang, Hao-Shu and Wang, Chenxi and Gou, Minghao and Lu, Cewu},
  booktitle={Proceedings of the IEEE/CVF conference on computer vision and pattern recognition},
  pages={11444--11453},
  year={2020}
}

@inproceedings{wang2021graspness,
  title={Graspness discovery in clutters for fast and accurate grasp detection},
  author={Wang, Chenxi and Fang, Hao-Shu and Gou, Minghao and Fang, Hongjie and Gao, Jin and Lu, Cewu},
  booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision},
  pages={15964--15973},
  year={2021}
}