Video object segmentation for automatic image annotation of ethernet connectors with environment mapping and 3D projection (original) (raw)

ALET (Automated Labeling of Equipment and Tools): A Dataset, a Baseline and a Usecase for Tool Detection in the Wild

2020

Robots collaborating with humans in realistic environments will need to be able to detect the tools that can be used and manipulated. However, there is no available dataset or study that addresses this challenge in real settings. In this paper, we fill this gap by providing an extensive dataset (METU-ALET) for detecting farming, gardening, office, stonemasonry, vehicle, woodworking and workshop tools. The scenes correspond to sophisticated environments with or without humans using the tools. The scenes we consider introduce several challenges for object detection, including the small scale of the tools, their articulated nature, occlusion, inter-class invariance, etc. Moreover, we train and compare several state of the art deep object detectors (including Faster R-CNN, YOLO and RetinaNet) on our dataset. We observe that the detectors have difficulty in detecting especially small-scale tools or tools that are visually similar to parts of other tools. This in turn supports the importa...

Automated object detection of mechanical fasteners using faster region based convolutional neural networks

International Journal of Electrical and Computer Engineering (IJECE), 2021

Mechanical fasteners are widely used in manufacturing of hardware and mechanical components such as automobiles, turbine & power generation and industries. Object detection method play a vital role to make a smart system for the society. Internet of things (IoT) leads to automation based on sensors and actuators not enough to build the systems due to limitations of sensors. Computer vision is the one which makes IoT too much smarter using deep learning techniques. Object detection is used to detect, recognize and localize the object in an image or a real time video. In industry revolution, robot arm is used to fit the fasteners to the automobile components. This system will helps the robot to detect the object of fasteners such as screw and nails accordingly to fit to the vehicle moved in the assembly line. Faster R-CNN deep learning algorithm is used to train the custom dataset and object detection is used to detect the fasteners. Region based convolutional neural networks (Faster R-CNN) uses a region proposed network (RPN) network to train the model efficiently and also with the help of Region of Interest able to localize the screw and nails objects with a mean average precision of 0.72 percent leads to accuracy of 95 percent object detection.

IJERT-Automation using Machine Learning and Object Detection

International Journal of Engineering Research and Technology (IJERT), 2021

https://www.ijert.org/automation-using-machine-learning-and-object-detection https://www.ijert.org/research/automation-using-machine-learning-and-object-detection-IJERTCONV9IS03047.pdf A major challenge in many of the object detection systems is the dependency on other computer vision techniques for helping the deep learning-based approach, which leads to slow and non-optimal performance. In this paper, a completely deep learning-based approach is used to solve the problem of object detection in an end-to-end fashion. The paper aims to incorporate state-of-the-art technique for detecting the object placed in front of the webcam with the goal of achieving high accuracy with a real-time performance using deep learning. Based on the detected image several preprogrammed robots are used to transport the object in the detected image from the place where humans cannot work flawlessly to the desired location efficiently. This paper comes with the combination of deep learning and robotics which can be used in several areas such as mines, construction sites, steel factories etc where human works in a risky environment. The network is trained on the most publicly available data set, on which an object detection challenge is conducted annually.