Development of the supply system, control algorithm and architecture of verbal robot (original) (raw)

Development of a Verbal Robot Hand Gesture Recognition System

WSEAS TRANSACTIONS ON SYSTEMS AND CONTROL, 2021

This article analyzes the most famous sign languages, the correlation of sign languages, and also considers the development of a verbal robot hand gesture recognition system in relation to the Kazakh language. The proposed system contains a touch sensor, in which the contact of the electrical property of the user's skin is measured, which provides more accurate information for simulating and indicating the gestures of the robot hand. Within the framework of the system, the speed and accuracy of recognition of each gesture of the verbal robot are calculated. The average recognition accuracy was over 98%. The detection time was 3ms on a 1.9 GHz Jetson Nano processor, which is enough to create a robot showing natural language gestures. A complete fingerprint of the Kazakh sign language for a verbal robot is also proposed. To improve the quality of gesture recognition, a machine learning method was used. The operability of the developed technique for recognizing gestures by a verbal...

SignBot, Sign-Language Performing Robot, Based on Sequential Motion of Servo Motor Arrays

Advances in Intelligent Systems and Computing, 2018

This paper presents the development of SignBot, a 3D printed robot which can perform Malaysian Sign Language (MSL). This work is the first attempt to eliminate the barriers of communication between hearing impaired individuals and the mainstream society as it is the first robot to perform MSL. The signing, in this work, can be done with two hands. The robot hands were developed with detailed finger joints. Micro servo motors were installed to allow for the signing motions for the relevant joints of selected letters, numbers as well as phrases for emergency cases. The sequential movements of the servo motor arrays are stored in the database to represent particular signs, and retrieved by the microcontroller based on the speech input detected, and finally executed accordingly by the servo motors to perform the sign.

Development of robotic hands of signbot, advanced Malaysian sign-language performing robot

2018

This paper presents the development of a 3D printed humanoid robotic hands of SignBot, which can perform Malaysian Sign Language (MSL). The study is considered as the first attempt to ease the means of communication between the general community and the hearing-impaired individuals in Malaysia. The signed motions performed by the developed robot in this work can be done by two hands. The designed system, unlike previously conducted work, includes a speech recognition system that can feasibly integrate with the controlling platform of the robot. Furthermore, the design of the system takes into account the grammar of the MSL which differs from that of Malay spoken language. This reduces the redundancy and makes the design more efficient and effective. The robot hands are built with detailed finger joints. Micro servo motors, controlled by Arduino Mega, are also loaded to actuate the relevant joints of selected alphabetical and numerical signs as well as phrases for emergency contexts ...

Design and Realization of a Sign Language Educational Humanoid Robot

This paper introduces a novel robotic platform, called RASA (Robot Assistant for Social Aims). This educational social robot is designed and constructed to facilitate teaching Persian Sign Language (PSL) to children with hearing disabilities. There are three predominant characteristics from which design guidelines of the robot are generated. First, the robot is designed as a fully functional interactive social robot with children as its social service recipients. Second, it comes with the ability to perform PSL, which demands a dexterous upper-body of 29 actuated degrees of freedom. Third, it has a relatively low development cost for a robot in its category. This funded project, addresses the challenges resulting from the at times divergent requirements of these characteristics. Accordingly, the hardware design of the robot is discussed, and an evaluation of its sign language realization performance has been carried out. The inspected recognition rates of certain signs of PSL, performed by RASA, have also been reported.

Implementation of Speech Recognition Based Robotic System

Robotics has a momentous feature and future in our daily life. It can make our life fast and easier. But for real life man and robot interaction like household or workplace creates a new question about the controlling the robot. It is quite impossible to command a robot through a keyboard or interfaces like this. The problem can be solved by the way the human solved it, speech. Speech has a huge opportunity to solve this problem. But the speech recognised based robot controlling system is rarely implemented. Speech recognition is a broader solution which refers to technology that can recognize speech without being targeted at single speaker. This paper describes a robot which can recognize the voice command and acted as it is programmed to do. Our Speech recognition program converts spoken words to text. Then text compared to grammar helper for its activity, if the text matches with any command with the database. It executes the command.

Speech Recognition for Robotic Control

The term "robot" generally connotes some anthropomorphic (human-like) appearance . Brooks research coined some research issues for developing humanoid robot and one of the significant research issues is to develop machine that have human-like perception. What is human-like perception? -The five classical human sensors -vision, hearing, touch, smell and taste; by which they percept the surrounding world. The main goal of our project is to introduce "hearing" sensor and also the speech synthesis to the Mobile robot such that it is capable to interact with human through Spoken Natural Language (NL). Speech recognition (SR) is a prominent technology, which helps us to introduce "hearing" as well as Natural Language (NL) interface through Speech for the Human-Robot interaction. So the promise of anthropomorphic robot is starting to become a reality. We have chosen Mobile Robot, because this type of robot is getting popular as a service robot in the social context, where the main challenge is to interact with human. Two type of approach we have chosen for Voice User Interface (VUI) implementation -using a Hardware SR system and another one, using a Software SR system. We have followed Hybrid architecture for the general robotics design and communication with the SR system; also created the grammar for the speech, which is chosen for the robotic activities in his arena. The design and both implementation approaches are presented in this report. One of the important goals of our project is to introduce suitable user interface for novice user and our test plan is designed according to achieve our project goals; so we have also conducted a usability evaluation of our system through novice users. We have performed tests with simple and complex sentences for different types of robotics activities; and also analyzed the test result to find-out the problems and limitations. This report presents all the test results and the findings, which we have achieved through out the project.

Representing American Sign Language Letters and Numbers with Humanoid Robot Arm

Kocaeli Journal of Science and Engineering, 2021

The widespread use of robotic systems is an example of increasing technological developments in daily life. The robotic systems that are accustomed to widespread use in the industry show huge impact in education, health, and many other areas nowadays. Robotic systems are no longer expensive and are not difficult to access systems that can be drawn and designed with design software like CAD programs. Within the scope of the study, major changes are made in the reference design, and Python software is used to send data to the Arduino control card that is used for control of the robotic system and to provide movement. The humanoid robotic arm developed in the study is printed with the 3D printer, sign languages that can be realized by one-handed letters among sign languages were investigated. All 26 alphabetical letters of English in American Sign Language can be demonstrated with the right hand alone. It has nearly the same principle that represents the demonstration of sign language ...

Implementation of Robotic System Using Speech Recognition Technique based on Neuro-Fuzzy Controller

Recently, voice becomes one of the methods commonly used to control the electronic appliances, because of easily being reproduced by human compared to other efforts needed to operate to control some other appliances. There are many places which are hard or dangerous to approach by human and there are many people with disabilities do not have the dexterity necessary to control a keypad or a joystick on electrical devices. The aim of this study is to build a mobile robotic system, which can be controlled by analyzing the human voice commands. The robot will identify the voice commands and take action based on received signal. In general, the robotic system consists of the voice recognition module (AD-VR3) which serves as the ear that will listen and interpret the voice command, while the Arduino serve as the brain of the system that will process and coordinate the correct output of the input command to control the robot motors to perform the action.

IJERT-Intelligent Interactive Robot with Gesture Recognition and Voice Feedback

International Journal of Engineering Research and Technology (IJERT), 2016

https://www.ijert.org/intelligent-interactive-robot-with-gesture-recognition-and-voice-feedback https://www.ijert.org/research/intelligent-interactive-robot-with-gesture-recognition-and-voice-feedback-IJERTV5IS040386.pdf Now-a-days with the help of wireless robot we can do different work. This paper is based on wireless robot using gesture recognition and voice feedback. Robot is designed with the help of flex sensor for the movement of robotic arm. Also voice command is given with the help of microphone for the movement of robot. In industry such a robot can work without any external assistance. Wireless robot system with voice and hand gesture recognition commands is useful in the hazardous industry or area where human being cannot work. Here we are using the voice recognition with pattern recognition in MATLAB software.