Development of a Smart Device for Blind & Visually Impaired Person using Computer Vision (original) (raw)

Real Time Object Detection for Visually Impaired Person

According to statistics from the World Health Organization (WHO), at least 285 million people are visually impaired or blindness. Blind people generally have to rely on white canes, guide dogs, screen-reading software, magnifiers, and glasses for navigation and surrounding object detection. Therefore, to help blind people, the visual world has to be transformed into the audio world with the potential to inform them about objects. In this paper, we propose a real-time object detection system to help visually impaired people in their daily life. This system consists of a Raspberry Pi in which YOLO (You Only Look Once) deep learning algorithm is employed. We will use YOLOv3 real-time Object Detection algorithm trained on the COCO dataset to identify the object present before the person. Then the label of the object is identified and then converted into audio by using Google Text to Speech (gTTS), which will be the expected output.

Object Detection System with Voice Alert for Blind

International Journal for Research in Applied Science & Engineering Technology (IJRASET), 2023

As we can see, there are numerous blind persons nearby who encounter various challenges, such as difficulty in crossing roads and identifying objects in their environment. With the advancement in technology in several fields, human life is evolving to better standards. Unfortunately, those who are blind are unable to fully enjoy this kind of lifestyle. So, this project is one strategy for introducing blind individuals to a new way of living that makes them independent on others. The major goal of this project is to create a deep-learning algorithm that can be used to analyse the environment for people who are blind by using the rapidly evolving technology. We'll accomplish this using object detection and transform the data into speech alerts and warnings. Real-time object detection is one of the more challenging tasks since it requires continuous processing and takes a long time. The convolution neural network is the main backbone for any type of object detection (CNN). We can create algorithms based on photos and videos by employing a convolution neural network. We utilise the YOLO technique for object detection because it is simple and quick to process. In addition, for the voice warnings, we employed Text to Speech (TTS). The dataset used in this technique is the COCO dataset, which contains the names of things and objects in our daily lives. These algorithms have been thoroughly trained by the over 90 outdoor objects that we view every day in our daily lives.

Real Time Indoor Object Detection Aid for Blind

IARJSET, 2021

Our proposal accentuates to help blind people to navigate independently using real-time indoor object detection and identification model. The project aims to help blind and visually impaired people to detect and recognize objects around them, through a small camera that is fixed on the glasses. The device setup gives an audio output that is sent to an earphone placed on the person's ear to help him/her find various items easily and independently. All the captured data will be fed to raspberry pi that will have an inbuilt code for object detection in python language and will contain Opencv and TensorFlow files in it. The unit will analyze the image based on the ssd_mobilenet network and custom data-set and the processed data that is the name of the object will come as output. This output will be heard by the user in voice format by incorporating TTS in our model. This model will act as an aid for blind people and will help them to do the daily chores easily and independently.

A Smart Assistance for Visually Impaired

IRJET, 2023

Independent living is one of the major concerns for people around the globe. But when it comes to people who are visually challenged, they always rely on other people to get their daily things done. In today's advanced technical environment, the need for self-sufficiency is recognized in the situation of visually impaired people who are socially restricted. More than 90% of individuals with blindness and low vision are mostly seen in developing countries. Visually impaired people always need the help of others, and they rely on others for essential needs. In this project, we developed a system that uses a conglomeration of technologies like Object detection, Speech Recognition, etc, to solve the problems faced by blind people to a certain extent. It makes use of a camera module that acts as a virtual eye for the visually impaired and helps them recognize objects surrounding them. This system also includes other features like searching Wikipedia and sending emails. All the features are implemented using a headset that provides voice assistance for an easier lifestyle for the visually impaired. The whole system was developed in the Python programming language.

Image based Voice Assistance for Visually Impaired

2021

1Professor, Department of Electronics and Telecommunications, Xavier Institute of Engineering, Mumbai, India 2,3,4,5Student, Department of Electronics and Telecommunications, Xavier Institute of Engineering, Mumbai, India ---------------------------------------------------------------------***---------------------------------------------------------------------Abstract Nowadays Most of the blind rely on the conventional white cane. It's capability to deliver navigational freedom is limited. In our project the system will tell the user about the scene in front of them by capturing an image. The captured image will be processed and the objects and text in the image will be given as the output to the user in real time through voice. In this project we use the Raspberry Pi to process the data and Raspberry Pi Camera to detect the environment using Machine Learning and Deep Learning. We also add one switch in our project for the end user to decide when they want to explore the enviro...

Visual Assistant for Blind People using Raspberry Pi

International Journal of Scientific Research in Computer Science, Engineering and Information Technology, 2021

Blind people face the problem in daily life. They can't even walk without any aid. Many times they rely on others for help. Several technologies for the assistance of visually impaired people have been developed. Among the various technologies being utilized to assist the blind, Computer Vision-based solutions are emerging as one of the most promising options due to their affordability and accessibility. This paper proposes a system for visually impaired people. The proposed system aims to create a wearable visual aid for visually impaired people in which speech commands are accepted by the user. Its functionality addresses the identification of objects and signboards. This will help the visually impaired person to manage day-to-day activities and navigate through his/her surroundings. Raspberry Pi is used to implement artificial vision using python language on the Open CV platform.

Advanced Audio Aid for Blind People

2022 International Conference on Emerging Technologies in Electronics, Computing and Communication (ICETECC)

One of the most important senses in human life is vision, without it one's life is totally filled with darkness. According to WHO globally millions of people are visually impaired estimated there are 285 million, of whom some millions are blind. Unfortunately, there are around 2.4 million people are blind in our beloved country Pakistan. Human are a crucial part of society and the blind community is a main part of society. The technologies are grown so far to make the life of humans easier more comfortable and more reliable for. However, this disability of the blind community would reduce their chance of using such innovative products. Therefore, the visually impaired community believe that they are burden to other societies and they do not capture in normal activities separates the blind people from society and because of this believe did not participate in the normally tasks of society. The visual impair people mainly face most of the problems in this real-time The aim of this work is to turn the real time world into an audio world by telling blind person about the objects in their way and can read printed text. This will enable blind persons to identify the things and read the text without any external help just by using the object detection [33] and reading system in real time. Objective of this work: i) Object detection ii) Read printed text, using state-of-the-art (SOTA) technology.

Assistive Object Recognition System for Visually Impaired

International Journal of Engineering Research and, 2020

The issue of visual impairment or blindness is faced worldwide. According to statistics of the World Health Organization (WHO), globally, at least 2.2 billion people have a vision impairment or blindness, of whom at least 1 billion are blind. In terms of regional differences, the prevalence of vision impairment in low-and middle-income regions is four times higher than in high-income regions.[6] Blind people generally have to rely on white canes, guide dogs, screen-reading software, magnifiers, and glasses to assist them for mobility, however, To help the blind people the visual world has to be transformed into the audio world with the potential to inform them about objects as well as their spatial locations. Therefore, we propose to aid the visually impaired by introducing a system that is most feasible, compact, and costeffective. So, we implied a system that makes use of Raspberry Pi in which you only look once (YOLO v3) machine learning algorithm trained on the coco database is applied. The experimental result shows YOLO v3 achieves state-of-the-art results of 85% to 95% on overall performance, 100% (person, chair, clock, and cell-phone) recognition accuracy. This system not only provides mobility to the visually impaired with that it provides the term that ahead is an XYZ object rather than a sense of obstacle.

A Smart Assistance System for Visually Impaired People

International Journal of Innovative Technology and Exploring Engineering, 2021

Resolving the problems of individuals with Visual, Hearing, and Vocal Impairment through a solitary serving framework could be a tough task. Various current investigations focus on the resolution of the problems of 1 of them on top of challenges however not all. The work centers around chase down a noteworthy procedure that guides the externally weakened by permitting them to listen to what's self-addressed as text and it's accomplished by the tactic that catches the image through a camera and converts the content accessible as voice signals. This planned framework provides a path to people with Hearing weakening to image scan that is in morphology by discourse to message modification procedure and that we, in addition, provides a route to the vocally disabled to handle their voice by the guide of text to voice transformation strategy. each one of those 3 arrangements was regulated to be in an exceedingly solitary exceptional framework. each one of those exercises consists o...

Blind Assistance System using Image Processing

International Journal for Research in Applied Science & Engineering Technology (IJRASET), 2022

Eye diseases usually cause blindness and visual impairment. According to the World Health Organization, around 40 million people are blind, while another 250 million have some form of visual impairment. They come across many troubles in their daily life, especially while navigating from one place to another on their own. They often depend on others for help to satisfy their day-today needs. So, it is quite a challenging task to implement a technological solution to assist them. Several technologies have been developed for the assistance of visually impaired people. One such attempt is that we would wish to make an Integrated Machine Learning System that allows the blind victims to identify and classify real-time objects generating voice feedback and distance. Which also produces warnings whether they are very close or far away from the thing.