Fish detection and species classification in underwater environments using deep learning with temporal information (original) (raw)
Related papers
Automatic Fish Detection from Different Marine Environments Video Using Deep Learning
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2022
The marine environment provides many ecosystems that support habitats biodiversity. Benthic habitats and fish species associations are investigated using underwater gears to secure and manage these marine ecosystems in a sustainable manner. The current study evaluates the possibility of using deep learning methods in particular the You Only Look Once version 3 algorithm to detect fish in different environments such as; different shading, low light, and high noise within images and by each frame within an underwater video, recorded in the Atlantic Coast of Morocco. The training dataset was collected from Open Images Dataset V6, a total of 1295 Fish images were captured and split into a training set and a test set. An optimization approach was applied to the YOLOv3 algorithm which is data augmentation transformation to provide more learning samples. The mean average precision (mAP) metric was applied to measure the YOLOv3 model's performance. Results of this study revealed with a mAP of 91,3% the proposed method is proved to have the capability of detecting fish species in different natural marine environments also it has the potential to be applied to detect other underwater species and substratum.
Fish species classification in unconstrained underwater environments based on deep learning
Limnology and Oceanography: Methods, 2016
Underwater video and digital still cameras are rapidly being adopted by marine scientists and managers as a tool for non-destructively quantifying and measuring the relative abundance, cover and size of marine fauna and flora. Imagery recorded of fish can be time consuming and costly to process and analyze manually. For this reason, there is great interest in automatic classification, counting, and measurement of fish. Unconstrained underwater scenes are highly variable due to changes in light intensity, changes in fish orientation due to movement, a variety of background habitats which sometimes also move, and most importantly similarity in shape and patterns among fish of different species. This poses a great challenge for image/video processing techniques to accurately differentiate between classes or species of fish to perform automatic classification. We present a machine learning approach, which is suitable for solving this challenge. We demonstrate the use of a convolution neural network model in a hierarchical feature combination setup to learn species-dependent visual features of fish that are unique, yet abstract and robust against environmental and intra-and inter-species variability. This approach avoids the need for explicitly extracting features from raw images of the fish using several fragmented image processing techniques. As a result, we achieve a single and generic trained architecture with favorable performance even for sample images of fish species that have not been used in training. Using the LifeCLEF14 and LifeCLEF15 benchmark fish datasets, we have demonstrated results with a correct classification rate of more than 90%.
Frontiers in Marine Science
Machine-assisted object detection and classification of fish species from Baited Remote Underwater Video Station (BRUVS) surveys using deep learning algorithms presents an opportunity for optimising analysis time and rapid reporting of marine ecosystem statuses. Training object detection algorithms for BRUVS analysis presents significant challenges: the model requires training datasets with bounding boxes already applied identifying the location of all fish individuals in a scene, and it requires training datasets identifying species with labels. In both cases, substantial volumes of data are required and this is currently a manual, labour-intensive process, resulting in a paucity of the labelled data currently required for training object detection models for species detection. Here, we present a “machine-assisted” approach for i) a generalised model to automate the application of bounding boxes to any underwater environment containing fish and ii) fish detection and classification...
2019
Aquatic ecologists routinely count animals to provide critical information for conservation and management. Increased accessibility to underwater recording equipment such as cameras and unmanned underwater devices have allowed footage to be captured efficiently and safely. It has, however, led to immense volumes of data being collected that require manual processing, and thus significant time, labour and money. The use of deep learning to automate image processing has substantial benefits, but has rarely been adopted within the field of aquatic ecology. To test its efficacy and utility, we compared the accuracy and speed of deep learning techniques against human counterparts for quantifying fish abundance in underwater images and video footage. We collected footage of fish assemblages in seagrass meadows in Queensland, Australia. We produced three models using a MaskR-CNN object detection framework to detect the target species, an ecologically important fish, luderick (Girella tricu...
2020
Environmental monitoring guides conservation, and is thus particularly important for coastal aquatic habitats, which are heavily impacted by human activities. Underwater cameras and unmanned devices monitor aquatic wildlife, but manual processing of footage is a significant bottleneck to rapid data processing and dissemination of results. Deep learning has emerged as a solution, but its ability to accurately detect animals across habitat types and locations is largely untested for coastal environments. Here, we produce three deep learning models using an object detection framework to detect an ecologically important fish, luderick (Girella tricuspidata). Two were trained on footage from single habitats (seagrass or reef), and one on footage from both habitats. All models were subjected to tests from both habitat types. Models performed well on test data from the same habitat type (object detection measure: mAP50: 91.7 and 86.9% performance for seagrass and reef, respectively), but p...
Fish Detection Using Deep Learning
Applied Computational Intelligence and Soft Computing, 2020
Recently, human being’s curiosity has been expanded from the land to the sky and the sea. Besides sending people to explore the ocean and outer space, robots are designed for some tasks dangerous for living creatures. Take the ocean exploration for an example. There are many projects or competitions on the design of Autonomous Underwater Vehicle (AUV) which attracted many interests. Authors of this article have learned the necessity of platform upgrade from a previous AUV design project, and would like to share the experience of one task extension in the area of fish detection. Because most of the embedded systems have been improved by fast growing computing and sensing technologies, which makes them possible to incorporate more and more complicated algorithms. In an AUV, after acquiring surrounding information from sensors, how to perceive and analyse corresponding information for better judgement is one of the challenges. The processing procedure can mimic human being’s learning r...
Fish Species Classification from Underwater Images using Large-Scale Dataset via Deep Learning
Research Square (Research Square), 2022
Many natural science investigations, including fishery assessment, marine environment assessment, and environmental research, depend on the classification of underwater fish species from apprehended images in habitats. But due to noisy captured images, existing models faced lots of issues during recognition of fish species from the underwater images and to solvu such kind of problem, need to develop a high-performance fish recognition model, although it can be challenging due to the chaotic nature of underwater imagery. In directive to train Deep Neural Network (DNN) in precise manner to develop a Fish Species Classification (FSC) model from noisy large-scale underwater captured images, this research article introduces an inimitable deep learning framework called Optimized DNN. The underwater environment is very fascinating and challenging and many research groups are currently working together to unravel the facts of underwater imaging and mapping. The proposed FSC model is use for fish detection based on the segmentation approach and DNN-based identification in complex underwater environments. To simulate and validate the proposed FSC model, publicly available Fish4Knowledge (Fish Detection) benchmark dataset is used and experimental results show that the FSC model performance is far better in terms of Average Precision (AP = 92.26%), Average Recall (AR = 87.45%), Average F-measure (AF = 89.74%) and Average Accuracy (AA = 93.86%). The composite FSC network model increases the usage of distinctive info and the output of distinctive info for the discovered object.
Ecological Informatics, 2018
Identifying and counting fish individuals on photos and videos is a crucial task to cost-effectively monitor marine biodiversity, yet it remains difficult and time-consuming. In this paper, we present a method to assist the identification of fish species on underwater images, and we compare our model performances to human ability in terms of speed and accuracy. We first tested the performance of a convolutional neural network (CNN) trained with different photographic databases while accounting for different post-processing decision rules to identify 20 fish species. Finally, we compared the performance of species identification of our best CNN model with that of humans on a test database of 1197 fish images representing nine species. The best CNN was the one trained with 900 000 images including (i) whole fish bodies, (ii) partial fish bodies and (iii) the environment (e.g. reef bottom or water). The rate of correct identification was 94.9%, greater than the rate of correct identification by humans (89.3%). The CNN was also able to identify fish individuals partially hidden behind corals or behind other fish and was more effective than humans to identify fish on smallest or blurry images while humans were better to identify fish individuals in unusual positions (e.g. twisted body). On average, each identification by our best CNN using a common hardware took 0.06 seconds. Deep Learning methods can thus perform efficient fish identification on underwater images and offer promises to build-up new video-based protocols for monitoring fish biodiversity cheaply and effectively.
Automated Fish Species Detection
IRJET, 2023
Fish species detection is essential for many different uses, including managing fisheries and monitoring aquatic ecosystems. In this research, we present a deep learning-based method for precise fish species identification using MobileNetV2 architecture. The MobileNetV2 is a compact and effective convolutional neural network (CNN) model that successfully strikes a compromise between precision and computational effectiveness, making it especially ideal for contexts with limited resources. We assembled a large collection of fish photos from various species with different lighting, backdrops, and orientations in order to evaluate our method. We demonstrate the efficiency of our approach in attaining accurate fish species detection and categorization through comprehensive training and evaluation. Notably, our methodology maintains computational economy while delivering competitive performance compared to cutting-edge technologies, enabling its use in real-time scenarios. By presenting an automated system for fish species detection, our proposed application aims to streamline and enhance the efficiency of monitoring aquatic ecosystems. This, in turn, contributes significantly to the conservation of biodiversity by providing a more precise and efficient means of assessing and managing fish populations.
Toward low-cost automated monitoring of life below water with deep learning
Environmental Data Science
Oceans will play a crucial role in our efforts to combat the growing climate emergency. Researchers have proposed several strategies to harness greener energy through oceans and use oceans as carbon sinks. However, the risks these strategies might pose to the ocean and marine ecosystem are not well understood. It is imperative that we quickly develop a range of tools to monitor ocean processes and marine ecosystems alongside the technology to deploy these solutions on a large scale into the oceans. Large arrays of inexpensive cameras placed deep underwater coupled with machine learning pipelines to automatically detect, classify, count, and estimate fish populations have the potential to continuously monitor marine ecosystems and help study the impacts of these solutions on the ocean. In this paper, we successfully demonstrate the application of YOLOv4 and YOLOv7 deep learning models to classify and detect six species of fish in a dark artificially lit underwater video dataset captu...