Publications des scientifiques de l'IRD

Villon Sébastien, Iovan Corina, Mangeas Morgan, Vigliola Laurent. (2024). Toward an artificial intelligence-assisted counting of sharks on baited video. Ecological Informatics, 80, p. 102499 [9 p.]. ISSN 1574-9541.

Titre du document
Toward an artificial intelligence-assisted counting of sharks on baited video
Année de publication
Type de document
Article référencé dans le Web of Science WOS:001174108700001
Villon Sébastien, Iovan Corina, Mangeas Morgan, Vigliola Laurent
Ecological Informatics, 2024, 80, p. 102499 [9 p.] ISSN 1574-9541
Given the global biodiversity crisis, there is an urgent need for new tools to monitor populations of endangered marine megafauna, like sharks. To this end, Baited Remote Underwater Video Stations (BRUVS) stand as the most effective tools for estimating shark abundance, measured using the MaxN metric. However, a bottleneck exists in manually computing MaxN from extensive BRUVS video data. Although artificial intelligence methods are capable of solving this problem, their effectiveness is tested using AI metrics such as the F-measure, rather than ecologically informative metrics employed by ecologists, such as MaxN. In this study, we present both an automated and a semi-automated deep learning approach designed to produce the MaxN abundance metric for three distinct reef shark species: the grey reef shark (Carcharhinus amblyrhynchos), the blacktip reef shark (C. melanopterus), and the whitetip reef shark (Triaenodon obesus). Our approach was applied to one-hour baited underwater videos recorded in New Caledonia (South Pacific). Our fully automated model achieved F-measures of 0.85, 0.43, and 0.72 for the respective three species. It also generated MaxN abundance values that showed a high correlation with manually derived data for C. amblyrhynchos (R = 0.88). For the two other species, correlations were significant but weak (R = 0.35-0.44). Our semi-automated method significantly enhanced Fmeasures to 0.97, 0.86, and 0.82, resulting in high-quality MaxN abundance estimations while drastically reducing the video processing time. To our knowledge, we are the first to estimate MaxN with a deep-learning approach. In our discussion, we explore the implications of this novel tool and underscore its potential to produce innovative metrics for estimating fish abundance in videos, thereby addressing current limitations and paving the way for comprehensive ecological assessments.
Plan de classement
Limnologie biologique / Océanographie biologique [034] ; Ecologie, systèmes aquatiques [036] ; Informatique [122]
Fonds IRD [F B010089628]
Identifiant IRD