TY - JOUR
T1 - Can citizen science and social media images support the detection of new invasion sites? A deep learning test case with Cortaderia selloana
AU - Cardoso, Ana Sofia
AU - Malta-Pinto, Eva
AU - Tabik, Siham
AU - August, Tom
AU - Roy, Helen E.
AU - Correia, Ricardo
AU - Vicente, Joana R.
AU - Vaz, Ana Sofia
PY - 2024/7
Y1 - 2024/7
N2 - Deep learning has advanced the content analysis of digital data, unlocking opportunities for detecting, mapping, and monitoring invasive species. Here, we tested the ability of open source classification and object detection models (i.e., convolutional neural networks: CNNs) to identify and map the invasive plant Cortaderia selloana (pampas grass) in mainland Portugal. CNNs were trained over citizen science images and then applied to social media content (from Flickr, Twitter, Instagram, and Facebook), allowing to classify or detect the species in over 77% of situations. Images where the species was identified were mapped, using their georeferenced coordinates and time stamp, showing previously unreported occurrences of C. selloana, and a tendency for the species expansion from 2019 to 2021. Our study shows great potential from deep learning, citizen science and social media data for the detection, mapping, and monitoring of invasive plants, and, by extension, for supporting follow-up management options.
AB - Deep learning has advanced the content analysis of digital data, unlocking opportunities for detecting, mapping, and monitoring invasive species. Here, we tested the ability of open source classification and object detection models (i.e., convolutional neural networks: CNNs) to identify and map the invasive plant Cortaderia selloana (pampas grass) in mainland Portugal. CNNs were trained over citizen science images and then applied to social media content (from Flickr, Twitter, Instagram, and Facebook), allowing to classify or detect the species in over 77% of situations. Images where the species was identified were mapped, using their georeferenced coordinates and time stamp, showing previously unreported occurrences of C. selloana, and a tendency for the species expansion from 2019 to 2021. Our study shows great potential from deep learning, citizen science and social media data for the detection, mapping, and monitoring of invasive plants, and, by extension, for supporting follow-up management options.
KW - 1172 Environmental sciences
KW - 519 Social and economic geography
U2 - 10.1016/j.ecoinf.2024.102602
DO - 10.1016/j.ecoinf.2024.102602
M3 - Article
AN - SCOPUS:85190862810
SN - 1574-9541
VL - 81
JO - Ecological Informatics
JF - Ecological Informatics
M1 - 102602
ER -