Michigan ZoomIN: Validating Crowd‐Sourcing to Identify Mammals from Camera Surveys

TitleMichigan ZoomIN: Validating Crowd‐Sourcing to Identify Mammals from Camera Surveys
Publication TypeJournal Article
Year of Publication2021
AuthorsGadsden GI, Malhotra R, Schell J, Carey T, Harris NC
JournalWildlife Society Bulletin
Volume4518
Issue2
Pagination221 - 229
Date PublishedJan-06-2021
ISSN2328-5540
Abstract

Camera trap studies have become a popular medium to assess many ecological phenomenaincluding population dynamics, patterns of biodiversity, and monitoring of endangered species. In conjunctionwith the benefit to scientists, camera traps present an unprecedented opportunity to involve the public inscientific research via image classifications. However, this engagement strategy comes with a myriad ofcomplications. Volunteers vary in their familiarity with wildlife, thus, the accuracy of user‐derived classi-fications may be biased by the commonness or popularity of species and user‐experience. From an extensivemulti‐site camera trap study across Michigan, U.S.A, we compiled and classified images through a public science platform called Michigan ZoomIN. We aggregated responses from 15 independent users per image using multiple consensus methods to assess accuracy by comparing to species identification completed by wildlife experts. We also evaluated how different factors including consensus algorithms, study area, wildlife species, user support, and camera type influenced the accuracy of user‐derived classifications. Overall accuracy of user‐derived classification was 97%; although, several canid (e.g.,Canis lupus, Vulpes vulpes) and mustelid(e.g.,Neovison vison) species were repeatedly difficult to identify by users and had lower accuracy. When validating user‐derived classification, we found that study area, consensus method, and user support best explained accuracy. To overcome hesitancy associated with data collected by untrained participants, we demonstrated their value by showing that the accuracy from volunteers was comparable to experts when classifying North American mammals. Our hierarchical workflow that integrated multiple consensus methods led to more image classifications without extensive training and even when the expertise of the volunteer was unknown. Ultimately, adopting such an approach can harness broader participation, expedite future camera trap data synthesis, and improve allocation of resources by scholars to enhance performance of public participants and increase accuracy of user‐derived data

URLhttps://onlinelibrary.wiley.com/toc/23285540/45/2
DOI10.1002/wsb.v45.210.1002/wsb.1175
Short TitleWildl. Soc. bull.
Related research sites: