Evidence map›Paper›PMID 32620873›Full record

ArticleScientific reports2020

A new method to control error rates in automated species identification with deep learning algorithms.

Sébastien Villon, David Mouillot, Marc Chaumont, Gérard Subsol, Thomas Claverie, Sébastien Villéger

Erratum issuedAbstract read
In one paragraph

Article in Scientific reports, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 12 papers.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed.

  1. Developing custom computer vision models with Njobvu-AI: A collaborative, user-friendly platform for ecological research.Ecological applications : a publication of the Ecological Society of America · 2025
    Article
  2. Article
  3. Article
  4. Article
  5. Review
  6. Article
  7. Review
  8. Leveraging social media and deep learning to detect rare megafauna in video surveys.Conservation biology : the journal of the Society for Conservation Biology · 2022
    Article
  9. Article
  10. Article
  11. Article
  12. Deep learning in deep time.Proceedings of the National Academy of Sciences of the United States of America · 2020
    Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

6 authors.

Sébastien VillonMARBEC, Univ of Montpellier, CNRS, IRD, Ifremer, Montpellier, France. villon@lirmm.fr.
David MouillotMARBEC, Univ of Montpellier, CNRS, IRD, Ifremer, Montpellier, France.
Marc ChaumontResearch-Team ICAR, LIRMM, Univ of Montpellier, CNRS, Montpellier, France.
Gérard SubsolResearch-Team ICAR, LIRMM, Univ of Montpellier, CNRS, Montpellier, France.
Thomas ClaverieMARBEC, Univ of Montpellier, CNRS, IRD, Ifremer, Montpellier, France.
Sébastien VillégerMARBEC, Univ of Montpellier, CNRS, IRD, Ifremer, Montpellier, France.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Processing data from surveys using photos or videos remains a major bottleneck in ecology. Deep Learning Algorithms (DLAs) have been increasingly used to automatically identify organisms on images. However, despite recent advances, it remains difficult to control the error rate of such methods. Here, we proposed a new framework to control the error rate of DLAs. More precisely, for each species, a confidence threshold was automatically computed using a training dataset independent from the one used to train the DLAs. These species-specific thresholds were then used to post-process the outputs of the DLAs, assigning classification scores to each class for a given image including a new class called "unsure". We applied this framework to a study case identifying 20 fish species from 13,232 underwater images on coral reefs. The overall rate of species misclassification decreased from 22% with the raw DLAs to 2.98% after post-processing using the thresholds defined to minimize the risk of misclassification. This new framework has the potential to unclog the bottleneck of information extraction from massive digital data while ensuring a high level of accuracy in biodiversity assessment.

Identifiers

PMID32620873
PMCPMC7334229

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.