Evidence map›Paper›PMID 39003341›Full record

ArticleScientific reports2024

Uncertainty quantification for probabilistic machine learning in earth observation using conformal prediction.

Geethen Singh, Glenn Moncrieff, Zander Venter, Kerry Cawse-Nicholson, Jasper Slingsby, Tamara B Robinson

Abstract read
In one paragraph

Article in Scientific reports, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Geethen SinghDepartment of Botany and Zoology, Centre for Invasion Biology, Stellenbosch University, Stellenbosch, South Africa. Geethen.singh@gmail.com.
Glenn MoncrieffGlobal Science, The Nature Conservancy, Cape Town, 7945, South Africa.
Zander VenterNorwegian Institute for Nature Research-NINA, Sognsveien 68, 0855, Oslo, Norway.
Kerry Cawse-NicholsonCarbon Cycles and Ecosystems, Jet Propulsion Laboratory, California Institute of Technology, Pasadena, CA, USA.
Jasper SlingsbyDepartment of Biological Sciences and Centre for Statistics in Ecology, Environment and Conservation, University of Cape Town, Private Bag X3, Rondebosch, Cape Town, 7701, South Africa.
Tamara B RobinsonDepartment of Botany and Zoology, Centre for Invasion Biology, Stellenbosch University, Stellenbosch, South Africa.

Funding

National Research Foundation 118593National Research Foundation 142438National Research Foundation 150296Norges Forskningsråd 160022/F40
6 · The paper itself

Abstract

Machine learning is increasingly applied to Earth Observation (EO) data to obtain datasets that contribute towards international accords. However, these datasets contain inherent uncertainty that needs to be quantified reliably to avoid negative consequences. In response to the increased need to report uncertainty, we bring attention to the promise of conformal prediction within the domain of EO. Unlike previous uncertainty quantification methods, conformal prediction offers statistically valid prediction regions while concurrently supporting any machine learning model and data distribution. To support the need for conformal prediction, we reviewed EO datasets and found that only 22.5% of the datasets incorporated a degree of uncertainty information, with unreliable methods prevalent. Current open implementations require moving large amounts of EO data to the algorithms. We introduced Google Earth Engine native modules that bring conformal prediction to the data and compute, facilitating the integration of uncertainty quantification into existing traditional and deep learning modelling workflows. To demonstrate the versatility and scalability of these tools we apply them to valued EO applications spanning local to global extents, regression, and classification tasks. Subsequently, we discuss the opportunities arising from the use of conformal prediction in EO. We anticipate that accessible and easy-to-use tools, such as those provided here, will drive wider adoption of rigorous uncertainty quantification in EO, thereby enhancing the reliability of downstream uses such as operational monitoring and decision-making.

Indexed as

Conformal predictionMachine learningRemote sensingSatelliteUncertainty quantification

Identifiers

PMID39003341
PMCPMC11246475

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.