Evidence map›Paper›PMID 28508065›Full record

ArticleScience advances2017

The ground truth about metadata and community detection in networks.

Leto Peel, Daniel B Larremore, Aaron Clauset

Abstract read
In one paragraph

Article in Science advances, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 81 papers.

0numbers the graph read from it
0cells of the map it votes in
81citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

81 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Cell Type Differentiation Using Network Clustering Algorithms.bioRxiv : the preprint server for biology · 2024
    Article
  12. Article
  13. Hierarchical communities in the larvalProceedings of the National Academy of Sciences of the United States of America · 2024
    Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Living on the edge: network neuroscience beyond nodes.Trends in cognitive sciences · 2023
    Review

21 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Leto PeelInstitute of Information and Communication Technologies, Electronics and Applied Mathematics, Université Catholique de Louvain, Louvain-la-Neuve, Belgium.ORCID 0000-0003-4740-7492
Daniel B LarremoreSanta Fe Institute, Santa Fe, NM 87501, USA.ORCID 0000-0001-5273-5234
Aaron ClausetSanta Fe Institute, Santa Fe, NM 87501, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Across many scientific domains, there is a common need to automatically extract a simplified view or coarse-graining of how a complex system's components interact. This general task is called community detection in networks and is analogous to searching for clusters in independent vector data. It is common to evaluate the performance of community detection algorithms by their ability to find so-called ground truth communities. This works well in synthetic networks with planted communities because these networks' links are formed explicitly based on those known communities. However, there are no planted communities in real-world networks. Instead, it is standard practice to treat some observed discrete-valued node attributes, or metadata, as ground truth. We show that metadata are not the same as ground truth and that treating them as such induces severe theoretical and practical problems. We prove that no algorithm can uniquely solve community detection, and we prove a general No Free Lunch theorem for community detection, which implies that there can be no algorithm that is optimal for all possible community detection tasks. However, community detection remains a powerful tool and node metadata still have value, so a careful exploration of their relationship with network structure can yield insights of genuine worth. We illustrate this point by introducing two statistical techniques that can quantify the relationship between metadata and community structure for a broad class of models. We demonstrate these techniques using both synthetic and real-world networks, and for multiple types of metadata and community structures.

Indexed as

algorithm performancecommunity detectionground truthmetadatanetworksno free lunch

Identifiers

PMID28508065
PMCPMC5415338

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.