Evidence map›Paper›PMID 33897979›Full record

ReviewComputational and structural biotechnology journal2021

The language of proteins: NLP, machine learning & protein sequences.

Dan Ofer, Nadav Brandes, Michal Linial

Open access · goldAbstract readReview
In one paragraph

Review in Computational and structural biotechnology journal, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 150 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
150citing papers in PubMed, 1 pooled it
23.1field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

150 citing papers in PubMed, 1 synthesis or guideline pooled it, 374 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Large language models for bioinformatics.Quantitative biology (Beijing, China) · 2026
    Review
  17. Article
  18. Article
  19. Article
  20. Article

90 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors at 2 institutions in 1 country.

Dan OferMedtronic, Inc, Israel.
Nadav BrandesThe Rachel and Selim Benin School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem, Israel.
Michal LinialDepartment of Biological Chemistry, Institute of Life Sciences, The Hebrew University of Jerusalem, Jerusalem, Israel.
Hebrew University of Jerusalem · ILMedtronic (Israel) · IL

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Natural language processing (NLP) is a field of computer science concerned with automated text and language analysis. In recent years, following a series of breakthroughs in deep and machine learning, NLP methods have shown overwhelming progress. Here, we review the success, promise and pitfalls of applying NLP algorithms to the study of proteins. Proteins, which can be represented as strings of amino-acid letters, are a natural fit to many NLP methods. We explore the conceptual similarities and differences between proteins and language, and review a range of protein-related tasks amenable to machine learning. We present methods for encoding the information of proteins as text and analyzing it with NLP methods, reviewing classic concepts such as bag-of-words, k-mers/n-grams and text search, as well as modern techniques such as word embedding, contextualized embedding, deep learning and neural language models. In particular, we focus on recent innovations such as masked language modeling, self-supervised learning and attention-based models. Finally, we discuss trends and challenges in the intersection of NLP and protein research.

Indexed as

Artificial neural networksBag of wordsBERTBioinformaticsContextualized embeddingDeep learningLanguage modelsNatural language processingTokenizationTransformerWord2vecWord embedding

Identifiers

PMID33897979
PMCPMC8050421
OpenAlexW3144701084

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.