Evidence map›Paper›PMID 27102331›Full record

ArticleOccupational and environmental medicine2016

Computer-based coding of free-text job descriptions to efficiently identify occupations in epidemiological studies.

Daniel E Russ, Kwan-Yuet Ho, Joanne S Colt, Karla R Armenti, Dalsu Baris, Wong-Ho Chow, Faith Davis, Alison Johnson, Mark P Purdue, Margaret R Karagas and 5 more

Abstract readComparative Study
In one paragraph

Article in Occupational and environmental medicine, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 26 papers.

0numbers the graph read from it
0cells of the map it votes in
26citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

26 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Occupational exposure to organic solvents and risk of bladder cancer.Journal of exposure science & environmental epidemiology · 2024
    Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Occupational history associates with ALS survival and onset segment.Amyotrophic lateral sclerosis & frontotemporal degeneration · 2023
    Article
  15. Associations of self-reported occupational exposures and settings to ALS: a case-control study.International archives of occupational and environmental health · 2022
    Article
  16. A Narrative Literature Review of Natural Language Processing Applied to the Occupational Exposome.International journal of environmental research and public health · 2022
    Review
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Daniel E RussDivision of Computational Bioscience, Center for Information Technology, NIH, Bethesda, Maryland, USA.ORCID http://orcid.org/0000-0003-4040-4416
Kwan-Yuet HoDivision of Computational Bioscience, Center for Information Technology, NIH, Bethesda, Maryland, USA.
Joanne S ColtOccupational and Environmental Epidemiology Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, Maryland, USA.
Karla R ArmentiDivision of Public Health Services, New Hampshire Department of Health and Human Services, Bureau of Public Health Statistics and Informatics, Concord, New Hampshire, USA.
Dalsu BarisOccupational and Environmental Epidemiology Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, Maryland, USA.
Wong-Ho ChowUniversity of Texas MD Anderson Cancer Center, Houston, Texas, USA.
Faith DavisDepartment of Public Health Sciences, University of Alberta, Edmonton, Alberta, Canada.
Alison JohnsonVermont Cancer Registry, Burlington, Vermont, USA.
Mark P PurdueOccupational and Environmental Epidemiology Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, Maryland, USA.
Margaret R KaragasGeisel School of Medicine at Dartmouth, Hanover, New Hampshire, USA.
Kendra SchwartzDepartment of Family Medicine and Public Health Sciences, Wayne State University, Detroit, Michigan, USA.
Molly SchwennMaine Cancer Registry, Augusta, Maine, USA.
Debra T SilvermanOccupational and Environmental Epidemiology Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, Maryland, USA.
Calvin A JohnsonDivision of Computational Bioscience, Center for Information Technology, NIH, Bethesda, Maryland, USA.
Melissa C FriesenOccupational and Environmental Epidemiology Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, Maryland, USA.

Funding

Text Analytics, Machine Learning & High Performance ComputingZIHCT000200 · CIT · CENTER FOR INFORMATION TECHNOLOGY · PI JOHNSON, CALVIN A · 2009 to 2019
$25.5M
Occupational Exposure AssessmentZIACP010122 · NCI · DIVISION OF CANCER EPIDEMIOLOGY AND GENETICS · PI FRIESEN, MELISSA · 2009 to 2025
$8.6M
Intramural NIH HHS Z99 CT999999
6 · The paper itself

Abstract

backgroundMapping job titles to standardised occupation classification (SOC) codes is an important step in identifying occupational risk factors in epidemiological studies. Because manual coding is time-consuming and has moderate reliability, we developed an algorithm called SOCcer (Standardized Occupation Coding for Computer-assisted Epidemiologic Research) to assign SOC-2010 codes based on free-text job description components.

methodsJob title and task-based classifiers were developed by comparing job descriptions to multiple sources linking job and task descriptions to SOC codes. An industry-based classifier was developed based on the SOC prevalence within an industry. These classifiers were used in a logistic model trained using 14 983 jobs with expert-assigned SOC codes to obtain empirical weights for an algorithm that scored each SOC/job description. We assigned the highest scoring SOC code to each job. SOCcer was validated in 2 occupational data sources by comparing SOC codes obtained from SOCcer to expert assigned SOC codes and lead exposure estimates obtained by linking SOC codes to a job-exposure matrix.

resultsFor 11 991 case-control study jobs, SOCcer-assigned codes agreed with 44.5% and 76.3% of manually assigned codes at the 6-digit and 2-digit level, respectively. Agreement increased with the score, providing a mechanism to identify assignments needing review. Good agreement was observed between lead estimates based on SOCcer and manual SOC assignments (κ 0.6-0.8). Poorer performance was observed for inspection job descriptions, which included abbreviations and worksite-specific terminology.

conclusionsAlthough some manual coding will remain necessary, using SOCcer may improve the efficiency of incorporating occupation into large-scale epidemiological studies.

Indexed as

Job DescriptionNatural Language ProcessingAlgorithmsCarcinoma, Renal CellCase-Control StudiesEpidemiologic MethodsEpidemiologic StudiesHumansIndustryLogistic ModelsOccupationsReproducibility of ResultsSoftwareUnited StatesUnited States Occupational Safety and Health AdministrationComputers and information technology < Methodologyspeciality

Identifiers

PMID27102331
PMCPMC4871757

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.