The languages of health in general practice electronic patient records: a Zipf's law analysis.

backgroundNatural human languages show a power law behaviour in which word frequency (in any large enough corpus) is inversely proportional to word rank - Zipf's law. We have therefore asked whether similar power law behaviours could be seen in data from electronic patient records.

resultsIn order to examine this question, anonymised data were obtained from all general practices in Salford covering a seven year period and captured in the form of Read codes. It was found that data for patient diagnoses and procedures followed Zipf's law. However, the medication data behaved very differently, looking much more like a referential index. We also observed differences in the statistical behaviour of the language used to describe patient diagnosis as a function of an anonymised GP practice identifier.

conclusionsThis works demonstrate that data from electronic patient records does follow Zipf's law. We also found significant differences in Zipf's law behaviour in data from different GP practices. This suggests that computational linguistic techniques could become a useful additional tool to help understand and monitor the data quality of health records.