Improving Electronic Health Record Note Comprehension With NoteAid: Randomized Trial of Electronic Health Record Note Comprehension Interventions With Crowdsourced Workers
- PMID: 30664453
- PMCID: PMC6351990
- DOI: 10.2196/10793
Improving Electronic Health Record Note Comprehension With NoteAid: Randomized Trial of Electronic Health Record Note Comprehension Interventions With Crowdsourced Workers
Abstract
Background: Patient portals are becoming more common, and with them, the ability of patients to access their personal electronic health records (EHRs). EHRs, in particular the free-text EHR notes, often contain medical jargon and terms that are difficult for laypersons to understand. There are many Web-based resources for learning more about particular diseases or conditions, including systems that directly link to lay definitions or educational materials for medical concepts.
Objective: Our goal is to determine whether use of one such tool, NoteAid, leads to higher EHR note comprehension ability. We use a new EHR note comprehension assessment tool instead of patient self-reported scores.
Methods: In this work, we compare a passive, self-service educational resource (MedlinePlus) with an active resource (NoteAid) where definitions are provided to the user for medical concepts that the system identifies. We use Amazon Mechanical Turk (AMT) to recruit individuals to complete ComprehENotes, a new test of EHR note comprehension.
Results: Mean scores for individuals with access to NoteAid are significantly higher than the mean baseline scores, both for raw scores (P=.008) and estimated ability (P=.02).
Conclusions: In our experiments, we show that the active intervention leads to significantly higher scores on the comprehension test as compared with a baseline group with no resources provided. In contrast, there is no significant difference between the group that was provided with the passive intervention and the baseline group. Finally, we analyze the demographics of the individuals who participated in our AMT task and show differences between groups that align with the current understanding of health literacy between populations. This is the first work to show improvements in comprehension using tools such as NoteAid as measured by an EHR note comprehension assessment tool as opposed to patient self-reported scores.
Keywords: MedlinePlus; crowdsourcing; health literacy; information storage and retrieval; natural language processing; psychometrics.
©John P Lalor, Beverly Woolf, Hong Yu. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 16.01.2019.
Conflict of interest statement
Conflicts of Interest: None declared.
Figures
![Figure 1](https://webcf.waybackmachine.org/web/20220618083502im_/https://www.ncbi.nlm.nih.gov/pmc/articles/instance/6351990/bin/jmir_v21i1e10793_fig1.gif)
![Figure 2](https://webcf.waybackmachine.org/web/20220618083502im_/https://www.ncbi.nlm.nih.gov/pmc/articles/instance/6351990/bin/jmir_v21i1e10793_fig2.gif)
![Figure 3](https://webcf.waybackmachine.org/web/20220618083502im_/https://www.ncbi.nlm.nih.gov/pmc/articles/instance/6351990/bin/jmir_v21i1e10793_fig3.gif)
![Figure 4](https://webcf.waybackmachine.org/web/20220618083502im_/https://www.ncbi.nlm.nih.gov/pmc/articles/instance/6351990/bin/jmir_v21i1e10793_fig4.gif)
![Figure 5](https://webcf.waybackmachine.org/web/20220618083502im_/https://www.ncbi.nlm.nih.gov/pmc/articles/instance/6351990/bin/jmir_v21i1e10793_fig5.gif)
Similar articles
-
Evaluating the Effectiveness of NoteAid in a Community Hospital Setting: Randomized Trial of Electronic Health Record Note Comprehension Interventions With Patients.J Med Internet Res. 2021 May 13;23(5):e26354. doi: 10.2196/26354. J Med Internet Res. 2021. PMID: 33983124 Free PMC article. Clinical Trial.
-
ComprehENotes, an Instrument to Assess Patient Reading Comprehension of Electronic Health Record Notes: Development and Validation.J Med Internet Res. 2018 Apr 25;20(4):e139. doi: 10.2196/jmir.9380. J Med Internet Res. 2018. PMID: 29695372 Free PMC article.
-
A Natural Language Processing System That Links Medical Terms in Electronic Health Record Notes to Lay Definitions: System Development Using Physician Reviews.J Med Internet Res. 2018 Jan 22;20(1):e26. doi: 10.2196/jmir.8669. J Med Internet Res. 2018. PMID: 29358159 Free PMC article.
-
Comparison of electronic health record system functionalities to support the patient recruitment process in clinical trials.Int J Med Inform. 2014 Nov;83(11):860-8. doi: 10.1016/j.ijmedinf.2014.08.005. Epub 2014 Aug 25. Int J Med Inform. 2014. PMID: 25189709 Review.
-
Capturing health literacy assessment in the electronic health record through evidence-based concept creation: A review of the literature and recommendations for action.Health Informatics J. 2019 Sep;25(3):1025-1037. doi: 10.1177/1460458217739341. Epub 2017 Nov 7. Health Informatics J. 2019. PMID: 29113528 Review.
Cited by 6 articles
-
Can sharing clinic notes improve communication and promote self-management? A qualitative study of patients with COPD.Patient Educ Couns. 2022 Mar;105(3):726-733. doi: 10.1016/j.pec.2021.06.004. Epub 2021 Jun 8. Patient Educ Couns. 2022. PMID: 34175167
-
Patient Rationales Against the Use of Patient-Accessible Electronic Health Records: Qualitative Study.J Med Internet Res. 2021 May 28;23(5):e24090. doi: 10.2196/24090. J Med Internet Res. 2021. PMID: 34047711 Free PMC article.
-
Evaluating the Effectiveness of NoteAid in a Community Hospital Setting: Randomized Trial of Electronic Health Record Note Comprehension Interventions With Patients.J Med Internet Res. 2021 May 13;23(5):e26354. doi: 10.2196/26354. J Med Internet Res. 2021. PMID: 33983124 Free PMC article. Clinical Trial.
-
Evaluation of lexical clarification by patients reading their clinical notes: a quasi-experimental interview study.BMC Med Inform Decis Mak. 2020 Dec 15;20(Suppl 10):278. doi: 10.1186/s12911-020-01286-9. BMC Med Inform Decis Mak. 2020. PMID: 33319706 Free PMC article.
-
BENTO: A Visual Platform for Building Clinical NLP Pipelines Based on CodaLab.Proc Conf Assoc Comput Linguist Meet. 2020 Jul;2020:95-100. doi: 10.18653/v1/2020.acl-demos.13. Proc Conf Assoc Comput Linguist Meet. 2020. PMID: 33223604 Free PMC article.
References
-
- Ross SE, Lin C. The effects of promoting patient access to medical records: a review. J Am Med Inform Assoc. 2003 Apr;10(2):129–38. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="uri" xlink:href="http://jamia.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=12595402"/> - PMC - PubMed
-
- Masys D, Baker D, Butros A, Cowles KE. Giving patients access to their medical records via the internet: the PCASSO experience. J Am Med Inform Assoc. 2002;9(2):181–91. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="uri" xlink:href="http://europepmc.org/abstract/MED/11861633"/> - PMC - PubMed
-
- Sheldon MG. Giving patients a copy of their computer medical record. J R Coll Gen Pract. 1982 Feb;32(235):80–6. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="uri" xlink:href="http://bjgp.org/cgi/pmidlookup?view=long&pmid=7097630"/> - PMC - PubMed
-
- Bronson DL, Costanza MC, Tufo HM. Using medical records for older patient education in ambulatory practice. Med Care. 1986 Apr;24(4):332–9. - PubMed
-
- Homer CS, Davis GK, Everitt LS. The introduction of a woman-held record into a hospital antenatal clinic: the bring your own records study. Aust N Z J Obstet Gynaecol. 1999 Feb;39(1):54–7. - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Medical