CLEF eHealth 2014

Lab Overview


The ShARe/CLEF eHealth Evaluation Lab 2014

Laypeople find eHealth documents to be difficult to understand and also clinicians have problems in understanding the jargon of other professional groups even though laws and policies emphasise patients’ right to be able to access and understand their clinical documents. A simple example from a US discharge document is “AP: 72 yo f w/ ESRD on HD, CAD, HTN, asthma p/w significant hyperkalemia & associated arrythmias.”

The usage scenario of the CLEF eHealth lab is to ease patients and next-of-kins’ ease in understanding eHealth information. eHealth documents are much easier to understand after expanding shorthand, correcting the misspellings, normalising all health conditions to standardised terminology,  and linking the words to a patient-centric search on the Internet. This would result in “Description of the patient’s active problem: 72 year old female with dependence on hemodialysis, coronary heart disease, hypertensive disease, and asthma who is currently presenting with the problem of significant hyperkalemia and associated arrhythmias” with the underlined words linked to their definitions in Wikipedia, Consumer Health Vocabulary, and other patient-friendly sources. This linkage would explain the connection between hyperkalemia and arrhythmia: “Extreme hyperkalemia (having too much potassium in the blood) is a medical emergency due to the risk of potentially fatal arrhythmias (abnormal heart rhythms).” Moreover, providing patients with reliable and relevant documents on their condition is also crucial to help their understanding.

The lab contains three tasks:
  • Task 1: Visual-Interactive Search and Exploration of eHealth Data
  • Task 2: Information extraction from clinical text
  • Task 3: User-centred health information retrieval.

This shared task has been supported in part by

  • Shared Annotated Resources (ShARe) project funded by the United States National Institutes of Health (R01GM090187). The guidelines annotation and schema for the SHAre/CLEF eHealth 2013 shared task are available to the research community. When using the annotation guidelines in your own research and publications, please cite 
    • The ShARe Schema for the Syntactic and Semantic Annotation of Clinical Texts. Noémie Elhadad, Wendy Chapman, Tim O’Gorman, Martha Palmer, Guergana Savova. Under Review.
  • CLEF Initiative (Conference and Labs of the Evaluation Forum, formerly known as Cross-Language Evaluation Forum)
  • NICTA, funded by the Australian Government as represented by the Department of Broadband, Communications and the Digital Economy and the Australian Research Council through the ICT Centre of Excellence program.
  • The Khresmoi project, funded by the European Union Seventh Framework Programme (FP7/2007-2013) under grant agreement no 257528.
  • Office of the National Coordinator of Healthcare Technology SHARP 90TR0002.