Encrypted | Login

An AAPM Grand Challenge

Overview

The American Association of Physicists in Medicine (AAPM) is facilitating a “Grand Challenge” on CT ventilation imaging leading up to the 2019 AAPM Annual Meeting. Computed tomography ventilation imaging evaluation 2019 (CTVIE19) will provide a unique opportunity for participants to compare their algorithms with those of other groups in a structured, direct way using the same datasets. A session at the 2019 AAPM Annual Meeting will focus on the CTVIE19 Challenge; an individual from each of the two top-performing teams will receive a waiver of the meeting registration fee in order to present their methods during this session. Following the Annual Meeting, challenge participants will be invited to co-author a challenge report.

Objective

The overall objective of CTVIE19 is to determine which CT ventilation imaging algorithms best correlate with reference measures across a range of pulmonary pathologies. To this end, we will provide a unique and diverse patient dataset of PFTs and paired multi-inflation CT and reference ventilation images collated from data acquired prospectively by leading functional lung imaging institutions worldwide.

Get Started

  1. Register to get access via the Challenge website
  2. Download the data after approval
  3. Submit preliminary cases as a pre-submission check
  4. Submit your results

Important Dates

Challenge Data

Data consist of PFTs, multi-inflation non-contrast CT (4D or breath-hold) and contrast-based ventilation images (nuclear imaging or hyperpolarised gas MRI) for patients with lung cancer and several non-oncological obstructive respiratory diseases including cystic fibrosis, asthma and COPD. The corresponding reference ventilation images for 50 CT scans will be provided for training. Several repeat CT datasets are also available for reproducibility analysis. In addition to the CT data, binary lung masks are provided for each inspiratory and expiratory scan. These may be used by participants in registering the scans if they wish to do so.

Table 1: Summary of CT and reference ventilation imaging training data included in grand challenge.

Reference Ventilation Modality Patients and disease CT breathing manoeuvre Reference breathing manoeuvre Data contributors
99mTc-DTPA SPECT ventilation 21 lung cancer 4D-CT Free breathing Dr Tokihiro Yamamoto (University of California-Davis, Davis, CA, USA)
68Ga-aerosol PET ventilation 25 lung cancer 4D-CT Free breathing Dr Shankar Siva and Prof. Michael Hofman (Peter MacCallum Cancer Centre, Melbourne, Australia)
Xenon CT 4 sheep 4D-CT Mechanical ventilation Prof Joseph Reinhardt and Gary Christensen (University of Iowa, Iowa, USA)

Abbreviations: DTPA = diethylenetriamine-pentaacetic acid; SPECT = single photon emission computerized tomography; PET = positron emission tomography; FRC = functional residual capacity; TLC = total lung capacity.

Table 2: Summary of CT and reference ventilation test data included in grand challenge.

Reference Ventilation Modality Patients and disease CT breathing manoeuvre Reference breathing manoeuvre

Data contributors

PFTs 50 lung cancer 4DCT  

Dr Yevgeniy Vinogradskiy (University of Colorado, Denver, USA)

68Ga-aerosol PET ventilation 18 lung cancer Breath-hold (End-expiration and inhalation) Free breathing

Dr Enid Eslick (Royal North Shore Hospital, Sydney, Australia)

68Ga-aerosol PET ventilation 22 lung cancer (mid-RT) 4D-CT Free breathing

Dr Shankar Siva and Prof. Michael Hofman (Peter MacCallum Cancer Centre, Melbourne, Australia)

68Ga-aerosol PET ventilation 18 lung cancer (post-RT) 4D-CT Free breathing

Dr Shankar Siva and Prof. Michael Hofman (Peter MacCallum Cancer Centre, Melbourne, Australia)

3He-MRI static ventilation 32 lung cancer 4D-CT Breath-hold (FRC+1L)

Prof Grace Parraga, Dr Doug Hoover, Dr Brian Yaremko, Dr David Palma, Dr Stewart Gaede (Robarts Research Institute and London Health Sciences Centre, London, ON, Canada)

3He-MRI static ventilation 32 COPD Breath-hold (End-expiration and inhalation) Breath-hold (FRC+1L)

Prof Grace Parraga (Robarts Research Institute, London, ON, Canada)

3He-MRI static ventilation 26 ex-smokers Breath-hold (End-expiration and inhalation) Breath-hold (FRC+1L)

Prof Grace Parraga (Robarts Research Institute, London, ON, Canada)

3He-MRI static ventilation 30 asthma Breath-hold (FRC and TLC) Breath-hold (FRC+1L)

Prof Jim Wild and Prof Chris Brightling (The University of Sheffield, Sheffield, UK and The University of Leicester, Leicester, UK)

3He-MRI static ventilation 20 lung cancer Breath-hold (FRC and FRC+1L) Breath-hold (FRC+1L)

Dr Bilal Tahir, Prof Jim Wild and Prof Matthew Hatton (The University of Sheffield and Weston Park Cancer Hospital, Sheffield, UK)

3He-MRI static ventilation 19 paediatric cystic fibrosis Breath-hold (End-expiration and inhalation) Breath-hold (FRC+1L)

Prof Jim Wild and Dr David Hughes (The University of Sheffield and Sheffield Children's Hospital, Sheffield, UK)

Abbreviations: DTPA = diethylenetriamine-pentaacetic acid; SPECT = single photon emission computerized tomography; PET = positron emission tomography; RT = radiation therapy; FRC = functional residual capacity; TLC = total lung capacity.

Table 3: Summary of CT reproducibility imaging data included in grand challenge.

Patients and disease CT breathing manoeuvre Time Interval Data contributors
10 lung cancer 4D-CT Different session (23 mins – 7 days) Prof Joe Reinhardt (University of Iowa, Iowa City, USA)
18 lung cancer 4D-CT Same (n = 10) and different (n = 8) day Dr Tokihiro Yamamoto (University of California-Davis, Davis, CA, USA)
36 normal smokers and non-smokers Breath-hold (TLC and FRC) Same-session Prof Eric Hoffman (University of Iowa, Iowa City, USA)


Quantitative evaluation

CT ventilation images will be compared against the corresponding reference ventilation images or repeat CT ventilation images for all test datasets using the following evaluation metrics:

Moreover, the following global metrics will be computed from the CT ventilation images and correlated against PFTs:

Results, prizes and publication plan

At the conclusion of the challenge, the following information will be provided to each participant:

The top 2 participants:

A manuscript summarizing the challenge results will be submitted for publication following completion of the challenge.

Terms and Conditions

The CTVIE19 challenge is organised in the spirit of cooperative scientific progress. The following rules apply to those who register a team and download the data:

Organizers and Major Contributors

Contact

For further information, please contact the lead organizer, Dr Bilal Tahir.