Article Text

Download PDFPDF
Original research
Predictive performance of cardiovascular disease risk prediction models in older adults: a validation and updating study
  1. Shiva Ganjali1,
  2. Mojtaba Lotfaliany1,
  3. Andrew Tonkin2,
  4. Mark R. Nelson2,3,
  5. Christopher M. Reid2,4,
  6. John J. McNeil2,
  7. Rory Wolfe2,
  8. Enayet Karim Chowdhury2,5,
  9. Robyn L. Woods2,
  10. Michael Berk1,6,
  11. Mohammadreza Mohebbi1,7
  1. 1IMPACT—The Institute for Mental and Physical Health and Clinical Translation, School of Medicine, Faculty of Health, Deakin University, Geelong, Victoria, Australia
  2. 2School of Public Health & Preventive Medicine, Monash University, Melbourne, Victoria, Australia
  3. 3Menzies Institute for Medical Research, University of Tasmania, Hobart, Tasmania, Australia
  4. 4School of Population Health, Curtin University, Perth, Western Australia, Australia
  5. 5Advara HeartCare, Leabrook, South Australia, Australia
  6. 6Psychiatry Research, Barwon Health, Geelong, Victoria, Australia
  7. 7Biostatistics Unit, Faculty of Health, Deakin University, Geelong, Victoria, Australia
  1. Correspondence to Dr Shiva Ganjali; s.ganjali{at}deakin.edu.au

Abstract

Background Current cardiovascular disease (CVD) risk prediction models tailored for older adults are inadequate. This study aimed to validate, update and assess the utility of widely used CVD risk prediction models including American College of Cardiology/American Heart Association, 2008 Framingham, GloboRisk, National Vascular Disease Prevention Alliance and Predict1 originally developed for middle-aged population, as well as an age-specific Systematic COronary Risk Evaluation 2-Older Person model, in Australian and the US community-dwelling older adults.

Methods Participants, without history of CVD events, dementia or physical disability, enrolled in the ASPREE (ASPirin in Reducing Events in the Elderly) clinical trial and ASPREE-eXTention observational post-trial follow-up, were considered for CVD risk prediction. The main outcome was predicted CVD risk from adjudicated CVD events. The performance of the original, recalibrated (adjusting models’ intercept and slope) and updated (adjusting models’ coefficients) models was evaluated by discrimination (C statistic), calibration (calibration plots) and clinical utility (decision curves). Models were extended by incorporating predictors including serum creatinine, depression and socioeconomic status index (Index of Relative Socio-economic Advantage and Disadvantage, IRSAD) into models’ equation, and the changes in discrimination were evaluated.

Results Among 15 618 adults (mean age 75 (4.4) years), 520 men and 498 women experienced CVD events over a median follow-up of 6.3 (IQR: 5.2–7.7) years. Following updating, the discrimination power of models increased for both sexes (C statistics ranged 0.62–0.64 for men and 0.68–0.69 for women). Updated models indicated good calibration, with an added net benefit at the risk thresholds ranging from 4%–10% for women to 5%–12% for men. Incorporating IRSAD, depression and serum creatinine did not improve CVD risk discrimination of updated models.

Conclusions Updating models, by adjusting model coefficients to better reflect the characteristics and risk factors of older adults, improves CVD risk prediction in a large cohort of relatively healthy Caucasian population aged 70+. Further external validation in diverse older populations including those with frailty and multimorbidity is recommended before clinical implementation.

  • Cardiovascular Diseases
  • Risk Assessment

Data availability statement

Data are available on reasonable request. Data may be obtained from a third party and are not publicly available. The datasets generated and/or analysed (analysis codes) during the current study are not publicly available due to legal and ethical reasons but are available from the corresponding author on reasonable request. More information can be found at https://aspree.org/aus/for-researchers/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Data availability statement

Data are available on reasonable request. Data may be obtained from a third party and are not publicly available. The datasets generated and/or analysed (analysis codes) during the current study are not publicly available due to legal and ethical reasons but are available from the corresponding author on reasonable request. More information can be found at https://aspree.org/aus/for-researchers/.

View Full Text

Footnotes

  • SG and ML are joint first authors.

  • X @profcmreid

  • SG and ML contributed equally.

  • Contributors SG: conceptualisation, methodology, software, data curation, formal analysis, visualisation and writing–original draft. ML: conceptualisation, methodology, software, data curation, formal analysis, validation, writing–review and editing. AT: writing–review and editing. MRN: writing–review and editing. CMR: writing–review and editing. JJMN: writing–review and editing. RW: writing–review and editing. EKC: writing–review and editing. RLW: writing–review and editing. MB: writing–review and editing. MM: conceptualisation, methodology, supervision, validation, writing–review and editing. SG is responsible for the overall content as guarantor. All authors read and approved the final manuscript.

  • Funding ASPREE is registered on the International Standard Randomized Controlled Trial Number Register (ISRCTN83772183). The ASPREE project, comprising two components of ASPREE and ASPREE-XT, was led by Monash University in Australia and the Berman Centre for Outcomes and Clinical Research in the USA. Funding for the ASPREE project was provided by Australian and US governments; the Australian National Health and Medical Research Council (NHMRC) (grants 334047 and 1127060); the National Institute on Aging; the National Cancer Institute at the US National Institutes of Health (grants U01AG029824 and U19AG062682); Monash University (Australia) and the Victorian Cancer Agency (Australia). MB is supported by an NHMRC Leadership 3 Investigator grant (GNT2017131). JJM is supported by an NHMRC Leadership 3 Investigator grant (IG1173690). SG is supported by the Alfred Deakin Postdoctoral Research Fellowship.

  • Disclaimer The funders had no role in study design, data collection and analysis, and decision to publish.

  • Competing interests None declared.

  • Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.