Developing EHR-driven heart failure risk prediction models using CPXR(Log) with the probabilistic loss function. Academic Article uri icon

Overview

MeSH

  • Aged
  • Algorithms
  • Area Under Curve
  • Cohort Studies
  • Comorbidity
  • False Positive Reactions
  • Female
  • Humans
  • Linear Models
  • Logistic Models
  • Male
  • Middle Aged
  • Probability
  • Prognosis
  • ROC Curve
  • Regression Analysis
  • Reproducibility of Results
  • Risk

MeSH Major

  • Electronic Health Records
  • Heart Failure
  • Medical Informatics

abstract

  • Computerized survival prediction in healthcare identifying the risk of disease mortality, helps healthcare providers to effectively manage their patients by providing appropriate treatment options. In this study, we propose to apply a classification algorithm, Contrast Pattern Aided Logistic Regression (CPXR(Log)) with the probabilistic loss function, to develop and validate prognostic risk models to predict 1, 2, and 5year survival in heart failure (HF) using data from electronic health records (EHRs) at Mayo Clinic. The CPXR(Log) constructs a pattern aided logistic regression model defined by several patterns and corresponding local logistic regression models. One of the models generated by CPXR(Log) achieved an AUC and accuracy of 0.94 and 0.91, respectively, and significantly outperformed prognostic models reported in prior studies. Data extracted from EHRs allowed incorporation of patient co-morbidities into our models which helped improve the performance of the CPXR(Log) models (15.9% AUC improvement), although did not improve the accuracy of the models built by other classifiers. We also propose a probabilistic loss function to determine the large error and small error instances. The new loss function used in the algorithm outperforms other functions used in the previous studies by 1% improvement in the AUC. This study revealed that using EHR data to build prediction models can be very challenging using existing classification methods due to the high dimensionality and complexity of EHR data. The risk models developed by CPXR(Log) also reveal that HF is a highly heterogeneous disease, i.e., different subgroups of HF patients require different types of considerations with their diagnosis and treatment. Our risk models provided two valuable insights for application of predictive modeling techniques in biomedicine: Logistic risk models often make systematic prediction errors, and it is prudent to use subgroup based prediction models such as those given by CPXR(Log) when investigating heterogeneous diseases. Copyright © 2016 Elsevier Inc. All rights reserved.

publication date

  • April 2016

has subject area

  • Aged
  • Algorithms
  • Area Under Curve
  • Cohort Studies
  • Comorbidity
  • Electronic Health Records
  • False Positive Reactions
  • Female
  • Heart Failure
  • Humans
  • Linear Models
  • Logistic Models
  • Male
  • Medical Informatics
  • Middle Aged
  • Probability
  • Prognosis
  • ROC Curve
  • Regression Analysis
  • Reproducibility of Results
  • Risk

Research

keywords

  • Journal Article

Identity

Language

  • eng

PubMed Central ID

  • PMC4886658

Digital Object Identifier (DOI)

  • 10.1016/j.jbi.2016.01.009

PubMed ID

  • 26844760

Additional Document Info

start page

  • 260

end page

  • 269

volume

  • 60