Skip to contents

Counterfactual Performance (Single Population)

Estimate prediction model performance under counterfactual interventions

cf_mse()
Estimate Counterfactual Mean Squared Error
cf_auc()
Estimate Counterfactual Area Under the ROC Curve
cf_calibration()
Estimate Counterfactual Calibration Curve
cf_sensitivity() cf_tpr()
Estimate Counterfactual Sensitivity
cf_specificity() cf_tnr()
Estimate Counterfactual Specificity
cf_fpr()
Estimate Counterfactual False Positive Rate
cf_roc()
Compute Counterfactual ROC Curve

Transportability (Two Populations)

Transport prediction model performance from source to target population

tr_mse()
Estimate Transportable Mean Squared Error in the Target Population
tr_auc()
Estimate Transportable Area Under the ROC Curve in the Target Population
tr_calibration()
Estimate Transportable Calibration in the Target Population
tr_sensitivity() tr_tpr()
Estimate Transportable Sensitivity in the Target Population
tr_specificity() tr_tnr()
Estimate Transportable Specificity in the Target Population
tr_fpr()
Estimate Transportable False Positive Rate in the Target Population
tr_roc()
Compute Transportable ROC Curve

Model Selection

Cross-validation and model comparison

cf_cv()
Cross-Validation with Counterfactual Performance Metrics
cf_compare()
Compare Multiple Prediction Models

Machine Learning

ML learner specifications for nuisance models

ml_learner()
Specify a Machine Learning Learner for Nuisance Models
print(<ml_learner>)
Print Method for ml_learner Objects

Nuisance Models

Fit propensity and outcome models

fit_nuisance()
Fit Nuisance Models for Counterfactual Performance Estimation

S3 Methods

Methods for result objects

as.data.frame(<tr_roc>) as.data.frame(<cf_roc>)
Convert ROC Curve to Data Frame
coef(<cf_performance>)
Coefficient Method for cf_performance Objects
coef(<tr_performance>)
Coefficient Method for tr_performance Objects
confint(<cf_performance>)
Confidence Interval Method for cf_performance Objects
confint(<tr_performance>)
Confidence Interval Method for tr_performance Objects
plot(<cf_auc>)
Plot Method for cf_auc Objects
plot(<cf_calibration>)
Plot Method for cf_calibration Objects
plot(<tr_calibration>)
Plot Method for tr_calibration Objects
plot(<tr_roc>) plot(<cf_roc>)
Plot ROC Curve
print(<cf_compare>)
Print Method for cf_compare Objects
print(<cf_cv>)
Print Method for cf_cv Objects
print(<cf_nuisance>)
Print Method for cf_nuisance Objects
print(<cf_performance>)
Print Method for cf_performance Objects
print(<tr_performance>)
Print Method for tr_performance Objects
summary(<cf_compare>)
Summary Method for cf_compare Objects
summary(<cf_cv>)
Summary Method for cf_cv Objects
summary(<cf_performance>)
Summary Method for cf_performance Objects
summary(<tr_performance>)
Summary Method for tr_performance Objects

Example Data

cvd_sim
Simulated Cardiovascular Disease Data
transport_sim
Simulated Transportability Data