A stability-aware, value-driven framework for uplift policy selection is presented, applied to a telecommunications churn-retention dataset. The central argument is that reliable deployment of an uplift model requires more than optimizing a causal ranking metric: the targeted customer set must remain consistent across repeated training runs, and the selected policy must be economically sound and interpretable. Competing algorithmic families, including causal meta-learners, transformed- outcome approaches, four-quadrant models, and a conventional response baseline, are evaluated under a repeated-run experimental protocol that jointly quantifies economic effectiveness, run-to- run reliability of both targeted and persuadable customer sets via Jaccard-based consistency indices, and interpretability through surrogate CART distillation into compact Boolean decision rules. A Stability-Adjusted Revenue index synthesizes value and reliability into a single deployment-oriented criterion. Two complementary empirical regimes are examined: a semi-synthetic scenario with con- trolled treatment effects and an observational proxy scenario. Results reveal two significant find- ings: (i) the highest-yielding policy suffers from severe targeting instability, exposing a structural risk-return trade-off concealed by single-metric selection; and (ii) causal architectures do not univer- sally dominate, as a conventional response model proves economically superior under confounded observational conditions. Developed within a regional research program and validated through an ongoing industrial implementation, this work extends the methodological framework toward prac- tical, auditable deployment of causal machine learning.
Decision Reliability in Uplift Modeling: A Stability- and Value-Driven Framework for Customer Retention Policy Selection
Massimo Pacella
Primo
;Gabriele Papadia;
2026-01-01
Abstract
A stability-aware, value-driven framework for uplift policy selection is presented, applied to a telecommunications churn-retention dataset. The central argument is that reliable deployment of an uplift model requires more than optimizing a causal ranking metric: the targeted customer set must remain consistent across repeated training runs, and the selected policy must be economically sound and interpretable. Competing algorithmic families, including causal meta-learners, transformed- outcome approaches, four-quadrant models, and a conventional response baseline, are evaluated under a repeated-run experimental protocol that jointly quantifies economic effectiveness, run-to- run reliability of both targeted and persuadable customer sets via Jaccard-based consistency indices, and interpretability through surrogate CART distillation into compact Boolean decision rules. A Stability-Adjusted Revenue index synthesizes value and reliability into a single deployment-oriented criterion. Two complementary empirical regimes are examined: a semi-synthetic scenario with con- trolled treatment effects and an observational proxy scenario. Results reveal two significant find- ings: (i) the highest-yielding policy suffers from severe targeting instability, exposing a structural risk-return trade-off concealed by single-metric selection; and (ii) causal architectures do not univer- sally dominate, as a conventional response model proves economically superior under confounded observational conditions. Developed within a regional research program and validated through an ongoing industrial implementation, this work extends the methodological framework toward prac- tical, auditable deployment of causal machine learning.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


