A stability-aware, value-driven framework for uplift policy selection is presented, applied to a telecommunications churn-retention dataset. The central argument is that reliable deployment of an uplift model requires more than optimizing a causal ranking metric: the targeted customer set must remain consistent across repeated training runs, and the selected policy must be economically sound and interpretable. Competing algorithmic families, including causal meta-learners, transformed- outcome approaches, four-quadrant models, and a conventional response baseline, are evaluated under a repeated-run experimental protocol that jointly quantifies economic effectiveness, run-to- run reliability of both targeted and persuadable customer sets via Jaccard-based consistency indices, and interpretability through surrogate CART distillation into compact Boolean decision rules. A Stability-Adjusted Revenue index synthesizes value and reliability into a single deployment-oriented criterion. Two complementary empirical regimes are examined: a semi-synthetic scenario with con- trolled treatment effects and an observational proxy scenario. Results reveal two significant find- ings: (i) the highest-yielding policy suffers from severe targeting instability, exposing a structural risk-return trade-off concealed by single-metric selection; and (ii) causal architectures do not univer- sally dominate, as a conventional response model proves economically superior under confounded observational conditions. Developed within a regional research program and validated through an ongoing industrial implementation, this work extends the methodological framework toward prac- tical, auditable deployment of causal machine learning.

Decision Reliability in Uplift Modeling: A Stability- and Value-Driven Framework for Customer Retention Policy Selection

Massimo Pacella
Primo
;
Gabriele Papadia;
2026-01-01

Abstract

A stability-aware, value-driven framework for uplift policy selection is presented, applied to a telecommunications churn-retention dataset. The central argument is that reliable deployment of an uplift model requires more than optimizing a causal ranking metric: the targeted customer set must remain consistent across repeated training runs, and the selected policy must be economically sound and interpretable. Competing algorithmic families, including causal meta-learners, transformed- outcome approaches, four-quadrant models, and a conventional response baseline, are evaluated under a repeated-run experimental protocol that jointly quantifies economic effectiveness, run-to- run reliability of both targeted and persuadable customer sets via Jaccard-based consistency indices, and interpretability through surrogate CART distillation into compact Boolean decision rules. A Stability-Adjusted Revenue index synthesizes value and reliability into a single deployment-oriented criterion. Two complementary empirical regimes are examined: a semi-synthetic scenario with con- trolled treatment effects and an observational proxy scenario. Results reveal two significant find- ings: (i) the highest-yielding policy suffers from severe targeting instability, exposing a structural risk-return trade-off concealed by single-metric selection; and (ii) causal architectures do not univer- sally dominate, as a conventional response model proves economically superior under confounded observational conditions. Developed within a regional research program and validated through an ongoing industrial implementation, this work extends the methodological framework toward prac- tical, auditable deployment of causal machine learning.
2026
979-12-243434-1-7
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11587/583466
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact