Search papers, labs, and topics across Lattice.
This study investigates the optimal observation window for predicting subscription churn using early behavioral indicators, particularly focusing on the KKBox dataset. It finds that while a 45-90 day window yields diminishing returns in prediction accuracy, the effectiveness of this window is highly dependent on the specific cohort and target definitions employed. The research underscores the necessity of tailoring window-sufficiency claims to the design of the prediction task, revealing that different feature sets can significantly alter the sufficiency curve.
Early behavioral indicators can drastically improve churn prediction, but their effectiveness hinges on cohort design and feature selection.
How many days of early behavior suffice for subscription churn prediction? In the public KKBox dataset, the early indicator of churn is typically an indicator of someone's contract status; however, when looking in the heavily churned manual-renewal segment, having access to early behavior creates a substantial increase in prediction for that specific segment (PR +0.10 at 120 days). A nine-window sufficiency curve shows a diminishing-returns knee in a 45-90 day band. However, stress-testing over three cohort/task designs shows that this curve is singular to the design being tested; for example, in our test with a moving target, the curve inverts and can shift depending on the feature set used. Therefore, any window-sufficiency claim should state its cohort construction, target definition, and feature families. All evidence is from one music-streaming dataset; the mechanism should generalize but the magnitudes may not.
