|
ИСТИНА |
Войти в систему Регистрация |
ИПМех РАН |
||
Future User Engagement Prediction and Its Application to Improve the Sensitivity of Online Experimentsстатья
- Авторы: Drutsa Alexey, Gusev Gleb, Serdyukov Pavel
- Сборник: Proceedings of the 24th International Conference on World Wide Web
- Год издания: 2015
- Место издания: International World Wide Web Conferences Steering Committee
- Первая страница: 256
- Последняя страница: 266
- DOI: 10.1145/2736277.2741116
- Аннотация: Modern Internet companies improve their services by means of data-driven decisions that are based on online controlled experiments (also known as A/B tests). To run more online controlled experiments and to get statistically significant results faster are the emerging needs for these companies. The main way to achieve these goals is to improve the sensitivity of A/B experiments. We propose a novel approach to improve the sensitivity of user engagement metrics (that are widely used in A/B tests) by utilizing prediction of the future behavior of an individual user. This problem of prediction of the exact value of a user engagement metric is also novel and is studied in our work. We demonstrate the effectiveness of our sensitivity improvement approach on several real online experiments run at Yandex. Especially, we show how it can be used to detect the treatment effect of an A/B test faster with the same level of statistical significance.
- Добавил в систему: Друца Алексей Валерьевич