PlumX Metrics
SSRN
Embed PlumX Metrics

Customer Choice Models versus Machine Learning: Finding Optimal Product Displays on Alibaba

SSRN, ISSN: 1556-5068
2018
  • 11
    Citations
  • 12,101
    Usage
  • 14
    Captures
  • 1
    Mentions
  • 0
    Social Media
Metric Options:   Counts1 Year3 Year

Metrics Details

  • Citations
    11
    • Citation Indexes
      11
  • Usage
    12,101
    • Abstract Views
      9,630
    • Downloads
      2,471
  • Captures
    14
  • Mentions
    1
    • Blog Mentions
      1
      • Blog
        1
  • Ratings
    • Download Rank
      11,639

Article Description

We compare the performance of two approaches for finding the optimal set of products to display to customers landing on Alibaba's two online marketplaces, Tmall and Taobao. Both approaches were placed online simultaneously and tested on real customers for one week. The first approach we test is Alibaba's current practice. This procedure embeds thousands of product and customer features within a sophisticated machine learning algorithm that is used to estimate the purchase probabilities of each product for the customer at hand. The products with the largest expected revenue (revenue * predicted purchase probability) are then made available for purchase. The downside of this approach is that it does not incorporate customer substitution patterns; the estimates of the purchase probabilities are independent of the set of products that eventually are displayed. Our second approach uses a featurized multinomial logit (MNL) model to predict purchase probabilities for each arriving customer. In this way we use less sophisticated machinery to estimate purchase probabilities, but we employ a model that was built to capture customer purchasing behavior and, more specifically, substitution patterns. We use historical sales data to fit the MNL model and then, for each arriving customer, we solve the cardinality-constrained assortment optimization problem under the MNL model online to find the optimal set of products to display. Our experiments show that despite the lower prediction power of our MNL-based approach, it generates significantly higher revenue per visit compared to the current machine learning algorithm with the same set of features. We also conduct various heterogeneous-treatment-effect analyses to demonstrate that the current MNL approach performs best for sellers whose customers generally only make a single purchase.

Bibliographic Details

Jake Feldman; Dennis J. Zhang; Xiaofei Liu; Nannan Zhang

Elsevier BV

Multidisciplinary; Choice Models; Product Assortment; Machine Learning; Field Experiment; Retail Operations

Provide Feedback

Have ideas for a new metric? Would you like to see something else here?Let us know