Measuring Long-term Impact of Ads on LinkedIn Feed
This work addresses the trade-off between engagement and revenue for LinkedIn's feed, providing insights for ad placement optimization, though it is incremental in nature.
The paper investigates how varying ad density in LinkedIn's newsfeed affects user engagement and revenue over time, finding that long-term impacts are significantly smaller than short-term effects and that different user cohorts react differently.
Organic updates (from a member's network) and sponsored updates (or ads, from advertisers) together form the newsfeed on LinkedIn. The newsfeed, the default homepage for members, attracts them to engage, brings them value and helps LinkedIn grow. Engagement and Revenue on feed are two critical, yet often conflicting objectives. Hence, it is important to design a good Revenue-Engagement Tradeoff (RENT) mechanism to blend ads in the feed. In this paper, we design experiments to understand how members' behavior evolve over time given different ads experiences. These experiences vary on ads density, while the quality of ads (ensured by relevance models) is held constant. Our experiments have been conducted on randomized member buckets and we use two experimental designs to measure the short term and long term effects of the various treatments. Based on the first three months' data, we observe that the long term impact is at a much smaller scale than the short term impact in our application. Furthermore, we observe different member cohorts (based on user activity level) adapt and react differently over time.