YouTube Recommendations and Effects on Sharing Across Online Social Platforms

Did YouTube’s content quality initiative actually reduce its role in spreading harmful content? Our study finds that, although conspiracy-labeled videos experienced a downward trend in sharing, the sharing of other conspiracy-oriented content increased.

Abstract

In January 2019, YouTube announced it would exclude potentially harmful content from video recommendations but allow such videos to remain on the platform. While this step intends to reduce YouTube's role in propagating such content, continued availability of these videos in other online spaces makes it unclear whether this compromise actually reduces their spread. To assess this impact, we apply interrupted time series models to measure whether different types of YouTube sharing in Twitter and Reddit changed significantly in the eight months around YouTube's announcement. We evaluate video sharing across three curated sets of potentially harmful, anti-social content: a set of conspiracy videos that have been shown to experience reduced recommendations in YouTube, a larger set of videos posted by conspiracy-oriented channels, and a set of videos posted by alternative influence network (AIN) channels. As a control, we also evaluate effects on video sharing in a dataset of videos from mainstream news channels. Results show conspiracy-labeled and AIN videos that have evidence of YouTube's de-recommendation experience a significant decreasing trend in sharing on both Twitter and Reddit. For videos from conspiracy-oriented channels, however, we see no significant effect in Twitter but find a significant increase in the level of conspiracy-channel sharing in Reddit. For mainstream news sharing, we actually see an increase in trend on both platforms, suggesting YouTube's suppressing particular content types has a targeted effect. This work finds evidence that reducing exposure to anti-social videos within YouTube, without deletion, has potential pro-social, cross-platform effects. At the same time, increases in the level of conspiracy-channel sharing raise concerns about content producers' responses to these changes, and platform transparency is needed to evaluate these effects further.

Background

As of January 25, 2019, YouTube announced an initiative to improve the quality of content on its platform and the content it recommends to its users. While the platform removed these videos from the “Recommended” and “Up Next” section on the site, the videos were allowed to remain on the platform. With the intent to reduce YouTube's role in spreading harmful content, the continued availability of these videos in other online spaces begs the question of whether such actions actually impact the sharing of these videos in the broader information space. Little empirical evidence has studied the efficacy of such approaches to censorship on the information ecosystem and beyond YouTube’s boundaries.

Study

To assess the impact of YouTube’s actions, we measure whether the sharing of potentially harmful YouTube videos on Twitter and Reddit significantly changed in the eight months around YouTube's announcement. We do this by using a dataset of videos from mainstream news channels as a control. Then, we evaluate video sharing across three curated sets of content: conspiracy videos with reduced recommendations on YouTube, videos posted by conspiracy-oriented channels, and videos posted by alternative influence network (AIN) channels.

Results

The results of this study show that conspiracy-labeled videos experience a significant downward trend in sharing on both Twitter and Reddit. At the same time, videos from conspiracy-oriented channels experience a significant increase in sharing on Reddit following YouTube's intervention, suggesting that the de-recommendation may unintentionally push less overtly harmful conspiratorial content. This raises concerns about how producers and consumers of harmful content are responding to YouTube's changes. Researchers need transparency from YouTube and other platforms implementing similar changes in order to further evaluate these effects.