Humans at the center of effective digital defense

Content moderation is important for online experiences. Despite the "utopian notion" of an open internet, effective content moderation is necessary for digital platforms to function. He says that there is no platform that does not impose rules. Platforms need to protect one user from another, or one group from its antagonists, as well as to present their best face to new users, to their advertisers and partners.

Content moderation is used to address a lot of content. Content moderation can help organizations keep their users safe. A best practices approach to content moderation uses sophisticated and accurate technical solutions and backstopped those efforts with human skill and judgement.

Content moderation is important to all organizations and individuals who gather in digital spaces. According to the practice director of trust and safety at Everest Group, the industry was worth $7.5 billion in 2021. Content moderation will be considered a top priority by a third of large companies by the year 2020.

Content moderation: More than social media

Content is removed from the internet every day. The company removed over 20 million incidences of violent and graphic content and over 10 million incidences of hate speech in the last three months of the year. A lot of industries rely on User Generated Content and therefore need to moderation their content.

Mary L. Gray is a senior principal researcher at Microsoft Research and a faculty member at the Luddy School of Informatics, Computing, and Engineering at Indiana University. The public sector and government are two sectors that rely a lot on moderation.

Content moderation can remove offensive content, detect and eliminate bots, identify and remove fake user profiles, address phony reviews and ratings, remove police deceptive advertising, mitigate predatory content, and facilitate safe two-way communications. E-commerce platforms are prone to fraud. Akash Pugalia is the global president of trust and safety at Teleperformance, which provides non-egregious moderation support for global brands. Products follow the platform's guidelines and they are also removed from the market.

The report is available for download.

This content was produced by Insights, the custom content arm of MIT Technology Review. It was not written by MIT Technology Review’s editorial staff.