Countering Violent Extremism: Facebook Algorithms 'Will Identify Terrorists'

Facebook founder Mark Zuckerberg has outlined a plan to let artificial intelligence (AI) software review content posted on the social network.

In a letter describing the plan, he said algorithms would eventually be able to spot terrorism, violence, bullying and even prevent suicide.

He admitted Facebook had previously made mistakes in the content it had removed from the website.

But he said it would take years for the necessary algorithms to be developed.

The announcement has been welcomed by an internet safety charity, which had previously been critical of the way the social network had handled posts depicting extreme violence.

Errors

In his 5,500-word letter discussing the future of Facebook, Mr Zuckerberg said it was impossible to review the billions of posts and messages that appeared on the platform every day.

"The complexity of the issues we've seen has outstripped our existing processes for governing the community," he said.

He highlighted the removal of videos related to the Black Lives Matter movement and the historical napalm girl photograph from Vietnam as "errors" in the existing process.

Facebook was also criticised in 2014, following reports that one of the killers of Fusilier Lee Rigby spoke online about murdering a soldier, months before the attack.

"We are researching systems that can read text and look at photos and videos to understand if anything dangerous may be happening.

"This is still very early in development, but we have started to have it look at some content, and it already generates about one third of all reports to the team that reviews content."

He said AI promised to identify problematic material more quickly than humans and could also "identify risks that nobody would have flagged at all, including terrorists planning attacks using private channels".

"Right now, we're starting to explore ways to use AI to tell the difference between news stories about terrorism and actual terrorist propaganda."

Personal filtering

Mr Zuckerberg said his ultimate aim was to allow people to post largely whatever they liked, within the law, with algorithms detecting what had been uploaded.

Users would then be able to filter their news feed to remove the types of post they did not want to see.

"Where is your line on nudity? On violence? On graphic content? On profanity? What you decide will be your personal settings," he explained.

"For those who don't make a decision, the default will be whatever the majority of people in your region selected, like a referendum.

"It's worth noting that major advances in AI are required to understand text, photos and videos to judge whether they contain hate speech, graphic violence, sexually explicit content, and more.

"At our current pace of research, we hope to begin handling some of these cases in 2017, but others will not be possible for many years."

The plan was welcomed by the Family Online Safety Institute, a member of Facebook's own safety advisory board. The charity had previously criticised the social networkfor allowing beheading videos to be seen without any warning on its site.

"This letter further demonstrates that Facebook has been responsive to concerns and is working hard to prevent and respond to abuse and inappropriate material on the platform," said Jennifer Hanley, Fosi's vice president of legal and policy.

"I also really like the ability for users to customise their own experiences with these developments. It's important to give users power over their online experiences, and additional tools and controls will be helpful."

Culled from: The BBC