The scale of child sexual exploitation and abuse online is increasing at an alarming rate.The Internet Watch Foundation (IWF)recently announcedthat it’s finding more finding 15 times as much child sexual abuse material (CSAM) online as it was a decade ago.
This content is particularly prevalent inEurope. According toa 2020 report by the IWF, most web pages hosting CSAM are based in the continent.In response, the European Union plans to introduce stricter rules on tech firms that host the material.
“I will propose legislation in the coming months that will require companies to detect, report, and remove child sexual abuse,” EU home affairs commissioner Ylva Johansson toldGermany’s Welt am Sonntagon Sunday.
“A voluntary report will then no longer be sufficient.”
The 💜 of EU tech
The latest rumblings from the EU tech scene, a story from our wise ol' founder Boris, and some questionable AI art. It’s free, every week, in your inbox. Sign up now!
The measures would strengthen existing safeguards, but critics fear they’ll pave the way formasssurveillance.
“As with any crime, the fight against onlineCSAMneeds to be tackled in a way that is proportionate and lawful, meaning that interventions should be targeted against individuals or servers where there is reasonable suspicion,” Ella Jakubowska, a policy advisor atEuropean Digital Rights (EDRi), told TNW.
“In contrast, the EU’s strategy seems to be to cast a dangerously wide net, proposing measures which might force service providers to scan each and every person’s private messages.”
The EDRiwarnsthat such generalized scanning poses aserious risk to everyone’s fundamental rights. The advocacy group wants any proposals to detect CSAM to align with the EU’s fundamental rights obligations. It has called for all measures to be lawful, targeted, as well as clearly and objectively proportionate to their stated goal.
Some of the group’s concerns are reminiscent of the responses toApple’splans to scan customers’ devices for CSAM.
The companydelayed the feature’s launchamid criticisms of its effectiveness, vulnerabilityto hackers, and potential to scan for other material — such as indications of political dissent.
In the case of the EU’s plans, however, new measures will be mandatory.
A spokesperson for the bloc told TNW that the obligations must be implemented in full respect of fundamental rights. They added that mechanisms to ensure accountability and transparency will be key elements of the legislation.
Despite these pledges, activists fear that theEU’s proposals will create more problems than they solve.
Images and videos of online child sexual abuse can be reported anonymously onthe IWF website.
Story byThomas Macaulay
Thomas is a senior reporter at TNW. He covers European tech, with a focus on AI, cybersecurity, and government policy.Thomas is a senior reporter at TNW. He covers European tech, with a focus on AI, cybersecurity, and government policy.
Get the TNW newsletter
Get the most important tech news in your inbox each week.
