Singapore to develop tools to detect deepfakes and scams under new $20m initiative

Singapore to develop tools to detect deepfakes and scams under new $20m initiative
Singapore needs to grow new capabilities to keep pace with scammers and online risks, said Minister for Communications and Information Josephine Teo.
PHOTO: The Straits Times file

SINGAPORE - Deepfakes circulating here could be watermarked in the future to alert viewers. Similarly, the same watermarking technology could be used to label trusted content.

These are among a new arsenal of detection tools Singapore is developing to tackle the rising scourge of deepfakes and misinformation. The tools will be designed under a new $20 million initiative to build online trust and safety.

Announcing the efforts in Parliament on Jan 9, Minister for Communications and Information Josephine Teo said that Singapore needs to grow new capabilities to keep pace with scammers and online risks. The most worrisome is the misuse of deepfakes to create compelling pitches.

“Our digital way of life has exposed us to new risks. Cyberattacks, scams, and harmful content pose a growing threat to our safety and security. As many MPs have noted, trust in society, so crucial for normal human interactions, could be undermined,” she said.

And even though the Singapore government has taken bold steps to counter these risks including enacting new laws, more of the right things could be done continously, said Mrs Teo.

She was responding to a motion, of which she expressed support, filed by the five-member Government Parliamentary Committee (GPC) for Communications and Information and five other MPs.

Titled Building an Inclusive and Safe Digital Society, the motion contains 13 recommendations to better safeguard online transactions, detect deepfakes and scams, as well as educate whole of society to take part in digital activities safely.

The motion was filed by GPC (Communications and Information) chairperson Tin Pei Ling, deputy chairperson Alex Yam, and members Sharael Taha, Hany Soh and Jessica Tan. The five People’s Action Party MPs involved in the motion are Darryl David, Mariam Jaafar, Nadia Ahmad Samdin, Yip Hon Weng, and Dr Wan Rizal.

The recommendations include having the government take the lead in setting up information-sharing platforms to help the public better detect scams, ensuring that device makers and digital platforms provide stronger safeguards against malware, and holding social media services accountable for harmful content and malicious ads.

Parliamentarians unanimously supported the motion, and spoke widely covering areas from deepfakes manipulating public opinion and online scams to helping vulnerable groups navigate the digital space.

Mr Tan Wu Meng (Jurong GRC) said that the issue of deepfakes is a serious matter for all democracies, and called on the Government to look at ways of electronically watermaking content as a proof that the content is real. 

“If we can no longer discern easily what is real and not real. You can’t even have a functioning democracy. No government regardless of which political party they come from, will be able to govern in any country without that fundamental basis for deliberative democratic discussion,” he said.

Mr Tan raised the example of Prime Minister Lee Hsien Loong, who was recently a target of malicious actors as he had his likeness used in scam videos to promote investment products.

“That’s just deepfake 1.0. Project that forward, three, five or ten years with more computing power, you can imagine how authentic those deepfakes are going to be,” said Mr Tan.

As generative AI becomes mainstream, it has become easier to create and spread deepfakes and misinformation.

In a year of record elections where at least 40 countries and territories are heading to the polls, that has given rise to concerns on how such manipulated content can influence voters.

Singaporeans could head to the ballot box in 2024 too, as a leadership transition is set to take place by November.

Mrs Teo said that a new Centre for Advanced Technologies in Online Safety (CATOS) will be set up to hone Singapore’s expertise in detecting deepfakes and online misinformation.

The centre will be officially launched in the first half of 2024, and it comes under the $20 million Online Trust and Safety (OTS) Research Programme led by the Ministry of Communications and Information.

The $20 million will be used to boost the research capabilities of CATOS. It is funded under the Smart Nation & Digital Economy domain of Singapore’s Research, Innovation and Enterprise 2025 Plan, and runs from 2023 till 2028.

CATOS will be hosted by the Agency for Science, Technology and Research (A*STAR), and focus on building and customising tools to detect harmful content such as deepfakes and non-factual claims, and test technologies such as watermarking and content authentication.

The centre will also identify societal vulnerabilities and develop potential interventions, like flagging or correction of misinformation, that could reduce Internet users’ susceptibility to harmful online content.

“These research efforts will also help inform new legislation or regulations that we may need for issues like deepfakes and which we are studying,” said Mrs Teo.

CATOS will be officially launched at an inaugural online trust and safety forum later this year and the event will feature international experts, and showcase the first version of technology solutions by CATOS for trial and adoption.

In the lead-up to its official launch, CATOS has started conversations with local researchers, technology developers and industry to raise awareness of the challenges and opportunities in online trust and safety since April 2023.

Through its various workshops and seminar events, CATOS has built a professional online trust and safety community network, with over 100 participants from academia, industry and public agencies.

To date, more than 30 professionals are involved in CATOS’ work, including scientists, engineers, operations staff and adjunct members. CATOS draws on multidisciplinary research capabilities of academic experts from local and global research institutes to strengthen research collaboration and knowledge exchange.

Mrs Teo also said that Singapore had recently refreshed its AI strategy with the launch of Singapore’s second National AI Strategy (NAIS 2.0) in December 2023.

Singapore will soon update its recommendations on dealing with AI risks, and the Model AI Governance Framework 2.0, will be released for public consultation later in January.

“For example, we are very concerned about the mis-use of generative AI to spread misinformation and carry out targeted scams. Mitigating biasness and enhancing the explainability of AI models are also crucial to developing and deploying them responsibly,” said Mrs Teo.

ALSO READ: 'Very convincing but completely bogus': PM Lee warns of deepfake video of him promoting investment scams

This article was first published in The Straits Times. Permission required for reproduction.

This website is best viewed using the latest versions of web browsers.