Asian innovators fight online hate, lies as tech giants fall short

BANGKOK/JAKARTA听–听Fed up with the constant stream of fake news on her family WhatsApp group chats in India – ranging from a water crisis in South Africa to rumors around a Bollywood actor’s death -Tarunima Prabhakar built a simple tool to tackle misinformation.
Prabhakar, co-founder of India-based听迟别肠丑nology firm Tattle, archived content from fact-checking sites and news outlets, and used machine learning to automate the verification process.
The web-based tool is available to students, researchers, journalists and academics, she said.
“Platforms like Facebook and Twitter are under scrutiny for misinformation, but not WhatsApp,” she said of the messaging app owned by Meta, Facebook’s parent, that has more than 2 billion monthly active users, with about half a billion in India alone.
“The tools and methods used to check misinformation on Facebook and Twitter are not applicable to WhatsApp, and they also aren’t good with Indian languages,” she told the Thomson Reuters Foundation.
WhatsApp rolled out measures in 2018 to rein in messages forwarded by users, after rumors spread on the messaging service led to several killings in India. It also removed the quick-forward button next to media messages.
Tattle is among a rising number of initiatives across Asia tackling听辞苍濒颈苍别听misinformation,听丑补迟别听speech and abuse in local languages, using听迟别肠丑nologies such as artificial intelligence, as well as crowdsourcing, on-ground training and engaging with civil society groups to cater to the needs of communities.
While听迟别肠丑聽firms such as Facebook, Twitter and YouTube face growing scrutiny for听丑补迟别听speech and misinformation, they have not invested enough in developing countries, and lack moderators with language skills and knowledge of local events, experts say.
“Social media companies don’t listen to local communities. They also fail to consider context – cultural, social, historical, economic, political – when moderating users’ content,” said Pierre Fran莽ois Docquir, head of media freedom at Article 19, a human rights group.
“This can have a dramatic impact,听辞苍濒颈苍别听and offline. It can increase polarization and the risk of violence,” he added.
LOCAL INITIATIVES VITAL
While the impact of听丑补迟别听speech听辞苍濒颈苍别听has already been documented in several听础蝉颈补苍听countries in recent years, analysts say that听迟别肠丑聽firms have not ramped up resources to improve content moderation, particularly in local languages.
United Nations rights investigators said in 2018 that the use of Facebook had played a key role in spreading听丑补迟别听speech that fueled the violence against Rohingya Muslims in Myanmar in 2017, after a military crackdown on the minority community.
Facebook said at the time it was tackling misinformation and investing in Burmese-language speakers and听迟别肠丑nology.
In Indonesia, “significant听丑补迟别听speech”听辞苍濒颈苍别听targets religious and racial minority groups, as well as LGBTQ+ people, with bots and paid trolls spreading disinformation aimed at deepening divisions, a report from Article 19 found in June.
“Social media companies … must work with local initiatives to tackle the huge challenges in governing problematic content听辞苍濒颈苍别,” said Sherly Haristya, a researcher who helped write the report on content moderation in Indonesia with Article 19.
One such local initiative is by Indonesian non-profit Mafindo, which backed by Google, runs workshops to train citizens – from students to stay-at-home mothers – in fact-checking and spotting misinformation.
Mafindo, or Masyarakat Anti Fitnah Indonesia, the Indonesian Anti-Slander Society, provides training in reverse image search, video metadata and geolocation to help verify information.
The non-profit has a professional fact-checking team that, aided by citizen volunteers,听has debunked at least 8,550 hoaxes.
Mafindo has also built a fact-checking chatbot in the Bahasa language called Kalimasada – introduced just before the 2019 election. It is accessed via WhatsApp and has about 37,000 users – a sliver of the nation’s more than 80 million WhatsApp users.
“The elderly are particularly vulnerable to hoaxes, misinformation and fake news on the platforms, as they have limited听迟别肠丑nology skills and mobility,” said Santi Indra Astuti, Mafindo’s president.
“We teach them how to use social media, about personal data protection, and to look critically at trending topics: during COVID it was misinformation about vaccines, and in 2019, it was about the election and political candidates,” she said.
ABUSE DETECTION CHALLENGES
Across Asia, governments are tightening rules for social media platforms, banning certain types of messages, and requiring the swift removal of posts deemed objectionable.
Yet听丑补迟别听speech and abuse, particularly in local languages, often goes unchecked, said Prabhakar of Tattle, who has also built a tool called Uli – which is Tamil for chisel – for detecting听辞苍濒颈苍别听gender-based abuse in English, Tamil and Hindi.
Tattle’s team crowdsourced a list of offensive words and phrases that are used commonly听辞苍濒颈苍别, that the tool then blurs on users’ timelines. People can also add more words themselves.
“Abuse detection is very challenging,” said Prabhakar. Uli’s machine learning feature uses pattern recognition to detect and hide problematic posts from a user’s feed, she explained.
“The moderation happens at the user level, so it’s a bottom-up approach as opposed to the top-down approach of platforms,” she said, adding that they would also like Uli to be able to detect abusive memes, images and videos.
In Singapore, Empathly, a software tool developed by two university students, takes a more proactive approach, functioning like a spell check when it detects abusive words.
Aimed at businesses, it can detect abusive terms in English, Hokkien, Cantonese, Malay and Singlish – or Singaporean English.
“We’ve seen the harm that听丑补迟别听speech can cause. But Big听罢别肠丑听tends to focus on English and its users in English-speaking markets,” said Timothy Liau, founder and chief executive of Empathly.
“So there is room for local interventions – and as locals, we understand the culture and the context a bit better.” – Reuters


