Netizens were confused with AI-Generated Scam Ads, Fake Exit Polls

A wave of AI deepfakes related to elections in Europe and Asia has been spreading through social media for months, serving as a warning for the more than 50 countries heading to the polls this year.

These deepfakes have the potential to mislead voters and disrupt the democratic process, highlighting the need for heightened awareness and robust fact-checking mechanisms to combat the spread of misinformation during election periods.

AI tools are being used to generate and edit campaign videos, enhancing the visual appeal and reach of political messages. Political parties are using AI to produce personalised audio messages in a variety of Indian languages, allowing them to connect with voters in their native tongues.

The use of AI technology is transforming the way political campaigns are conducted, enabling more targeted and efficient communication with the electorate.AI-generated automated calls are being made to voters using a candidate's voice, making the outreach more personal and impactful.

Chief Election Commissioner (CEC) Rajiv Kumar stated that the apex polling body effectively managed deepfakes and AI-generated synthetic content during the general elections. He highlighted this achievement, saying, “During elections this time, we have even been able to kind of manage and control the menace of deepfakes and AI-generated synthetic content. This is one of the greatest stories which we want to tell you.”

This indicates significant progress in combating the spread of misinformation and ensuring the integrity of the electoral process amid increasing challenges posed by advanced AI technologies.

In May, during the General election in India. BOOM has published 128 fact-checks in English, Hindi, and Bangla, noting the highest occurrence of AI-generated fake news this year. The fact-checks included various forms of misinformation, such as:

• News channels predicting exit poll wins for political parties.
• Celebrities promoting diabetes pills.
• Deepfakes, AI-generated images, and voice clones.

Out of the 128 fact-checks, the Lok Sabha elections 2024, held between April 19 and June 1, were the leading topic, resulting in 101 fact-checks. Additionally, the Muslim community was the primary target of mis/disinformation, with 10 fact-checks addressing false claims and misinformation directed towards them.

This surge in AI-generated fake news highlights the growing challenge of combating misinformation during critical events like elections, where the potential for influence and disruption is significant.

The scam advertisements leveraging artificial intelligence (AI) to appear more realistic and targeted were a major concern . These AI-generated ads pose a serious threat as they can be difficult to distinguish from legitimate ones.

Secondly, Fake exit polls during elections or other important events were another tactic used to spread misinformation . This can sow doubt and confusion around the true results, potentially undermining trust in democratic processes.

These developments highlight the need for improved detection methods and public awareness campaigns to counter the spread of AI-generated scams and fake news.

All it shows, the use of AI for malicious purposes is a growing concern. It's crucial to stay vigilant and develop effective strategies to identify and combat misinformation in all its forms.