Tackling AI-Enhanced Social Media Manipulation: Key Takeaways from the RAND Podcast

As AI technology advances, so do the tactics used by nation-states and bad actors to influence public opinion on social media. A recent episode of RAND Corporation’s podcast Policy Currents dives into this complex issue, discussing the growing threat of AI-enhanced social media manipulation and how societies can work to counter it. RAND, a nonpartisan research organization, develops solutions to public policy challenges to help make communities safer, more secure, and more resilient. Here, we summarize some of the critical points from the podcast, focusing on the state of AI-driven disinformation efforts from countries like Iran, Russia, and China—and the steps we can take to protect our digital information ecosystem.

1. The New Wave of AI-Driven Influence Campaigns

In recent months, OpenAI identified and dismantled a covert Iranian influence campaign using AI to spread disinformation, including false information related to the upcoming U.S. presidential election. Similarly, U.S. authorities recently shut down an extensive Russian bot network promoting propaganda. Meanwhile, China has been experimenting with AI to produce and amplify its own propaganda, including the use of AI-generated video hosts. These incidents illustrate that AI is now a powerful tool for state-sponsored disinformation campaigns, raising serious concerns for digital integrity worldwide.

2. Mitigating AI-Enhanced Manipulation: The Role of Platforms and Policy

Combating AI-enhanced manipulation will require a collaborative effort between technology platforms, media companies, and regulators. RAND researchers suggest several key actions:

• Social Media Platforms could enhance their efforts to detect and remove fake accounts and bots, potentially by investing more in AI tools designed to identify inauthentic behavior.

• Media Companies could employ digital watermarks or other authenticity markers for their videos and images, helping users distinguish legitimate content from AI-generated forgeries.

• Federal Regulators might consider requiring identity verification for social media accounts, similar to the practices used in banking. However, this approach involves balancing privacy concerns with the need for secure and authentic online interactions.

3. Skepticism as a Defense

Despite these potential measures, technological solutions take time to develop and implement. RAND’s Nathan Beauchamp-Mustafaga, a co-author of the report, argues that the best defense against AI-driven manipulation may be for social media users to develop a skeptical mindset. With AI-driven disinformation spreading rapidly, users need to question what they see and take responsibility for discerning truth from fabrication.

4. Ukraine’s Example: Lessons in Resilience

The ongoing conflict in Ukraine highlights how a country can proactively counter disinformation. Before the war, Ukraine effectively “pre-bunked” Russian misinformation, laying a strong foundation for its later success. Throughout the war, Ukraine has managed to limit the impact of Russian propaganda within its borders, though countering Russian disinformation inside Russia has proven more challenging.

On the international stage, Ukraine’s transparency and proactive efforts to combat Russian disinformation have helped secure support for its cause, although this support has waned over time in some regions, notably the United States. This trend underscores the importance of consistent and truthful communication to maintain public support, especially in times of crisis.

5. Building Resilience Against Disinformation at Home

RAND suggests that the U.S. could take several key actions to better prepare for the risks of disinformation in future conflicts. First, fostering public trust in the government and institutions can make societies more resilient to disinformation, which often preys on mistrust and societal division. Additionally, military personnel could benefit from media literacy training, which would help them recognize and respond to disinformation campaigns aimed at undermining morale and cohesion.

RAND also recommends that the U.S. government consider partnering with agile organizations to develop counter-disinformation content that resonates with a broad audience. By leveraging these partnerships, the government could create timely, engaging content to counter false narratives.

Conclusion: Adapting to a New Reality of AI-Driven Disinformation

AI-enhanced disinformation is reshaping the landscape of social media manipulation. As the Policy Currents episode highlights, addressing this challenge requires a combination of regulatory oversight, platform responsibility, and public vigilance. As we adapt to this new reality, fostering critical thinking and digital literacy among social media users may be the most immediate and effective defense against the spread of AI-generated falsehoods.

For a deeper dive into these insights, listen to the full episode of RAND’s Policy Currents here.