AI Disinfo Hub

The development of artificial intelligence (AI) technologies has long been a challenge for the disinformation field, enabling the manipulation of content and accelerating its spread. Recent technical developments have exponentially increased these challenges. While AI offers opportunities for legitimate purposes, it is also widely generated and disseminated across the internet, causing – intentionally or not – harm and deception.

This hub intends to assist you to better understand how AI is impacting the disinformation field.  To be up-to-date on the latest developments, we will collect the latest Neural News and Trends and include upcoming events and job opportunities that you cannot miss.
 

Are you more into podcast and video content? You will find a repository of podcasts and webinars in AI Disinfo Multimedia, while AI Disinfo in Depth will feature research reports from academia and civil society organisations. This section will cover the burning questions related to the regulation of AI technologies and their use. In addition to this, the Community working in the intersections of AI and disinformation will have a dedicated space where initiatives and resources will be listed, as well as useful tools.

In short, this hub is your go-to resource for understanding the impact of AI on disinformation and finding ways to combat it.

Here, researchers, policymakers, and the public can access reliable tools and insights to navigate this complex landscape. Together, we’re building a community to tackle these challenges head-on, promoting awareness and digital literacy.

Join us in the fight against AI-driven disinformation. Follow us and share with the community!

NEURAL NEWS & TRENDS

We've curated a selection of articles from external sources that delve into the topic from different perspectives. Keep exploring the latest news and publications on AI and disinformation!

News
News

The Financial Times: Europe’s Mistral generative AI model is among the least able to filter out Russian disinformation, according to an analysis by Estonian researchers seeking ways to counter growing propaganda. Mistral’s most advanced system ranked 47th out of 60 models scrutinised, scoring under 40% in effectiveness against malicious propaganda, whilst commercial models like Anthropic’s Claude, Grok, and some Chinese systems performed better. This aligns with an April 2026 NewsGuard audit of Mistral’s consumer chatbot, Le Chat, which revealed that the tool repeated state-sponsored falsehoods regarding the Iran war 50% of the time in English and over 56% of the time in French. The findings have direct implications for European governments and organisations currently looking to Mistral for “sovereign” alternatives to US Big Tech.

Poole-Dayan, E., Roy, D., & Kabbara, J.: LLMs do not provide the same level of quality to all users, according to this study, revealing that the quality of AI responses systematically degrades based on specific users’ demographics. Testing GPT-4, Claude 3 Opus, and Llama 3-8B across truthfulness and factuality datasets, researchers found that models perform significantly worse for users with lower English proficiency, less formal education, and non-US origins. When these traits intersect, the negative effects compound, causing models to generate more misconceptions or withhold information. Furthermore, models display representation and allocation harms; for example, Claude 3 Opus refused tasks 11% of the time for less-educated, non-native personas and adopted patronising, condescending, or mocking language in nearly 44% of those refusals. Ultimately, the authors warn that as personalised AI features roll out at scale, these embedded sociocognitive biases risk systemically spreading misinformation to the most vulnerable user groups.

The Decoder: A regional court in Munich has ruled that Google is directly liable for false claims generated by its “AI Overviews”, rejecting the company’s defence that users should fact-check results themselves. The court classified these AI summaries as Google’s own content, rather than standard search results, after a case where the system wrongly linked two publishers to scams that did not appear in any of the linked sources. This landmark ruling sets a major precedent that strips tech giants of traditional liability protections, potentially affecting other global AI providers like OpenAI and Anthropic when their systems hallucinate. According to Reuters, Google has announced it will appeal against the judgment, arguing that the ruling focuses on narrow errors rather than the fundamental way the tool displays web content.

Mississippi Today: A federal judge in Mississippi has disqualified four attorneys representing both sides of a civil lawsuit after discovering they irresponsibly used generative artificial intelligence to write their legal filings. The legal teams relied on AI tools, which resulted in “hallucinations” that fabricated entirely fake legal quotes and case citations. Additionally, the out-of-state lawyers were ordered to pay financial fines, with one mandated to complete a legal education course specifically focusing on artificial intelligence.

Indicator: Commercial AI text detectors like Pangram remain highly vulnerable to simple adversarial bypasses, showing exactly how these models fail across various writing fields. Researcher Alexios Mantzarlis ran an audit revealing that Pangram systematically misclassifies synthetic content as human-written if the AI text repeats or rhymes. By exploiting this flaw, the author successfully fooled the detector 86% of the time. Ultimately, because these tools are being used deterministically to judge everything from fiction and tweets to innumerable academic articles, the piece warns that treating them as absolute judges has damaging consequences for research and reputation, insisting they should only ever serve as one element of a broader investigation.

OpenAI: OpenAI has disclosed the disruption of two Chinese influence operations targeting AI policy debates in the United States. Both campaigns relied on ChatGPT accounts creating content to exploit domestic economic anxieties. The first, dubbed “Data Center Bandwagon,” attempted to stoke public anger by falsely linking AI data center expansion to rising electricity bills for ordinary households. The second, “Tech and Tariffs,” framed U.S. trade policy and tariffs as tools of technological dominance, while directing criticism at Donald Trump and conspicuously shielding Xi Jinping from any negative framing. The same campaign also spread fabricated claims about ChatGPT data breaches.

Foxwell Digital: New York has become one of the first U.S. states to regulate AI in advertising. Effective June 9, 2026, a new state law requires advertisers to clearly disclose when an advertisement features a “synthetic performer” (an AI-generated human likeness). The requirement covers any image or video ad served to New York audiences across all major channels, including Meta, Google, YouTube, TikTok, and TV, among others. Brands and their agencies bear full legal responsibility for compliance; ad networks and platforms do not. Failure to display a disclosure carries civil penalties of $1,000 for a first violation and $5,000 for each subsequent offense. Exemptions apply to AI-generated product shots, backgrounds, audio-only ads, and non-identifiable body parts such as hands.

CNBC: The Trump administration and OpenAI CEO Sam Altman are in ongoing discussions regarding the US government taking an unprecedented financial stake in the $850 billion AI giant ahead of its anticipated initial public offering. The proposal, originally pitched by Altman in 2025, involves donating corporate equity to seed an American “Public Wealth Fund” to let everyday citizens profit directly from AI growth. According to Axios, President Trump embraced the idea, calling a public partnership “a beautiful thing” that could improve AI’s broadly unpopular image whilst helping the US maintain its technological lead over China.

NewsGuard: Google’s consumer-facing text-to-video tool, Gemini Omni, is highly susceptible to misuse by malicious actors, according to a NewsGuard audit. The study found that the model successfully generated convincing video “evidence” for 7 of 10 disinformation prompts, including fabricated footage of an Iranian missile attack and a staged blockade of Israeli ships. When confronted with these findings, Google defended the technology by noting that generative AI is built to follow user instructions, while adding that the company maintains clear usage policies and is “continually getting better” at identifying and addressing such vulnerabilities.

Indicator: A research study from Cornell and Georgetown universities revealed that 70% of popular “face swapping” apps on Apple’s App Store and Google’s Play Store can easily be used to create non-consensual deepfake nudes. While these tools market themselves as innocent, playful photo editors to bypass initial content moderation, many developers intentionally advertise them on adult websites. Cumulatively downloaded nearly 60 million times, these apps have netted hundreds of thousands of dollars, meaning tech giants like Apple and Google have inadvertently profited from them via app fees. Following the report, both companies removed dozens of the violative apps, though researchers are calling for stricter, proactive filters to stop the widespread abuse.

Saeri, A. K., Graham, J., Noetel, M., Slattery, P., Thompson, N., Lewandowsky, S: A Delphi study surveying 272 experts on AI risk (asking which threats are most severe, who is most vulnerable, and who bears responsibility) warns of a deepening “responsibility gap”: the general public is most exposed to AI-related harms, yet the power to prevent them rests almost entirely with developers and regulators. Of 24 risks assessed, experts ranked five as most severe: dangerous capabilities, competitive dynamics, weapons and cyberattacks, power centralization, and false information. The information, finance, and national security sectors were flagged as most at risk, reflecting how deeply AI is already embedded in their operations.

CBC News: A new artificial intelligence law in San Luis Potosí, Mexico, is being weaponised to suppress political dissent and silence the opposition. On May 22, authorities arrested Eréndira Reyes and Alejandra Hermosillo, who run the critical Facebook page San Wicho Times, alongside a third individual, Christian Herrera, for posting AI-manipulated images and political satire critical of Governor Ricardo Gallardo Cordona. Human rights and press freedom groups warn that the law, which carries prison sentences of 3 to 6 years, uses overly broad text that allows prosecutors to bypass journalistic and satirical exemptions by citing vague infractions like “provoking social alarm.” Local journalists state that the governor is actively using this AI legislation to silence critical opposition voices ahead of next year’s state gubernatorial elections, where his wife, Senator Ruth González Silva, plans to run.

404 Media: According to a report by 404 Media, hackers have successfully compromised a series of high-profile Instagram accounts (including the Barack Obama White House account, Sephora, and the Chief Master Sergeant of the Space Force) by exploiting a critical flaw in Meta’s new AI support chatbot. The vulnerability allowed attackers to hijack any account simply by instructing the chatbot to reassign the email address linked to a target username, with no human verification required. Attackers documented the process on Telegram through videos and screenshots. TechCrunch subsequently reported that the exploit persisted even after Meta claimed to have resolved the issue, with hackers broadening their targets beyond celebrities to harvest everyday users’ handles for resale on the grey market.

404 Media: LLM “poisoning” is no longer just a state-level tactic, corporations are trying to exploit it too. Moderators of the biohacking subreddit revealed that businesses selling hormones and peptides are secretly flooding Reddit with promotional content. Their goal is to seed discussions with specific narratives so that AI scrapers absorb the text, effectively hijacking the data pool that chatbots rely on to answer user queries. To protect the community from being weaponized for this type of Answer Engine Optimization (AEO), the subreddit is officially banning new submissions regarding hormone replacement therapies and peptides.

Hasan, M. A., Naswan, R., Samir, F., Sultana, S., & Ahmed, S. I.: AI models are trained predominantly on English-language content, and that imbalance is starting to show. A new study tested nine leading LLMs using a Bengali cultural dataset and found that prompting models in English, rather than Bangla, consistently caused them to replace local figures and institutions with globally recognizable equivalents and flatten regional perspectives. Researchers called this pattern “Global Narrative Dominance,” and found that it persisted even when models were explicitly given local supporting material, suggesting that English prompts act as a powerful default frame that overrides local facts rather than simply filling gaps in the model’s knowledge.

Events, jobs & announcements

Organised by the DSA Research Network and the DSA Observatory (IViR, University of Amsterdam), this online panel examines generative AI as a critical test case for the Digital Services Act’s risk-management regime.

📍 Location: Online (Zoom)

📅 Date: Thursday, 25 June 2026 (14:00–15:15 CEST) 

Register here.

The United Nations will host the inaugural Global Dialogue on AI Governance on 6–7 July 2026 at Palexpo in Geneva, Switzerland. Established by the UN General Assembly, this major multistakeholder event brings together governments, UN entities, academia, civil society, media, and private sector representatives to shape international cooperation on AI guardrails, safety, and digital inclusion.

📍 Location: Palexpo, Geneva, Switzerland

📅 Event Dates: 6–7 July 2026

Register here.

Hosted by the Association of Corporate Investigators (ACi), this free webinar explores how generative AI is shifting modern investigative workflows from mere keyword searches to full evidence synthesis and case strategy formulation. Sponsored by Relativity, the session will draw on practical experience and tools like “aiR legal AI” to demonstrate how legal and investigative teams can responsibly adopt AI to uncover facts while maintaining control and defensibility.


📍 Location: Online
📅 Event dates: Wednesday, 22 July 2026 (3:00 pm – 4:00 pm)

Register here.

The Pulitzer Center is accepting applications for its fifth cohort of the AI Accountability Fellowships. Recruiting 8 to 10 journalists globally, the 10-month program supports in-depth, high-impact reporting on how corporations, governments, and powerful actors fund, build, and deploy algorithmic and automated systems. For the first time, this cohort includes dedicated funding and training to develop local audience impact plans. Journalists from the Global South and underrepresented communities are strongly encouraged to apply.

📍 Location: Remote / Global

⏳ Duration: 10 months (Starting September 2026)

💰 Financial support: Up to $25,000 ($20,000 for reporting expenses/stipends, $5,000 for community engagement)

⏰ Application deadline: July 12, 2026

Full Fact is recruiting its next Head of AI. This senior management role sits at the critical intersection of AI development, journalism, and public policy. The successful candidate will lead an in-house tech team, scale AI workflows to fight disinformation (including a major new initiative to benchmark LLM outputs), build global media partnerships, and engage with the UK government and tech platforms on AI governance. Full Fact is strictly non-partisan, and applicants must commit to absolute political impartiality.

📍 Location: Hybrid / Remote-first in the UK (with travel to the Central London office at least once a month)

⏳ Employment type: Permanent, Full-time (35 hours/week)

💰 Salary: £75,000 – £84,317 per annum

⏰ Application deadline: 10:00 AM, Monday 22 June 2026

Schmidt Sciences is recruiting AI Institute Fellows-in-Residence for a 12–18 month programme for recent PhD graduates in AI and computer science.

📍Location: New York City (on-site) | ⏳ Fixed-term | 💼 $150,000/year
🗓️ Applications: Rolling (apply early) | 🗓️ Cohort starting in 2026

Fellows split their time between independent AI research and supporting the development of the AI & Advanced Computing Institute, including grantmaking exploration and programme design. Priority areas include multi-agent systems and AI agent interoperability, AI for scientific discovery, trustworthy AI and alignment, AI’s impact on the labour market, and hardware-enabled verification of AI agreements.

Alice is hiring across a range of roles focused on shielding “communicative tech” from emerging risks, online harms, and AI-driven threats. The company unites intelligence analysts, security researchers, and infrastructure engineers to build trust and safety frameworks for generative AI models, applications, and digital platforms.

📍 Locations: Israel (Ramat Gan), UK, and Remote

🧭 Active teams: Intelligence, Security, Infrastructure, Customer Success, and HR

🗓️ Applications: Rolling

Key Focus Areas: Open roles span trust & safety infrastructure, fraud threat analysis, Application and Android security research, AI software engineering, and web intelligence (Webint).

The Centre for Responsible AI (CeRAI) at IIT Madras is recruiting for a range of research, technical, and programme-oriented roles focused on advancing ethical and responsible AI. Opportunities span areas such as AI research, engineering, governance and policy, and programme management within an interdisciplinary research environment.

🗓️ Applications: Vary by role (no single deadline indicated)

AI & Disinfo Multimedia

A collection of webinars and podcasts from us and the wider community, dedicated to countering AI-generated disinformation.

Webinars

Our own and community webinar collection exploring the intersections of AI and disinformation

Podcasts

Community podcasts exploring the intersections of AI and disinformation

AI Disinfo in depth

A repository of research papers and reports from academia and civil society organisations alongside articles addressing key questions related with the regulation of AI technologies and their use. It also features a collection of miscellaneous readings.

Research

A compact yet potent library dedicated to what has been explored in the realm of AI and disinformation

policy & regulations

A look at regulation and policies implemented on AI and disinformation

Miscellaneous readings

Recommended reading on AI and disinformation

Community

A list of tools to fight AI-driven disinformation, along with projects and initiatives facing the challenges posed by AI. The ultimate aim is to foster cooperation and resilience within the counter-disinformation community.

Tools

A repository of tools to tackle AI-manipulated and/or AI-generated disinformation.

Synthetic image detection 

Video deepfake detection

AI-generated video detection

Deepfake detector

AI-generated image detection

AI-generated text detection

AI-generated text detection

AI-generated text detection

AI-generated text detection

AI-generated text detection

AI Voice Detector

AI-generated audio, video, text detector

Conspiracy debunking bot

Analysis, Data Science, and OSINT

AI Research Pilot by Henk van Ess is a lightweight, browser-based tool designed to help investigators, journalists, and researchers get more out of AI, not by using AI as a source, but as a guide to real sources.

LLM Journalism Tool Advisor is an interactive guide designed to cut through the noise, by walking you through a simple, step-by-step decision tree to pinpoint the best tool and the best strategy for your immediate task.

Digital Digging offers a handbook with seven strategies on how to identify AI-generated.

A new AI-powered tool that identifies where a photo was taken by analysing visual clues in the image. Launched by Where Is This Photo, it uses machine-learning models to predict locations — useful for quick geolocation checks or curiosity-driven searches.

Faktabaari has launched an interactive game that trains users to spot whether images are real or AI-generated, a quick, playful way to build digital and visual literacy.

The Agence France‑Presse (AFP) Digital Course, supported by the Google News Initiative, offers a 75-minute module on how AI is reshaping the information ecosystem, common types of AI-generated misinformation, and best practices for verification.

Image Whisperer is an experimental online image authenticity checker, created by Henk van Ess, designed to help journalists, researchers and fact-checkers evaluate whether a still image is likely authentic, manipulated, or AI-generated

The Global Investigative Journalism Network (GIJN) has launched a practical verification guide for journalists to assess whether text, image, audio or video is likely AI-generated.

Rather than a single software product, it teaches reporters a structured workflow combining quick checks, deeper analysis, and multiple verification techniques under real-world time pressure. 

AI Community Notes Tracker is a live monitoring tool developed by Indicator, that tracks the share of AI-generated or AI-assisted Community Notes on X. It helps researchers and practitioners see how AI is being used in X’s crowdsourced fact-checking/contextual annotation system and understand shifts in platform moderation practices.

Deezer has launched the AI Music Detector, a web tool that scans your playlists across 20 different streaming platforms, including Spotify and Apple Music, to identify and flag synthetic, AI-generated tracks.

 

NewsGuard has launched a real-time detection datastream identifying over 3,000 “AI content farms”, websites generating large volumes of undisclosed AI-written content to spread misinformation or capture ad revenue. Combining automated detection (Pangram Labs) with human verification, the tool helps platforms, advertisers, and researchers identify low-quality AI-generated sites and mitigate their impact on the information ecosystem.

Initiatives & organisations

Organisations working in the field and initiatives launched by community members to address the challenges posed by AI in the disinformation field.

veraAI is a research and development project focusing on disinformation analysis and AI supported verification tools and services.

AI against disinformation is a cluster of six European Commission co-funded research projects, which include research on AI methods for countering online disinformation. The focus of ongoing research is on detection of AI-generated content and development of AI-powered tools and technologies that support verification professionals and citizens with content analysis and verification.

AI Forensics is a European non-profit that investigates influential and opaque algorithms. They hold major technology platforms accountable by conducting independent and high-profile technical investigations to uncover and expose the harms caused by their algorithms. They empower the research community with tools, datasets and methodologies to strengthen the AI audit ecosystem.

AI Tracking Center is intended to highlight the ways that generative AI has been deployed to turbocharge misinformation operations and unreliable news. The Center includes a selection of NewsGuard’s reports, insights, and debunks related to artificial intelligence

AlgorithmWatch is a non-governmental, non-profit organisation based in Berlin and Zurich. They fight for a world where algorithms and Artificial Intelligence (AI) do not weaken justice, human rights, democracy and sustainability, but strengthen them.

The European AI & Society Fund empowers a diverse ecosystem of civil society organisations to shape policies around AI in the public interest and galvanises the philanthropic sector to sustain this vital work.

The European AI Media Observatory is a knowledge platform that monitors and curates relevant research on AI in media, provides expert perspectives on the potentials and challenges that AI poses for the media sector and allows stakeholders to easily get in touch with relevant experts in the field via their directory.

GZERO’s newsletter offers exclusive insights into our rapidly changing world, covering topics such as AI-driven disinformation and a weekly exclusive edition written by Ian Bremmer.

PR Hall of Shame is a watchdog-style list, developed by Press Gazette, exposing brands and PR networks linked to AI-generated “fake experts” quoted in the press, helping journalists spot credibility risks and reduce synthetic ‘expert’ manipulation.

AI for Good is the United Nations’ leading platform on Artificial Intelligence for sustainable development. Its mission is to leverage the transformative potential of artificial intelligence (AI) to drive progress toward achieving the UN Sustainable Development Goals.

Omdena is a collaborative AI platform where a global community of changemakers unites to co-create real-world tech solutions for social impact. It combines collective intelligence with hands-on collaboration, empowering the community from across all industries to learn, build, and deploy meaningful AI projects. 

Faked Up curates a library of academic studies and reports on digital deception and misinformation, offering accessible insights for subscribers. The collection includes studies from 2020 onward, organised into clusters like misinformation prevalence, fact-checking effects, and AI-generated deceptive content. It serves as a practical resource for understanding and addressing misinformation challenges.

AI Incident Database is dedicated to indexing the collective history of harms or near harms realized in the real world by the deployment of artificial intelligence systems. Like similar databases in aviation and computer security, the AI Incident Database aims to learn from experience to prevent or mitigate bad outcomes.

The TGuard project develops innovative methods for detecting disinformation in social media and formulating effective strategies for preventing AI-generated false reports.

The AI-on-Demand (AIoD) Platform is a European hub for trustworthy AI, offering open access to models, datasets, tools, and educational resources. Backed by the EU, it supports researchers, innovators, and public institutions in developing and sharing responsible AI technologies aligned with European values.

BBC Verify Live is a real-time news feed that gives audiences a behind-the-scenes look at how BBC journalists verify information. Using tools like open-source intelligence, satellite imagery, and data analysis, the BBC Verify team investigates disinformation, checks facts, and authenticates content as news breaks. Available on the BBC News homepage and app, this initiative aims to boost transparency and trust in journalism, especially in the face of rising threats from disinformation and AI-generated content.

Deepfake Glossary by Reality Defender: The Deepfake Glossary is a practical guide to the terms shaping today’s synthetic threat landscape. Review it to stay ahead of the evolving terminology.

The Universitat Politècnica de València (UPV), together with INECO, has created the AI and Diversity Observatory, a pioneering project that seeks to identify biases in artificial intelligence from an inclusive perspective. Collaborating with vulnerable groups and human rights organizations, the Observatory analyzes concerns and proposals to promote equitable and non-discriminatory AI. In addition, it will monitor trends and issues related to AI in society.

Prebunking at Scale is a new European initiative led by Full Fact, Maldita.es, and EFCSN that uses AI to detect emerging misinformation narratives early and help fact-checkers pre-emptively counter false claims before they go viral, especially on short-form video platforms.

The Pulitzer Center’s AI Spotlight is a new open curriculum offering free training materials to help journalists better understand, investigate, and report on artificial intelligence and its societal impacts.

The Data Tank is new initiative designed to help small and medium public-interest media organisations respond to the challenges posed by generative AI. The project brings together media outlets, researchers, regulators, and civil society to explore collective solutions such as data collaboratives, knowledge commons, innovative licensing models, and advocacy coalitions, aiming to strengthen media sustainability, bargaining power, and content integrity in the face of extractive AI practices.

PR Hall of Shame by Press Gazette, is a watchdog-style list exposing brands and PR networks linked to AI-generated “fake experts” quoted in the press, helping journalists spot credibility risks and reduce synthetic ‘expert’ manipulation.

The AI Resist List is a crowdsourced, public-interest initiative that maps and tracks global resistance to automated systems and algorithmic harms. The platform serves as a living archive documenting civil society protests, labor strikes, legal challenges, and grassroots campaigns aimed at halting or regulating harmful AI deployments worldwide. It is designed to connect researchers, journalists, and activists looking to study the socio-technical impacts of AI and the communities actively organizing against them.

CleanFeed is a collaborative research and tech initiative (March 2026 – March 2029) designed to counter AI-generated “slop” and coordinated disinformation through structural media provenance. Led by Deutsche Welle (DW Innovation) and funded by the German Federal Ministry (BMFTR), the project moves past reactive fact-checking by embedding content authenticity frameworks (like C2PA) and open protocols directly into journalistic distribution feeds.

Last updated: 19/06/2026

The articles and resources listed in this hub do not necessarily represent EU DisinfoLab’s position. This hub is an effort to give voice to all members of the community countering AI-generated disinformation.