AI Disinfo Hub

The development of artificial intelligence (AI) technologies has long been a challenge for the disinformation field, enabling the manipulation of content and accelerating its spread. Recent technical developments have exponentially increased these challenges. While AI offers opportunities for legitimate purposes, it is also widely generated and disseminated across the internet, causing – intentionally or not – harm and deception.

This hub intends to assist you to better understand how AI is impacting the disinformation field.  To be up-to-date on the latest developments, we will collect the latest Neural News and Trends and include upcoming events and job opportunities that you cannot miss.
 

Are you more into podcast and video content? You will find a repository of podcasts and webinars in AI Disinfo Multimedia, while AI Disinfo in Depth will feature research reports from academia and civil society organisations. This section will cover the burning questions related to the regulation of AI technologies and their use. In addition to this, the Community working in the intersections of AI and disinformation will have a dedicated space where initiatives and resources will be listed, as well as useful tools.

In short, this hub is your go-to resource for understanding the impact of AI on disinformation and finding ways to combat it.

Here, researchers, policymakers, and the public can access reliable tools and insights to navigate this complex landscape. Together, we’re building a community to tackle these challenges head-on, promoting awareness and digital literacy.

Join us in the fight against AI-driven disinformation. Follow us and share with the community!

NEURAL NEWS & TRENDS

We've curated a selection of articles from external sources that delve into the topic from different perspectives. Keep exploring the latest news and publications on AI and disinformation!

News
News

NewsGuard: Social media influencers are using Uncensored AI, an independent platform that provides a chatbot completely stripped of standard safety guardrails, to validate inaccurate conspiracy theories, as disclosed by NewsGuard.
By taking foundational AI code that is freely available to the public and removing the built-in safety filters, the creators of this platform have built an automated factory for internet rumours. Influencers present screenshot of these conversations to millions of followers as objective, computer-verified proof of rigged elections, staged attacks, and historical fabrications. The article shows how removing safety filters allows a machine to rewrite blatant disinformation into a polished, authoritative format.

White House: A fierce debate has emerged in the United States over who controls and profits from artificial intelligence, as some recent events show.

On 2 June 2026, President Donald J. Trump signed an Executive Order to cut AI regulation and strengthen U.S. tech leadership. It rejects mandatory licensing for advanced AI models and instead creates a voluntary system allowing federal agencies to review certain frontier models 30 days before release for national security risks.Democratic Senator Bernie Sanders has proposed a very different approach. Through the American AI Sovereign Wealth Fund Act, and according to Futurism, he wants major AI firms such as OpenAI, Anthropic, and xAI to pay a one-time 50 per cent stock tax into a public fund, arguing that AI wealth is partly built on humanity’s collective intellectual property.

Meanwhile, Wired reported that the FBI and DHS are monitoring peaceful protests against data centres and AI job displacement under a new “anti-technology extremism” classification.

AP News: AI developers continue to face lawsuits in court over safety and copyright issues. Florida became the first state to file a lawsuit against OpenAI and its CEO, Sam Altman, on 1 June 2026, as reported The Associated Press. The state accuses the company of hiding the psychological and physical risks of ChatGPT, prioritizing profit over safety, and violating state trade laws, and even alleges that ChatGPT has facilitated violent crimes and self-harm. Meanwhile, Perplexity AI is facing a growing number of lawsuits: CNN has become the ninth major publisher to sue the search startup for copyright and trademark infringement, according to Tech Times.

Newsweek: China-linked networks are using AI-generated deepfake pornography in a coordinated campaign to silence and discredit female human rights activists (living in Western nations, including the United Kingdom, Germany, and Canada) who criticise the Beijing government. When activists publish investigative reports or speak at public events, the networks instantly scale up the attacks by distributing the fabricated imagery across social media and directly to local community members. Tech giants and intelligence experts have directly traced these harassment operations to individuals associated with Chinese law enforcement.

Reuters: The global media industry is facing an immediate, AI-driven restructuring that will fundamentally change value and access to information, as discussed at the Nordic AI in Media Summit. AI is shifting the news economy away from traditional websites towards a model mediated by automated agents, that will browse the web on behalf of users, extracting, repackaging, and customising information into individualised summaries.

To survive this structural transition, publishers are being forced to stop designing content solely for human web traffic and start thinking in “machine audiences”. This technical shift threatens to create a sharp division between expensive, trust-based luxury journalism and automated, infrastructure-driven commodity content.

Italy’s Data Protection Authority (Garante): The Italian Data Protection Authority has issued an official warning to a domestic startup over an artificial intelligence tool designed to monitor employee stress levels via workplace messaging apps. The software operates as a plug-in for platforms like Slack and Microsoft Teams, using semantic analysis to evaluate employee chat messages and flag psychological stress.

Under existing privacy regulations, the Italian Workers’ Statute, and the European Union AI Act, using artificial intelligence to infer or analyse human emotions within a professional environment is strictly prohibited. The regulatory body warned that deploying language models for emotional monitoring can easily generate opaque, unverifiable results that lead to unlawful workplace discrimination.

YouTube: YouTube and LinkedIn have launched measures to contain the wave of artificial intelligence content flooding their networks. YouTube has overhauled its disclosure rules by introducing prominent, highly visible AI labels placed directly below long-form video players and as overlays on Shorts, and deployed automated detection signals to force-label photorealistic content if a creator fails to declare AI use manually. Concurrently, as reported by Entrepreneur, LinkedIn is now limiting the visibility of AI slop. By training machine learning classifiers on human-edited datasets, the platform is tracking generic posts, bot comments, and attention-bait videos, in order to limit its reach.

Indicator: An investigation by Indicator reveals that X’s crowdsourced moderation project, Community Notes, has effectively been automated. Following a policy shift allowing automated entries, a mere eight anonymous AI bots wrote 50.3 per cent of all visible, helpful Community Notes during the first three weeks of May 2026, raising serious concerns over algorithmic bias in platform fact-checking.

The Lancet: A comprehensive data audit of 2.5 million biomedical papers run by The Lancer has revealed that completely fabricated citations are infiltrating peer-reviewed scientific literature at an accelerating pace. The systematic study found that the rate of citation fabrication increased more than 12-fold over a three-year period. Researchers link this sudden inflection point to the uncritical adoption of LLM systems, which generate highly plausible but entirely non-existent bibliographic references that bypass traditional peer review. The infiltration of fraudulent source material compromises the integrity of systematic medical reviews, threatening to pollute the evidence chain used by global policy makers to establish formal clinical treatment guidelines.

Vatican News: On 25 May 2026, Pope Leo XIV issued his first encyclical, Magnifica humanitas: On Safeguarding the Human Person in the Time of Artificial Intelligence.

Reported by Vatican News, the document warns that AI is never neutral and inherits the biases of its creators, forcing humanity to choose between a new “Tower of Babel” or a shared common good. He strongly condemns the concentration of tech power in a few corporate hands and demands that AI be “disarmed” from military use, declaring that “there is no algorithm that can make war morally acceptable.”

The Pope labels mass data profiling as a new form of digital colonialism, names the treatment of migrants as a key litmus test for social justice, and demands that AI protect human workers rather than cause mass unemployment. Finally, the Pontiff calls for an internal “examination of conscience” within the Church to transparently root out institutional and power-based abuses.

Digital Watch Observatory: European artificial intelligence policy has entered a new phase of operational enforcement across the continent. The European Commission’s AI Office has convened key working groups to finalize the Code of Practice on Marking and Labelling of AI-Generated Content, as reported by the Digital Watch Observatory. Serving as the practical compliance layer for the EU AI Act, this code sets binding technical benchmarks for machine-readable provenance metadata, watermarking, and user-facing labels to ensure deepfakes and synthetic media remain entirely detectable.

Also in Europe, Spain’s cabinet has approved a strict draft Organic Bill for the Proper Use and Governance of AI, according to Diario Sur, that bans systems posing an “unacceptable risk,” such as non-consensual sexual deepfakes, subliminal chatbot manipulation of gamblers, biometric sorting by race or religion, and automated social scoring. The legislation introduces direct human supervision mandates and an aggressive penalty regime topping out at fines of €35 million or 7 per cent of global annual turnover.

IPIE: A large-scale scientific meta-analysis by the International Panel on the Information Environment has revealed that text-based artificial intelligence misinformation currently poses a greater persuasive risk than visual misinformation. The findings show that false content can be easily tailored to specific audiences and mimic authentic communication, making it difficult for people to judge what is true. Researchers found that the most effective response to combat this threat is providing users with preventive, corrective information so they can evaluate accuracy and credibility themselves. Conversely, content labelling by tech firms yields highly variable results and requires careful design and testing.

A collaborative privacy investigation by cybersecurity researchers at IMDEA Networks has uncovered major structural data leaks across four prominent generative AI assistants: Perplexity, Anthropic’s Claude, xAI’s Grok, and OpenAI’s ChatGPT.

The report, titled LeakyLM and published in May 2026, reveals that these prominent platforms embed third-party advertising and analytics trackers, which systematically capture user conversation data, prompt topics, and sensitive user metadata. The researchers noted that these trackers frequently fire regardless of user cookie consent choices, warning that Big Tech is quietly replicating the traditional web’s extractive, surveillance-based advertising model within the rapidly expanding AI ecosystem.

Researchers at Imperial College London Dolezal, J., Alam, S., Graham, M., & Bohacek, M.: A comprehensive web-scale analysis by researchers at Imperial College London, the Internet Archive, and Stanford University has revealed unexpected results shedding light on the impact of AI-content on the Internet. Contrary to widespread public fears regarding automated “truth decay,” the study found no statistically significant evidence linking the rise of machine-authored content to an increase in factual errors or hallucinations. However, the data alerts on a different effect: AI is making online content more homogeneous, less diverse, and more emotionally accommodating.

The AI Resist List was launched in May 2026 by bestselling tech author Karen Hao alongside a global coalition of researchers and civil rights advocates, including the Distributed AI Research Institute (DAIR) and We and AI. Operating as a live, publicly accessible directory, the project documents and maps grass-roots resistance to the rapid, unregulated expansion of major artificial intelligence companies. Inspired by historic anti-authoritarian tracking initiatives, the platform catalogues active global legal battles, artistic protests, and community campaigns such as local movements fighting the massive environmental and water footprints of physical data centres. Rather than monitoring corporate boardrooms, it intentionally highlights pushback from the Global Majority world to challenge the assumption that Big Tech’s “scale at all costs” trajectory is completely inevitable. Additionally, the database maps a repository of “Possible Futures” to feature community-led, open-source technology alternatives built entirely on human public utility and consent.

Events, jobs & announcements

The United Nations will host the inaugural Global Dialogue on AI Governance on 6–7 July 2026 at Palexpo in Geneva, Switzerland. Established by the UN General Assembly, this major multistakeholder event brings together governments, UN entities, academia, civil society, media, and private sector representatives to shape international cooperation on AI guardrails, safety, and digital inclusion.

📍 Location: Palexpo, Geneva, Switzerland

📅 Event dates: 6–7 July 2026

⏰ Registration deadline: Thursday, 25 June 2026

🔒 Requirement: Formal organizational affiliation is required (no independent/individual participation).

The Pulitzer Center is accepting applications for its fifth cohort of the AI Accountability Fellowships. Recruiting 8 to 10 journalists globally, the 10-month program supports in-depth, high-impact reporting on how corporations, governments, and powerful actors fund, build, and deploy algorithmic and automated systems. For the first time, this cohort includes dedicated funding and training to develop local audience impact plans. Journalists from the Global South and underrepresented communities are strongly encouraged to apply.

📍 Location: Remote / Global

⏳ Duration: 10 months (Starting September 2026)

💰 Financial support: Up to $25,000 ($20,000 for reporting expenses/stipends, $5,000 for community engagement)

⏰ Application deadline: July 12, 2026

Full Fact is recruiting its next Head of AI. This senior management role sits at the critical intersection of AI development, journalism, and public policy. The successful candidate will lead an in-house tech team, scale AI workflows to fight disinformation (including a major new initiative to benchmark LLM outputs), build global media partnerships, and engage with the UK government and tech platforms on AI governance. Full Fact is strictly non-partisan, and applicants must commit to absolute political impartiality.

📍 Location: Hybrid / Remote-first in the UK (with travel to the Central London office at least once a month)

⏳ Employment type: Permanent, Full-time (35 hours/week)

💰 Salary: £75,000 – £84,317 per annum

⏰ Application deadline: 10:00 AM, Monday 22 June 2026

Schmidt Sciences is recruiting AI Institute Fellows-in-Residence for a 12–18 month programme for recent PhD graduates in AI and computer science.

📍Location: New York City (on-site) | ⏳ Fixed-term | 💼 $150,000/year
🗓️ Applications: Rolling (apply early) | 🗓️ Cohort starting in 2026

Fellows split their time between independent AI research and supporting the development of the AI & Advanced Computing Institute, including grantmaking exploration and programme design. Priority areas include multi-agent systems and AI agent interoperability, AI for scientific discovery, trustworthy AI and alignment, AI’s impact on the labour market, and hardware-enabled verification of AI agreements.

Alice is hiring across a range of roles focused on shielding “communicative tech” from emerging risks, online harms, and AI-driven threats. The company unites intelligence analysts, security researchers, and infrastructure engineers to build trust and safety frameworks for generative AI models, applications, and digital platforms.

📍 Locations: Israel (Ramat Gan), UK, and Remote

🧭 Active teams: Intelligence, Security, Infrastructure, Customer Success, and HR

🗓️ Applications: Rolling

Key Focus Areas: Open roles span trust & safety infrastructure, fraud threat analysis, Application and Android security research, AI software engineering, and web intelligence (Webint).

The Centre for Responsible AI (CeRAI) at IIT Madras is recruiting for a range of research, technical, and programme-oriented roles focused on advancing ethical and responsible AI. Opportunities span areas such as AI research, engineering, governance and policy, and programme management within an interdisciplinary research environment.

🗓️ Applications: Vary by role (no single deadline indicated)

AI & Disinfo Multimedia

A collection of webinars and podcasts from us and the wider community, dedicated to countering AI-generated disinformation.

Webinars

Our own and community webinar collection exploring the intersections of AI and disinformation

Podcasts

Community podcasts exploring the intersections of AI and disinformation

AI Disinfo in depth

A repository of research papers and reports from academia and civil society organisations alongside articles addressing key questions related with the regulation of AI technologies and their use. It also features a collection of miscellaneous readings.

Research

A compact yet potent library dedicated to what has been explored in the realm of AI and disinformation

policy & regulations

A look at regulation and policies implemented on AI and disinformation

Miscellaneous readings

Recommended reading on AI and disinformation

Community

A list of tools to fight AI-driven disinformation, along with projects and initiatives facing the challenges posed by AI. The ultimate aim is to foster cooperation and resilience within the counter-disinformation community.

Tools

A repository of tools to tackle AI-manipulated and/or AI-generated disinformation.

Synthetic image detection 

Video deepfake detection

AI-generated video detection

Deepfake detector

AI-generated image detection

AI-generated text detection

AI-generated text detection

AI-generated text detection

AI-generated text detection

AI-generated text detection

AI Voice Detector

AI-generated audio, video, text detector

Conspiracy debunking bot

Analysis, Data Science, and OSINT

AI Research Pilot by Henk van Ess is a lightweight, browser-based tool designed to help investigators, journalists, and researchers get more out of AI, not by using AI as a source, but as a guide to real sources.

LLM Journalism Tool Advisor is an interactive guide designed to cut through the noise, by walking you through a simple, step-by-step decision tree to pinpoint the best tool and the best strategy for your immediate task.

Digital Digging offers a handbook with seven strategies on how to identify AI-generated.

A new AI-powered tool that identifies where a photo was taken by analysing visual clues in the image. Launched by Where Is This Photo, it uses machine-learning models to predict locations — useful for quick geolocation checks or curiosity-driven searches.

Faktabaari has launched an interactive game that trains users to spot whether images are real or AI-generated, a quick, playful way to build digital and visual literacy.

The Agence France‑Presse (AFP) Digital Course, supported by the Google News Initiative, offers a 75-minute module on how AI is reshaping the information ecosystem, common types of AI-generated misinformation, and best practices for verification.

Image Whisperer is an experimental online image authenticity checker, created by Henk van Ess, designed to help journalists, researchers and fact-checkers evaluate whether a still image is likely authentic, manipulated, or AI-generated

The Global Investigative Journalism Network (GIJN) has launched a practical verification guide for journalists to assess whether text, image, audio or video is likely AI-generated.

Rather than a single software product, it teaches reporters a structured workflow combining quick checks, deeper analysis, and multiple verification techniques under real-world time pressure. 

AI Community Notes Tracker is a live monitoring tool developed by Indicator, that tracks the share of AI-generated or AI-assisted Community Notes on X. It helps researchers and practitioners see how AI is being used in X’s crowdsourced fact-checking/contextual annotation system and understand shifts in platform moderation practices.

NewsGuard has launched a real-time detection datastream identifying over 3,000 “AI content farms”, websites generating large volumes of undisclosed AI-written content to spread misinformation or capture ad revenue. Combining automated detection (Pangram Labs) with human verification, the tool helps platforms, advertisers, and researchers identify low-quality AI-generated sites and mitigate their impact on the information ecosystem.

Initiatives & organisations

Organisations working in the field and initiatives launched by community members to address the challenges posed by AI in the disinformation field.

veraAI is a research and development project focusing on disinformation analysis and AI supported verification tools and services.

AI against disinformation is a cluster of six European Commission co-funded research projects, which include research on AI methods for countering online disinformation. The focus of ongoing research is on detection of AI-generated content and development of AI-powered tools and technologies that support verification professionals and citizens with content analysis and verification.

AI Forensics is a European non-profit that investigates influential and opaque algorithms. They hold major technology platforms accountable by conducting independent and high-profile technical investigations to uncover and expose the harms caused by their algorithms. They empower the research community with tools, datasets and methodologies to strengthen the AI audit ecosystem.

AI Tracking Center is intended to highlight the ways that generative AI has been deployed to turbocharge misinformation operations and unreliable news. The Center includes a selection of NewsGuard’s reports, insights, and debunks related to artificial intelligence

AlgorithmWatch is a non-governmental, non-profit organisation based in Berlin and Zurich. They fight for a world where algorithms and Artificial Intelligence (AI) do not weaken justice, human rights, democracy and sustainability, but strengthen them.

The European AI & Society Fund empowers a diverse ecosystem of civil society organisations to shape policies around AI in the public interest and galvanises the philanthropic sector to sustain this vital work.

The European AI Media Observatory is a knowledge platform that monitors and curates relevant research on AI in media, provides expert perspectives on the potentials and challenges that AI poses for the media sector and allows stakeholders to easily get in touch with relevant experts in the field via their directory.

GZERO’s newsletter offers exclusive insights into our rapidly changing world, covering topics such as AI-driven disinformation and a weekly exclusive edition written by Ian Bremmer.

PR Hall of Shame is a watchdog-style list, developed by Press Gazette, exposing brands and PR networks linked to AI-generated “fake experts” quoted in the press, helping journalists spot credibility risks and reduce synthetic ‘expert’ manipulation.

AI for Good is the United Nations’ leading platform on Artificial Intelligence for sustainable development. Its mission is to leverage the transformative potential of artificial intelligence (AI) to drive progress toward achieving the UN Sustainable Development Goals.

Omdena is a collaborative AI platform where a global community of changemakers unites to co-create real-world tech solutions for social impact. It combines collective intelligence with hands-on collaboration, empowering the community from across all industries to learn, build, and deploy meaningful AI projects. 

Faked Up curates a library of academic studies and reports on digital deception and misinformation, offering accessible insights for subscribers. The collection includes studies from 2020 onward, organised into clusters like misinformation prevalence, fact-checking effects, and AI-generated deceptive content. It serves as a practical resource for understanding and addressing misinformation challenges.

AI Incident Database is dedicated to indexing the collective history of harms or near harms realized in the real world by the deployment of artificial intelligence systems. Like similar databases in aviation and computer security, the AI Incident Database aims to learn from experience to prevent or mitigate bad outcomes.

The TGuard project develops innovative methods for detecting disinformation in social media and formulating effective strategies for preventing AI-generated false reports.

The AI-on-Demand (AIoD) Platform is a European hub for trustworthy AI, offering open access to models, datasets, tools, and educational resources. Backed by the EU, it supports researchers, innovators, and public institutions in developing and sharing responsible AI technologies aligned with European values.

BBC Verify Live is a real-time news feed that gives audiences a behind-the-scenes look at how BBC journalists verify information. Using tools like open-source intelligence, satellite imagery, and data analysis, the BBC Verify team investigates disinformation, checks facts, and authenticates content as news breaks. Available on the BBC News homepage and app, this initiative aims to boost transparency and trust in journalism, especially in the face of rising threats from disinformation and AI-generated content.

Deepfake Glossary by Reality Defender: The Deepfake Glossary is a practical guide to the terms shaping today’s synthetic threat landscape. Review it to stay ahead of the evolving terminology.

The Universitat Politècnica de València (UPV), together with INECO, has created the AI and Diversity Observatory, a pioneering project that seeks to identify biases in artificial intelligence from an inclusive perspective. Collaborating with vulnerable groups and human rights organizations, the Observatory analyzes concerns and proposals to promote equitable and non-discriminatory AI. In addition, it will monitor trends and issues related to AI in society.

Prebunking at Scale is a new European initiative led by Full Fact, Maldita.es, and EFCSN that uses AI to detect emerging misinformation narratives early and help fact-checkers pre-emptively counter false claims before they go viral, especially on short-form video platforms.

The Pulitzer Center’s AI Spotlight is a new open curriculum offering free training materials to help journalists better understand, investigate, and report on artificial intelligence and its societal impacts.

The Data Tank is new initiative designed to help small and medium public-interest media organisations respond to the challenges posed by generative AI. The project brings together media outlets, researchers, regulators, and civil society to explore collective solutions such as data collaboratives, knowledge commons, innovative licensing models, and advocacy coalitions, aiming to strengthen media sustainability, bargaining power, and content integrity in the face of extractive AI practices.

PR Hall of Shame by Press Gazette, is a watchdog-style list exposing brands and PR networks linked to AI-generated “fake experts” quoted in the press, helping journalists spot credibility risks and reduce synthetic ‘expert’ manipulation.

The AI Resist List is a crowdsourced, public-interest initiative that maps and tracks global resistance to automated systems and algorithmic harms. The platform serves as a living archive documenting civil society protests, labor strikes, legal challenges, and grassroots campaigns aimed at halting or regulating harmful AI deployments worldwide. It is designed to connect researchers, journalists, and activists looking to study the socio-technical impacts of AI and the communities actively organizing against them.

CleanFeed is a collaborative research and tech initiative (March 2026 – March 2029) designed to counter AI-generated “slop” and coordinated disinformation through structural media provenance. Led by Deutsche Welle (DW Innovation) and funded by the German Federal Ministry (BMFTR), the project moves past reactive fact-checking by embedding content authenticity frameworks (like C2PA) and open protocols directly into journalistic distribution feeds.

Last updated: 04/06/2026

The articles and resources listed in this hub do not necessarily represent EU DisinfoLab’s position. This hub is an effort to give voice to all members of the community countering AI-generated disinformation.