Purging Citation Contamination

No one knows. However, fabricated citations in peer-reviewed biomedical research have increased more than twelvefold in the last two years, according to a peer-reviewed audit published in The Lancet. By early 2026, roughly one in 277 papers indexed in a major medical database contained at least one reference to a study that does not exist. One in 458 a year earlier. One in 2,828 three years ago (Topaz et al., 2026). This is not a fringe problem confined to obscure journals. In separate retracted papers, researchers have found reference lists where more than half the citations were entirely fabricated. If you have not been checking citations? Time to start yesterday.

...can I just look at my references and tell which ones are made up?

Fabricated references rarely announce themselves — and a literature review is where most of them enter. They typically carry a believable title, a real-sounding — frequently genuinely real — author name, a correctly structured format, and a plausible publication year and journal — yes, with a DOI as well. Formatting alone gives no warning sign.

And this is not particular to citations.

We keep a log of what these tools have done to real text in our own work — dated, with the model named and the passage before and after.

The Ghost in the Machine is our whole current list of AI models' common failures with text. Disconcerting, ugly and unhappy reading, alas.

Two of the nine common failure cases we identify produce exactly what you are reading about here. A model deletes a real source and reports the deletion as a correction. A model reproduces its own earlier work from memory, so a citation that was right comes back wrong.

In both cases the output reads perfectly well. It always does. That is the whole problem.

Skimming your reference list for anything "off" will not catch this. Only checking each source against the actual paper will.

...ok so how do I actually check if my sources are real?

Don't trust any single signal — a link that opens, a citation that looks well-formatted. The only real verification is opening the actual source at the actual publisher or database and confirming three things by eye.

1. The title matches exactly.

2. The named authors are real and match.

3. The specific claim you're citing is genuinely stated on the page you think it is.

If any one of those three doesn't check out, the source doesn't go in your paper — no exceptions, no benefit of the doubt. Never let a source into your reference list until you've personally done this. If you inherited a reference list from AI-assisted note-taking sessions weeks or months ago, re-verify it now — don't assume past-you (or anyone else) already checked.

And a source can be real and still be worthless.

A 2025 PNAS study found paper mill output growing exponentially, with some publishers reporting up to one in seven submissions as probable paper-mill provenance. The study also identified editors at legitimate journals who repeatedly accepted work that was later retracted.

So a reference can survive every check on this page — real DOI, real journal, real authors, indexed — and still point at fabricated research.

What protects you is not the check. It is reading the source. A paper you have actually read cannot surprise you later.

Richardson et al., PNAS 2025.

Why a clean bibliography is not a safe one: Unlucky Seven.

This isn't a hypothetical risk you're being warned about early — enforcement is already here. Major research platforms have begun banning authors outright for submitting papers with AI-hallucinated references, and top academic venues are moving toward rejecting submissions for undisclosed AI use in citations. If you are already being asked about it, start here. If your committee or school reviewer catches even one fabricated source in your dissertation, it can trigger the exact kind of institutional scrutiny that stalls approval for months — the same structural crisis partnering with us can help you avoid. If it is too late for that? It is even more important to call us and get help. Can't wait for business hours? Too stressed? Our Panic page exists to help you talk to someone knowledgeable — not an answering service — 24/7.