How peer review became so easy to exploit by AI

Long seen as the safeguard of academic publishing, peer review is the process where experts vet and challenge research before it’s published in journals. Now AI tools are speeding it up, helping reviewers work faster and allowing authors to write and revise more efficiently. This sounds great in theory, but some researchers are already finding ways to use AI to push papers through with less scrutiny.

Prompt engineer Jim the AI Whisperer reveals how researchers are embedding hidden commands in their papers — white text, tiny fonts, even metadata — to hijack AI-assisted peer review. The instructions target large language models (LLMs), the AI tools reviewers now rely on to summarize papers and draft evaluations. Designed to process all text in a document, LLMs can be tricked into following secret prompts like ignore flaws, exaggerate strengths, and recommend acceptance. A recent investigation found these hidden instructions in 17 papers from authors at 14 universities, including Columbia, Peking University, and Waseda. Other studies show that LLMs reward polish over substance and tend to inflate paper scores, making them easy to manipulate. Jim compares the tactic to early SEO hacks, where invisible keywords tricked search engines — except here, it’s the scientific record at stake.

Innovation professor Enrique Dans examines how peer review became so easy to exploit. Reviewers, once bogged down in dense manuscripts and tight deadlines, now rely on AI tools to lighten the load. That efficiency has made the process faster and less painful, but also more fragile. Authors use the same technology to write, revise, and even plant hidden instructions for AI systems. And reviewers use the same AI to interpret that work, creating a strange loop where humans just supervise from the sidelines, hoping the system hasn’t been compromised (or actively trying to compromise it). Unless peer review develops stronger safeguards and clearer norms for AI use, he warns, it risks becoming a hollow ritual where rigor gives way to automation.

Source: Anna Dorn

https://medium.com/blog/how-peer-review-became-so-easy-to-exploit-by-ai-d5818545bd93