Rather than relying on text alone, the algorithm looks for clues in a paper’s reasoning.

Science is no longer a purely human endeavor. Machine minds are increasingly merging with human creativity to generate hypotheses, experiments, and ideas.

But with promise comes misuse. Like TikTok videos and AI-generated images splattered across the internet, AI slop has infiltrated science. Academic journals and conferences are being flooded with AI-generated content, and editors are drawing the line. As long as they disclose it, scientists can use chatbots to help write papers, as long as the underlying ideas are their own. Submitting a whole paper dreamed up by AI, with little human input, is another matter.

Publishers are turning to AI detectors to weed out slop. But detectors aren’t perfect. Most scrutinize turns of phrase, word choice, and other intricacies associated with machine-generated text. They can mislabel legitimate research because of how the paper is written, rather than on the merit or origin of its ideas. That’s especially problematic for scientists whose first language isn’t English and who rely on AI for heavy editing.

A team at the University of Maryland in College Park is now taking a different approach: Strip away the prose until only a skeleton of concepts remains. Their detector, called IdeaLens, learned to find patterns in how human and AI models organize ideas, build narratives, and construct arguments, all of which are integral to every scientific paper.

IdeaLens alone won’t stem the deluge of AI slop polluting scientific literature. But it joins a growing toolset that recognizes human contributions, even as the boundary between scientist- and AI-generated ideas grows blurry.

Source link