These Tools Say They Can Spot AI Fakes. Do They Really Work?

The New York Times Gift Article: “Content generated by artificial intelligence has become so lifelike that it’s often impossible to tell whether a video or an image floating through social media is real or fake. Enter the A.I. detector. More than a dozen online tools claim they can tell the difference between what’s real and what’s A.I. by looking for hidden watermarks, composition errors and other digital clues. The reality is more mixed, according to a battery of tests conducted by The New York Times. While many tools did a good job detecting some A.I. content, they were not accurate enough to offer users complete confidence. The findings suggest that these detectors can help confirm suspicions about A.I.-generated media, but it is hard to rely on any of them to make definitive rulings. That presents fresh challenges for internet users and fact-checkers trying to manage the A.I. fakery that has flooded social media in recent months…Overall, we found that any conclusions drawn by the tools should be supported by other research, like details in official photographs or news reports. Many people nevertheless see the detection tools, which now analyze not just imagery but also video and audio, as powerful arbiters of truth at a crucial moment when A.I.-generated content is coursing through social media and deceiving users during breaking news moments. The tools are being adopted by banks and insurance companies trying to spot A.I.-powered fraud, by teachers looking for plagiarism, and by internet sleuths trying to verify images and videos circulating through social media. “You’re never going to have a detection tool that is able to 100 percent detect whether A.I. has been used in text, images, video, whatever form it is,” said Mike Perkins, a professor at British University Vietnam who studied A.I. detectors and found that text detectors were unreliable. As the A.I. generators improve, he said, A.I. detectors will struggle to catch up, creating an “arms race.”..

Posted in: AI, E-Records, Internet, Knowledge Management, Legal Research