If a group of people is presented with a body of text, will they be able to spot the human-written passages over the AI-generated ones? The answer is, well — maybe. AI detection work is at the center of a University of Pennsylvania study in its School of Engineering and Applied Science. Chris Callison-Burch, an associate professor in the Department of Computer and Information Science, along with Liam Dugan and Daphne Ippolito, two Ph.D. students in the program, tested this question over the course of about a year. The team drafted a test that asked users to identify which writing was done by a computer. They used language modeling AI tools GPT-2 and GPT-3, and tested two groups of people — some who were given tools and incentives to look for AI writing, and others who were not. A recently published paper “ Real or Fake Text?: Investigating Human Ability to Detect Boundaries Between Human-Written and Machine-Generated Text ” summarizes their findings. Take the test Dugan told Technically AI models have progressed immensely, even since just a few years ago in 2020. “The models were good, but they weren't like scary good,” he said. “They could detect news articles, but they were easy to check. It's progressed so quickly from there, from even just one year ago.” The research mainly happened in 2021 and 2022, using GPT-2 and GPT-3. The team submitted their paper a few months before ChatGPT rolled out in November 2022 . Though what ChatGPT can […]
Click here to view original web page at How can humans detect AI writing? These Penn researchers have some tips
© 2023, wcadmin. ©2023. All rights reserved, Writers Critique, LLC Unless otherwise noted, all posts remain copyright of their respective authors.