Will The Last Human Researcher Please Close the Door After Them?

--

The peer review process in science and technology is the bedrock of research. Without it, anyone could publish any old rubbish. We see this with paper mill journals, and they often say that they can publish papers within just a few weeks of submission. Overall, there is virtually no credibility in publishing in these journals, as the peer review process is often so weak. But there are problems. Firstly, there is no payment for the peer review process, and, secondly, a good review often takes a considerable amount of time. One must also worry that the peer reviewer is not the best person in the world to review a specific paper.

Now, a paper outlines that AI could be playing an increasing role in the peer review process [1]:

The authors used a GPTZero LLM detector to detect the presence of AI assisted reviews for the ICLR (International Conference on Learning Representations) 2024 conference. For this, they split their work into three main experiments: to determine the prevalence of AI-assisted reviews, analyse the effect of AI-assisted reviews, and determine the effect of AI-assisted reviews on the acceptance rate.

--

--

Prof Bill Buchanan OBE FRSE
ASecuritySite: When Bob Met Alice

Professor of Cryptography. Serial innovator. Believer in fairness, justice & freedom. Based in Edinburgh. Old World Breaker. New World Creator. Building trust.