Authors’ response to the Letter to the Editor: Re-evaluating the role of AI in scientific writing: a critical analysis on ChatGPT (original) (raw)
Related papers
International Journal Of Advance Research And Innovative Ideas In Education, 2023
AI tools are applications or software that specifically perform tasks that encompass a wide range of functions. Artificial intelligence plays a pivotal role in scholarly publication as it provides insights, helps in refining the article language, and grammar checking, and suggests improvement thus enhancing the efficiency, quality, and depth of the content of the research paper. The new educational paradigm has both benefits and drawbacks. The present study employs a cross-sectional online survey method. The study aims to analyze the role of AI tools among research scholars in the Vellore district. The study focuses on identifying the AI tools used by the researcher for effective writing. The study employs a self-designed questionnaire (Likert scale) with 40 items concerning variables like content creation, grammar and spelling, detection of plagiarism, paraphrasing and summarizing, citation generator, translation, assistance in outlining and structure, data visualization, editing and proofreading, sentiment analysis, collaborative writing, and its ethical considerations. The questionnaire was circulated to research scholars in Vellore District through Google Forms. The consent was obtained from the scholars on the initial page of the forms. The data collected were analyzed using Statistical Package for Social Sciences. The tests like descriptive statistics, frequency, reliability, validity, normality, ANOVA, and regression were performed to analyze the data. The proposed research questions of the study aim to find the different AI tools used in content generation and the effectiveness of these tools when employed in research paper writing. The respondents also use Grammarly Go for grammar checking, tone, and clarity. In the preliminary survey, most of them accepted that AI tools help scholars ease the writing process. After Zotero, they found it easier to change the referencing style to the journal requirement. Most of the researchers accepted that they would use AI tools in writing, and many have also confirmed that they do not completely rely on AI tools as they use them based on requirements like paraphrasing, grammar checking, and citation. Hence, they conclude that AI tools are an advantage for scholars in research writing.
The use of ChatGPT in scientific publishing
Geriatrics Gerontology and Aging
The use of Generative Pretrained Transformer (ChatGPT), an artificial intelligence tool, for writing scientific articles has been reason for discussion by the academic community ever since its launch in late 2022. This artificial intelligence technology is becoming capable of generating fluent language, and distinguishing between text produced by ChatGPT and that written by people is becoming increasingly difficult. Here, we will present some topics to be discussed: (1) ensuring human verification; (2) establishing accountability rules; (3) avoiding the automatization of scientific production; (4) favoring truly open-source large language models (LLMs); (5) embracing the benefits of artificial intelligence; and (6) broadening the debate. With the emergence of these technologies, it is crucial to regulate, with continuous updates, the development and responsible use of LLMs with integrity, transparency, and honesty in research, along with scientists from various areas of knowledge, t...
Biology of Sport
Natural language processing (NLP) has been studied in computing for decades. Recent technological advancements have led to the development of sophisticated artificial intelligence (AI) models, such as Chat Generative Pre-trained Transformer (ChatGPT). These models can perform a range of language tasks and generate human-like responses, which offers exciting prospects for academic efficiency. This manuscript aims at (i) exploring the potential benefits and threats of ChatGPT and other NLP technologies in academic writing and research publications; (ii) highlights the ethical considerations involved in using these tools, and (iii) consider the impact they may have on the authenticity and credibility of academic work. This study involved a literature review of relevant scholarly articles published in peer-reviewed journals indexed in Scopus as quartile 1. The search used keywords such as "ChatGPT," "AI-generated text," "academic writing," and "natural language processing." The analysis was carried out using a quasi-qualitative approach, which involved reading and critically evaluating the sources and identifying relevant data to support the research questions. The study found that ChatGPT and other NLP technologies have the potential to enhance academic writing and research efficiency. However, their use also raises concerns about the impact on the authenticity and credibility of academic work. The study highlights the need for comprehensive discussions on the potential use, threats, and limitations of these tools, emphasizing the importance of ethical and academic principles, with human intelligence and critical thinking at the forefront of the research process. This study highlights the need for comprehensive debates and ethical considerations involved in their use. The study also recommends that academics exercise caution when using these tools and ensure transparency in their use, emphasizing the importance of human intelligence and critical thinking in academic work.
Chapter2: ChatGPT in Academic Writing and Publishing: A Comprehensive Guide
ChatGPT and AI Conversational Models in Higher Education, Research and Development , 2023
Scientific writing is a difficult task that requires clarity, precision, and rigour. It also involves a large amount of research, analysis, and synthesis of information from various sources. However, scientific writing is also hard, time-consuming, and susceptible to errors. Advanced artificial intelligence (AI) models, such as ChatGPT, can simplify academic writing and publishing. ChatGPT is based on the two most advanced large language models (LLMs), GPT-3.5 and GPT-4, which can produce natural language texts in many fields of knowledge. ChatGPT has been fine-tuned with both supervised and reinforced learning technologies to improve its quality and performance. ChatGPT has many applications and uses in academic and scientific writing and publishing such as hypothesis generation, literature review, safety recommendations, troubleshooting, tips, paraphrasing and summarising, editing, and proofreading, journal selection, journal style formatting, and other applications. In this book chapter, we will discuss the main advantages, examples, and applications of ChatGPT in academic and scientific writing from research conception to publishing
EXPLORING THE POTENTIAL AND LIMITATIONS OF CHATGPT IN ACADEMIC WRITING AND EDITORIAL TASKS
Fırat Üniversitesi Sosyal Bilimler Dergisi, 2024
This study aims to investigate the potential of ChatGPT, a large language model created by OpenAI, in assisting with academic writing tasks. By focusing on various aspects of academic writing, including drafting articles, proofreading, generating research topics, suggesting article titles, summarizing content, organizing academic references, and conducting peer reviews, the study evaluates ChatGPT's proficiency in these areas. While ChatGPT demonstrates structural proficiency and efficiency in editorial tasks, the accuracy of the generated content and the reliability of the sources used are subject to debate. The study concludes that ChatGPT cannot replace human creativity and intelligence in academic work. However, it can be a useful tool for generating ideas and identifying data. Despite its limitations, ChatGPT provides unique benefits, particularly in editorial tasks related to academic writing. Further research and specific studies are needed to determine the boundaries and potential of ChatGPT. This study contributes to the understanding of the potential of language models in academic writing and is expected to benefit academics and practitioners in the field of artificial intelligence and social sciences.
Journal of Nature and Science of Medicine, 2023
This article examines the advantages and disadvantages of Large Language Models (LLMs) and Artificial Intelligence (AI) in research and education and proposes the urgent need for an international statement to guide their responsible use. LLMs and AI demonstrate remarkable natural language processing, data analysis, and decision-making capabilities, offering potential benefits such as improved efficiency and transformative solutions. However, concerns regarding ethical considerations, bias, fake publications, and malicious use also arise. The objectives of this paper are to critically evaluate the utility of LLMs and AI in research and education, call for discussions between stakeholders, and discuss the need for an international statement. We identify advantages such as data processing, task automation, and personalized experiences, alongside disadvantages like bias reinforcement, interpretability challenges, inaccurate reporting, and plagiarism. Stakeholders from academia, industry, government, and civil society must engage in open discussions to address the ethical, legal, and societal implications. The proposed international statement should emphasize transparency, accountability, ongoing research, and risk mitigation. Monitoring, evaluation, user education, and awareness are essential components. By fostering discussions and establishing guidelines, we can ensure the responsible and ethical development and use of LLMs and AI, maximizing benefits while minimizing risks.
arXiv (Cornell University), 2023
The use of artificial intelligence (AI) in research across all disciplines is becoming ubiquitous. However, this ubiquity is largely driven by hyperspecific AI models developed during scientific studies for accomplishing a well-defined, data-dense task. These AI models introduce apparent, human-recognizable biases because they are trained with finite, specific data sets and parameters. However, the efficacy of using large language models (LLMs)-and LLM-powered generative AI tools, such as ChatGPT-to assist the research process is currently indeterminate. These generative AI tools, trained on general and imperceptibly large datasets along with human feedback, present challenges in identifying and addressing biases. Furthermore, these models are susceptible to goal misgeneralization, hallucinations, and adversarial attacks such as red teaming prompts-which can be unintentionally performed by human researchers, resulting in harmful outputs. These outputs are reinforced in research-where an increasing number of individuals have begun to use generative AI to compose manuscripts. Efforts into AI interpretability lag behind development, and the implicit variations that occur when prompting and providing context to a chatbot introduce uncertainty and irreproducibility. We thereby find that incorporating generative AI in the process of writing research manuscripts introduces a new type of context-induced algorithmic bias and has unintended side effects that are largely detrimental to academia, knowledge production, and communicating research.
ChatGPT and Future of Medical Research Writing
Zenodo (CERN European Organization for Nuclear Research), 2023
Artificial intelligence (AI) is a disruptive technology that has revolutionized various industries, including the field of research writing. Using AI-based tools in research writing brings a new level of efficiency, accuracy, and productivity to the process, allowing researchers to tap into alternative perspectives and generate fresh insights that can boost the quality of research work. In this article, we discuss the current trends and the potential benefits of open Artificial Intelligence (AI-) based tools for research writing, focusing on AI tools. In addition, we also discuss the impact of collaborative writing with AI on productivity, highlighting the benefits of AI tools in the research writing process. The current trends show that AI tools enable researchers to perform complex data analysis, generate personalized content, and identify patterns that can aid decision-making. Therefore, it is imperative for researchers to embrace AI tools, learn how to use them effectively and harness their potential to achieve better research outcomes.
An Evaluation of Scholarly Publisher Policies on the Use of AI and Generative-AI Tools in Research
Innovations in Webometrics, Informetrics, and Scientometrics: AI-Driven Approaches and Insights: Proceedings of the COLLNET 2024 18th International Conference on Webometrics, Informetrics, and Scientometrics (WIS) and the 23rd COLLNET Meeting 2024, Bookwell ISBN 978-93-86578-65-5, 2024
Generative Artificial Intelligence (AI) and AI-assistive tools have become more prevalent in research writings, manuscript preparation, and publishing in current scholarly communication systems. The introduction of AI technology is poised to bring disruptive changes to academic publishing. Since the research community is widely using AI, it is important to understand the individual publishers' policies for researchers (known as authors) on the use of AI and generative AI tools and their limitations in the publishing industry. Keeping this in view, the authors of this study considered evaluating the policies of the leading top ten publishers as per Jisc Sherpa Romeo. The publishers covered are Taylor & Francis, Elsevier, Springer, Wiley, SAGE, Oxford University Press, De Gruyter, MDPI, Cambridge University Press, and Emerald. The study investigates the publishers;general policies on using AI and generative AI tools in manuscript preparation, studies the specific guidelines for AI terms, identifies the type of disclosures that allow authors to use AI and generative AI tools, discovers the recommended guidelines and provides comprehensive guidance to authors on the effective use of AI tools in preparing their manuscripts. It helps authors ensure ethical considerations while preparing manuscripts or research reports using AI and Generative AI tools. The findings show that the publishers have clearly mentioned that the AI generated content (in any form) are prohibited and not credited as author. However, they can be used for the initial idea generation and writing process, including the structure of the paper, grammar, spelling error corrections, and overall language improvement by clearly disclosing them in the manuscript with specific sections. The study also aimed to recommend the overall policy guidelines on how authors can effectively utilize AI technologies while adhering to ethical standards and policies set by publishers. It also helps to navigate the evolving landscape of AI and generative AI tools in research writing, manuscript preparation, and publishing.
El Profesional de la información, 2023
The irruption of artificial intelligence (AI) in all areas of our lives is a reality to which the university, as an institution of higher education, must respond prudently, but also with no hesitation. This paper discusses the potential that resources based on AI presents as potential reviewers of scientific articles in a hypothetical peer review of already published articles. Using different models (GPT-3.5 and GPT-4) and platforms (ChatPDF and Bing), we obtained three full reviews, both qualitative and quantitative, for each of the five articles examined, thus being able to delineate and contrast the results of all of them in terms of the human reviews that these same articles received at the time. The evidence found highlights the extent to which we can and should rely on generative language models to support our decisions as qualified experts in our field. Furthermore, the results also corroborate the hallucinations inherent in these models while pointing out one of their curren...