ChatGPT Guide Report
ChatGPT Guide Report
Enago is a trusted name in author services for the global Objective of the Guide 01
research community with offices in Tokyo, Seoul, Beijing, ChatGPT's Capabilities and Limitations 02
Shanghai, Istanbul, and New York. A preferred partner for
leading publishers, societies, and universities since 2005, we High-Risk and Safe Applications of ChatGPT and
have worked with researchers in over 125 countries. Other Generative AI Models 05
The ChatGPT Guide was published in October 2023 and is Potential Negative Consequences for an
based on GPT-3.5, the latest free version available at the Organization/Institution 07
time. It contains independent views and opinions of the 08
Reported Risks of Using ChatGPT
authors. We recommend readers to follow latest relevant
guidelines to comply with ethical use of generative AI or GPT. Guiding Principles for Framing Policies
for AI Use in Academia 09
Authors: Uttkarsha Bhosale, Gayatri Phadke, and Anupama Kapadia
Recommendations to Ensure Ethical and
Reach us at: [email protected] | www.enago.com
Responsible AI Use in Research 10
Concluding Remarks 12
1. This publication is available in Open Access under the Creative AI Solutions With Enago 13
Commons — Attribution-NonCommercial-ShareAlike 4.0 International
— (CC-BY-NC-SA 4.0) license. Appendices 14
2. The users accept to be bound by Enago Academy’s terms of use, Learn with Expert Resources 20
including but not limited to re-use of this publication and inclusion of
third-party links and information.
Artificial Intelligence (AI) has been in the global spotlight with the increased accessibility of ChatGPT
and other generative AI tools. While the academic community remains apprehensive about
generative AI usage in research, its usage continues to impact the academic research and writing
processes.
Consequently, it becomes essential for universities, professional organizations, and publishers to
establish clear and detailed policies to embrace AI responsibly.
Enago has curated this comprehensive guide with the following objectives:
This guide aims to equip decision-makers with a balanced and informed approach to integrating
generative AI technologies responsibly in education and research settings.
Let’s quickly understand some of ChatGPT’s capabilities and limitations at the time this
guide was written:
Capabilities of ChatGPT
Expanded Language
Support
ChatGPT lacks the ability to assess The training data also contains biased
sources or verify facts, and its opaque information (such as underrepresentation
responses make it hard to understand its of women in research).2 Thus, societal and
reasoning or identify citations. cultural stereotypes may affect ChatGPT's
responses.
1. Sabzalieva E, Valentini A. ChatGPT and artificial intelligence in higher education: quick start guide (2023) [Internet]. UNESCO International Institute for Higher Education in Latin America and
the Caribbean [cited 2023 April 28]. Available from: https://unesdoc.unesco.org/ark:/48223/pf0000385146.locale=en
2. Open AI. How should AI systems behave, and who should decide? (February 16, 2023) [Internet]. Open AI. [cited 2023 August 28].
Available from: https://openai.com/blog/how-should-ai-systems-behave
ChatGPT recycles information as it creates responses based on ChatGPT sometimes generates responses that seem plausible but are
statistical probabilities of which word may appear next. So, it may factually wrong or unrelated to the context. These hallucinations are
produce the text with different words without changing the often a result of training data biases, a lack of real-world
essence of the response. This may limit innovation, comprehension, and the AI model's technical limitations.3 When
advancements, creativity, and originality. addressing unfamiliar topics, it tends to provide inaccurate responses.
No. of Citations
20%
In March 2023, a group of researchers assessed if ChatGPT could
15%
reliably generate accurate references for literature searches.4 Out of 12
the 35 citations provided by ChatGPT, only 2 were accurate references. 10%
5% 02
0%
Fake Slightly Erroneous Real
3. Gungor A. ChatGPT: What are hallucinations and why are they A problem for AI systems [Internet]. Bernard Marr. 2023 [cited 2023 May 23].
Available from: https://bernardmarr.com/chatgpt-what-are-hallucinations-and-why-are-they-a-problem-for-ai-systems/
4. McGowan A, Yunlai G, Dobbs M, Shuster S, Cotter M, Selloni A, Goodman M, Srivastava A, Cecchi GA, Corcoran CM. Psychiatry Research. 2023;326:115334.
Available from: https://doi.org/10.1016/j.psychres.2023.115334
We provide below a summary of use cases provided to help researchers and educators in making informed decisions about the application of
ChatGPT and other generative AI models:
Conducting Research
Hypothesis Initial research idea discovery or Full hypothesis generation, as ideas may be
Generation inspiration for new avenues incomplete, plagiarized or outdated
Research Refining research design for enhanced clarity End-to-end experimental design due to potentially
Design and coherence impractical or biased recommendations
Literature Review Automation of vast information search and Unauthorized use of copyright data or falsification
& Meta-analysis statistical data analysis of data sources to support study results
Summarization Extraction of key points for quick review Oversimplification and non-contextual
summarization of complex research findings
Note: Since there are already established low-risk applications of generative AI such as writing emails, essays, application letters, and so on, they are not added in here.
Manuscript Generation of titles and keywords, and Generation of results and discussion prompting
Writing structuring the research outline misleading conclusions
Language Aids with specific vocabulary and Translations may lack precision due to language
Translation expressions complexity and cultural references
Plagiarism Checker Assists with rewording of sentences or Unintentional plagiarism if the output closely
and Paraphrasing checking for verbatim text copy resembles the original text
Reference Basic guidance on how to format and May not align with specific citation styles or the
Management structure citations guidelines provided by journals or academic institutions
Grammar Check Correction of basic grammar and syntax Inadequate compliance with academic requirements,
and Editing errors in large amounts of text in less time fact-checking, and understanding discipline-specific terms
Find a wide range of journals on broader Overlook relevant publishing opportunities and ignore
Journal Finder
subjects key factors influencing journal selection process
Identification of typical language and No subject matter expertise and inability to address
Peer Review
grammar errors ethical considerations
ChatGPT's capabilities seem to tempt users to rely heavily on its responses without conducting
thorough evaluations. This can inadvertently lead to the dissemination of plagiarized content or
neglect of proper attribution and citation practices. Preventing these issues demands rigorous
policies: validating outputs, correcting biases, upholding legal and ethical norms, and balancing
AI with human expertise.
Threat to Critical Thinking
Overreliance on ChatGPT or similar AI systems without human oversight may erode
expertise and judgment, impairing research quality and tarnishing reputation.
Ethical Concerns
Any data users add into prompts for ChatGPT are stored in its dataset; this
poses ethical concerns as users may add confidential and sensative
infromation. A particularly concerning areas of use is th integration of
ChatGPT or generative AI in healthcare. For example, the use of generative
AI in a mental health app has already drawn intense scruitiny. Medical
applications will require stricter adherence to informed consent laws and
ethical guidelines to protect users' rights and privacy.6
Source: nature.com
5. Tsigaris P, Teixeira da Silva JA. The role of ChatGPT in scholarly editing and publishing. Eur Sci Ed [Internet]. 2023 [cited 2023 May 15];49:e101121.
Available from: https://ese.arphahub.com/article/101121/list/8/
6. Quarles S. Online mental health company uses ChatGPT to help users respond to experiment - raising ethical concerns [Internet]. Business News. 2023 [cited 2023 Jul 20].
Available from: https://biz.crast.net/online-mental-health-company-uses-chatgpt-to-help-users-respond-to-experiment-raising-ethical-concerns-around-healthcare-and-ai-technology/
7. Adopt a culture of continuous learning and training to stay updated with the latest technology
and ethics in AI research.
These guiding principles can serve as a foundation for developing comprehensive policies that address ethical,
technical, and social considerations, while also fostering responsible and innovative AI research practices.
The limitations of generative AI do create opportunities for inaccurate and fake research; however,
universities should not expect individual researchers to completely avoid this technology in light of
its widespread use. Instead, institutions can focus on setting well-defined guidelines that outline
requirements, workflows, and set up regulations to ensure responsible AI use.
Utilizing ChatGPT and other generative AI tools will require continuous attention and
adherence to evolving AI guidelines. Our key recommendations are as follows:
To achieve this, university administrators could utilize a four-step process process for setting up sustainable policies:
01 02 03 04
Set Guiding Define Policy Demonstrate Re-visit and Update
Principles Frameworks Safe Use Cases Policies Regularly
Enago is here to support your journey with AI and help you implement the right solutions.
Advisory and Consulting Service
Our AI consultants can help you identify the right use cases as well as provide you a clear
forward-looking direction for your Gen AI needs, keeping in mind your strategic goals.
Publication Optimization
Enago Reports is a one-stop solution to ensure superior language quality, technical
compliances, eliminate bias, automatically proofread, facilitate journal submission, and
identify plagiarism or AI-generated content.
Control the future of knowledge creation and dissemination with smart AI solutions that redefine
the boundaries of what's possible in the world of academia.
Table of Content
• Brief Introduction to ChatGPT 15
*OpenAI introduced web browsing in GPT-4.0 for Plus and Enterprise users in late September, thereby eliminating the knowledge
cutoff limitation. However, this is currently not accessible in the free version.
1. 2.
Researchgate.net. [cited 2023 May 3]. Available from: https://www.researchgate.net/publication/369817340_Chapter_2_ChatGPT_in_Academic_Writing_and_Publishing_A_Comprehensive_Guide
2. Torres JL. Tec de Monterrey recomienda a su comunidad uso inteligente de ChatGPT [Internet]. Tec.mx. [cited 2023 May 11].
Available from: https://conecta.tec.mx/es/noticias/nacional/institucion/tec-de-monterrey-recomienda-su-comunidad-uso-inteligente-de-chatgpt
3. Nature Editorials. Why Nature will not allow the use of generative AI in images and videos [Internet]. Naure. Vol 618, 8 Jun 2023 [cited 2023 July 28].
Available from: https://www.nature.com/articles/d41586-023-01546-4
4. Kaiser J. Science funding agencies say no to using AI for peer review [Internet]. ScienceInsider. 14 Jul 2023 [cited 2023 July 28].
Available from: https://www.science.org/content/article/science-funding-agencies-say-no-using-ai-peer-review
5. Hill C. OpenAI and Microsoft face class action lawsuit for allegedly violating copyright and privacy laws [Internet]. Legal IT Insider. 29 Jun 2023 [cited 2023 July 28].
Available from: https://legaltechnology.com/2023/06/29/openai-and-microsoft-face-class-action-lawsuit-for-allegedly-violating-copyright-and-privacy-laws/
6. Knight L. Authors call for AI companies to stop using their work without consent [Internet]. The Guardian. 20 Jul 2023 [cited 2023 July 28].
Available from: https://www.theguardian.com/books/2023/jul/20/authors-call-for-ai-companies-to-stop-using-their-work-without-consent
7. Liang W, Yuksekgonul M, Mao Y, Wu E, Zou J. GPT detectors are biased against non-native English writers. Patterns, 4(7), 100779, 2023. https://doi.org/10.1016/j.patter.2023.100779
Original Text
Error Explanation
In current study we have single stock whose price observe a switching geometric The human editor combined the two
Brownian motion. Also, the stockpay no dividends. sentences with the use of technical jargon.
In contrast, the ChatGPT sentence could not
revise “stock pays no dividend” and
Edited by ChatGPT Edited by a Human (Enago Editor) “switching geometric Brownian motion” to
“no-dividend stock” and “regime-switching
In current study, we have a single stock In current This study we have examines a
geometric Brownian motion”, respectively.
whose price follows a switching no-dividend single stock whose prices
geometric Brownian motion. Additionally, observe a exhibit regime- switching
the stock pays no dividends. geometric Brownian motion. Also, the Expert Tip
stockpay no dividends. Aside from being unable to understand
technical nuances, generative AI’s editing
skills have been inefficient at several other
Publication-ready Statement
important aspects of academic research and
This study examines a no-dividend stock whose prices exhibit regime-switching writing. Please find more examples here:
geometric Brownian motion. https://www.enago.com/academy/limitation
s-of-deepl-write-chatgpt-editing/
While a majority of researchers understood individual responsibility, more than 60% researchers held Funding bodies (24%), Peer Reviewers
(20%) and even ChatGPT itself (15%) responsible for declaring how to use generative AI responsibly.
Poll details:
1. Survey was conducted on English, Japanese, and Korean websites.
2. Total of 7,748 researchers answered the poll question
35%
30%
25% 24%
20%
20%
15%
15%
10%
5% 4%
0%
The researcher/s Funding body ChatGPT developers Peer reviewers Regulatory bodies
1. https://www.enago.com/academy/manuscript-preparation-with-ai/
2. https://www.iesalc.unesco.org/wp-content/uploads/2023/04/ChatGPT-and-Artificial-Intelligence-in-higher-
education-Quick-Start-guide_EN_FINAL.pdf
3. https://www.enago.com/academy/human-editors-vs-chatgpt-publication-ready-research/
4. https://www.enago.com/academy/negative-costs-of-using-chatgpt-to-edit-research-manuscript/
5. https://research.aimultiple.com/generative-ai-in-life-sciences/
6. https://www.enago.com/academy/why-ai-alone-is-not-enough/
7. https://research.aimultiple.com/chatgpt-survey/
8. https://www.researchgate.net/publication/369359524_ChatGPT_and_AI-Written_Research_Papers_Ethical_
Considerations_for_Scholarly_Publishing
9. https://www.cam.ac.uk/stories/ChatGPT-and-education
10. https://axial.acs.org/publishing/ai-in-publishing-the-ghost-writer-in-the-machine
11. https://www.enago.com/academy/generative-ai-ethics-in-academic-writing/
12. https://www.enago.com/academy/university-policies-for-AI-use-education-research/
13. https://www.enago.com/academy/chatgpt-and-ai-tools-in-academic-publishing/