1 s2.0 S2352396416301992 Main
1 s2.0 S2352396416301992 Main
EBioMedicine
Research Paper
⁎ Corresponding author at: Department of Endoscopy, Fukuoka University Chikushi Hospital, 1-1-1 Zokumyouin, Chikushino City, Fukuoka, 818-8502, Japan.
E-mail address: [email protected] (K. Yao).
http://dx.doi.org/10.1016/j.ebiom.2016.05.016
2352-3964/© 2016 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
K. Yao et al. / EBioMedicine 9 (2016) 140–147 141
a r t i c l e i n f o a b s t r a c t
Article history: Background: In many countries, gastric cancer is not diagnosed until an advanced stage. An Internet-based e-
Received 4 February 2016 learning system to improve the ability of endoscopists to diagnose gastric cancer at an early stage was developed
Received in revised form 15 May 2016 and was evaluated for its effectiveness.
Accepted 16 May 2016 Methods: The study was designed as a randomized controlled trial. After receiving a pre-test, participants were
Available online 17 May 2016
randomly allocated to either an e-learning or non-e-learning group. Only those in the e-learning group gained
access to the e-learning system. Two months after the pre-test, both groups received a post-test. The primary
Keywords:
Endoscopic diagnosis
endpoint was the difference between the two groups regarding the rate of improvement of their test results.
Gastric cancer Findings: 515 endoscopists from 35 countries were assessed for eligibility, and 332 were enrolled in the study,
E-learning with 166 allocated to each group. Of these, 151 participants in the e-learning group and 144 in the non-e-
International multicenter randomized con- learning group were included in the analysis. The mean improvement rate (standard deviation) in the e-
trolled trial learning and non-e-learning groups was 1·24 (0·26) and 1·00 (0·16), respectively (P b 0·001).
Interpretation: This global study clearly demonstrated the efficacy of an e-learning system to expand knowledge
and provide invaluable experience regarding the endoscopic detection of early gastric cancer (R000012039).
© 2016 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY license (http://
creativecommons.org/licenses/by/4.0/).
non-cancer, whereas C4 (mucosal high-grade neoplasia) and C5 (sub- limited to the submucosal layer (Japanese Gastric Cancer Association,
mucosal invasion of neoplasia) were diagnosed as cancer (Ezoe et al., 2011). The lesions are present in some, but not all, of the images. The
2011). The EGC was defined as cancer whose depth of invasion is images have sufficient quality to permit the differentiation of cancer
from non-cancer (Fig. 1). As shown in Fig. 1, the participants were
asked to analyze each image in each set for:
Test scores were marked for correct answers to (1), (2) and (3), up
to a total of 100 points. To avoid potential bias, participants were not in-
formed about the number of cancerous cases among the test sets.
3.2. Allocation
Fig. 1. An example of the pre- and post-test. a. When the participant starts the test, an
endoscopic image appears. The first question is whether or not a localized lesion is
present. If the participant clicks “present” as shown by “A1” in the slide, the second
instruction is for the participant to click on the center of the detected lesion on the
image as shown by “Q1”. b. The third question is whether the detected lesion is
malignant or benign. c. The participant is then offered the chance to identify any Fig. 2. An example of a video clip. On the lecture page, lecture video clips can be viewed
additional lesion. online or can be downloaded.
K. Yao et al. / EBioMedicine 9 (2016) 140–147 143
experience (Figs. 2 and 3). The content was originally constructed for
the purpose of improving the ability of a participant to endoscopically
detect EGC by conventional white light endoscopy. The e-learning con-
tent comprised:
1. Technique
2. Knowledge
– Test (ten questions without answers)
– Lecture (video clips & slides) (Fig. 2)
– Test (ten questions with answers and descriptions)
After the e-learning period, all participants (both e-learning and In this trial, we decided to invite as large a number of participants as
non-e-learning groups) received the post-test between June 16th, possible without calculation of an actual sample size in order to expand
2014 and July 31st, 2014. The post-test evaluation used the same format the benefit of e-learning. In a usual clinical trial, we need to minimize
and methodology as the pre-test evaluation, however the participants the number of participants who receive random allocation from an eth-
did not know how the post-test questions differed from the pre-test ical viewpoint. However, in this study, there was no significant disad-
questions, in order to minimize any carry-over effect. vantage for the participants because eventually, all participants were
The e-tests and the e-learning content were prepared by the lead re- able to receive the e-learning.
searcher (K. Y.). Endoscopic images were supplied by the Department of
Endoscopy at Fukuoka University Chikushi Hospital. All images were
3.7. Statistical Analysis
taken during actual clinical practice. All patient information (including
patient ID, name, gender, age and date of examination) was removed,
The data were expressed as mean (standard deviation, SD). The dif-
and each image was allocated a new number for tracking purposes.
ference in score improvement between the two groups was examined
The e-test and the e-learning system were both originally constructed
by an independent-sample t-test, with a P value of b0.05 indicating sta-
by an information technology engineer (Y. T.)
tistical significance. All analyses were performed using SPSS software
(IBM SPSS Statistics Ver. 20, Chicago, IL).
3.5. Study Outcomes
The primary outcome was the difference in the degree of improve- 4. Results
ment in e-test results between the “e-learning” and “non-e-learning”
groups. The degree of improvement was determined as post-test result 4.1. Participant Flow and Baseline Characteristics
(score)/pre-test result (score). The secondary outcomes were the differ-
ence in the degree of improvement in the e-test according to pre-test Among the 515 endoscopists from 35 countries assessed for eligibil-
score, experience of endoscopy and geographical difference. The partic- ity, 332 participants from 27 countries who met the inclusion criteria
ipants were divided into low and high pre-test groups according to the completed the pre-test and were enrolled in the study. Of these partic-
mean pre-test score of the whole baseline group. Experience of endos- ipants, 166 were allocated to the e-learning group and 166 to the non-e-
copy was divided into less experienced (b8 years) and experienced learning group. During the e-learning period, 151 participants in the e-
(≥8 years) groups based on the median years of experience (7 years). learning group completed both e-learning and the post-test, while 144
Geographical region was divided into Asia-Pacific, Europe and Latin participants in the non-e-learning group completed only the post-test
America. (Fig. 4). The data of 151 participants in the e-learning and 144 in the
Fig. 4. Details regarding enrollment of participants, randomization and e-tests. IC: informed consent.
K. Yao et al. / EBioMedicine 9 (2016) 140–147 145
et al. indicated that the learning effect may decrease if endoscopists do 9. Yao F: Participant recruitment, acquisition of data, revising the
not continue their learning practice (Mabe et al., 2014). An Internet- manuscript and final approval of the article
based e-learning system has the advantage that endoscopists can repeat 10. Parra-Blanco A: Participant recruitment, acquisition of data, revis-
the practice and maintain their ability wherever and whenever they ing the manuscript and final approval of the article
wish. 11. Ho SH: Participant recruitment, acquisition of data, revising the
manuscript and final approval of the article
5.4. Limitations 12. Avendano AG: Participant recruitment, acquisition of data, revising
the manuscript and final approval of the article
One of the limitations of this trial is that the primary outcome was 13. Piscoya A: Participant recruitment, acquisition of data, revising the
not an improvement of the detection rate of EGC in actual clinical prac- manuscript and final approval of the article
tice, but an improvement of test scores. Nevertheless, we have already 14. Fedorov E: Participant recruitment, acquisition of data, revising the
started a clinical study to investigate the improvement of EGC detection manuscript and final approval of the article
rate in real clinical practice after finalizing this trial as described in the 15. Bialek AP: Participant recruitment, acquisition of data, revising the
protocol (UMIN: R000012039). In that study, the number of detected manuscript and final approval of the article
EGCs during the post-e-learning period (one-year after this study) will 16. Mitrakov A: Participant recruitment, acquisition of data, revising
be compared with that during the pre-e-learning period (the one- the manuscript and final approval of the article
year period prior to this study). Another limitation is that this 17. Caro L: Participant recruitment, acquisition of data, revising the
Internet-based system was not designed to be interactive. We hope to manuscript and final approval of the article
improve the system thereby enabling it to accept questions or allow dis- 18. Gonen C: Participant recruitment, acquisition of data, revising the
cussion from the participants. Finally, this system has only an English manuscript and final approval of the article
version currently, however other major language versions could be pro- 19. Dolwani S: Participant recruitment, acquisition of data, revising the
vided in the future. manuscript and final approval of the article
20. Farca A: Participant recruitment, acquisition of data, revising the
5.5. Generalizations manuscript and final approval of the article
21. Cuaresma LF: Participant recruitment, acquisition of data, revising
The content of this e-learning system did not utilize advanced imag- the manuscript and final approval of the article
ing endoscopy, but conventional white-light endoscopy alone which 22. Bonilla JJ: Participant recruitment, acquisition of data, revising the
can be available in any facility in the world. If we were to upload this manuscript and final approval of the article
system onto an official website and offer participation free of charge, 23. Kasetsermwiriya W: Participant recruitment, acquisition of data, re-
then unlimited numbers of endoscopists worldwide would have the op- vising the manuscript and final approval of the article
portunity to learn how to make an endoscopic diagnosis of EGC. Fur- 24. Ragunath K: Participant recruitment, acquisition of data, revising
thermore, this e-learning system could be modified to provide the manuscript and final approval of the article
education regarding endoscopic diagnosis in other organs, such as the 25. Kim SE: Participant recruitment, acquisition of data, revising the
large intestine and the esophagus, as well as the stomach. It may con- manuscript and final approval of the article
tribute to human welfare and health by reducing the mortality from 26. Marini M: Participant recruitment, acquisition of data, revising the
gastrointestinal cancer. manuscript and final approval of the article
In conclusion, as clearly shown by the increased test scores of partic- 27. Li H: Participant recruitment, acquisition of data, revising the man-
ipants in the e-learning group, this multicenter randomized controlled uscript and final approval of the article
trial has successfully demonstrated that an Internet-based e-learning 28. Cimmino DG: Participant recruitment, acquisition of data, revising
system was effective in enabling health practitioners around the the manuscript and final approval of the article
world to improve their knowledge and experience with regard to mak- 29. Piskorz MM: Participant recruitment, acquisition of data, revising
ing an endoscopic detection of EGC. the manuscript and final approval of the article
30. Iacopini F: Participant recruitment, acquisition of data, revising the
Funding manuscript and final approval of the article
31. So JB: Participant recruitment, acquisition of data, revising the man-
The Central Research Institute of Fukuoka University (I) and JSPS uscript and final approval of the article
Core-to-Core Program (B. Asia-Africa Science Platforms). 32. Yamazaki K: Participant recruitment, acquisition of data, revising
the manuscript and final approval of the article
Author Contributions 33. Kim GH: Participant recruitment, acquisition of data, revising the
manuscript and final approval of the article
34. Ang TL: Participant recruitment, acquisition of data, revising the
1. Yao K: Conception and design, analysis and interpretation of data,
manuscript and final approval of the article
participant recruitment, and drafting the article
35. Milhomem-Cardoso DM: Participant recruitment, acquisition of
2. Uedo N: Conception and design, analysis and interpretation of data, data, revising the manuscript and final approval of the article
participant recruitment 36. Waldbaum CA: Participant recruitment, acquisition of data, revising
3. Muto M: Conception and design the manuscript and final approval of the article
4. Ishikawa H: Conception and design, analysis and interpretation of 37. Piedra Carvajal WA: Participant recruitment, acquisition of data, re-
data vising the manuscript and final approval of the article
5. Cardona HJ: Participant recruitment, acquisition of data, revising 38. Hayward CM: Participant recruitment, acquisition of data, revising
the manuscript and final approval of the article the manuscript and final approval of the article
6. Castro Fiho EC: Participant recruitment, acquisition of data, revising 39. Singh R: Participant recruitment, acquisition of data, revising the
the manuscript and final approval of the article manuscript and final approval of the article
7. Pittayanon R: Participant recruitment, acquisition of data, revising 40. Banerjee R: Participant recruitment, acquisition of data, revising the
the manuscript and final approval of the article manuscript and final approval of the article
8. Olano C: Participant recruitment, acquisition of data, revising the 41. Anagnostopoulos GK: Participant recruitment, acquisition of data,
manuscript and final approval of the article revising the manuscript and final approval of the article
K. Yao et al. / EBioMedicine 9 (2016) 140–147 147
42. Takahashi Y: Engineering, acquisition of data, revising the manu- GLOBOCAN, 2012. Estimated Incidence, Mortality and Prevalence in 2012. Available from
http://globocan.iarc.fr/Default.aspx.
script and final approval of the article Japanese Gastric Cancer Association, 2011. Japanese classification of gastric carcinoma:
3rd English edition. Gastric Cancer 14, 101–112.
Acknowledgements Leung, W.K1., Wu, M.S., Kakugawa, Y., et al., 2008. Screening for gastric cancer in Asia:
current evidence and practice. Lancet Oncol. 9, 279–287.
Mabe, K., Yao, K., Nojima, M., et al., 2014. An educational intervention to improve the
This trial was supported by the Central Research Institute of Fukuoka endoscopist's ability to correctly diagnose small gastric lesions using magnifying en-
University (I) (111001) and JSPS Core-to-Core Program (B. Asia-Africa doscopy with narrow-band imaging. Ann. Gastroenterol. 27 (149-5).
Schlemper, R.J., Kato, Y., Stolte, M., 2000. Diagnostic criteria for gastrointestinal carcinoma
Science Platforms). We would like to express our sincere appreciation in Japan and western countries: proposal for a new classification system of gastroin-
to Prof. Fatima Aparecida Ferreira Figueiredo (Head of the Digestive En- testinal epithelial neoplasia. J. Gastroenterol. Hepatol. 15 (Suppl), C52–C60.
doscopy Department of the Copa D'Or Hospital and Quinta D'Or Hospi- Schulz KF, Altman DG, Moher D; CONSORT Group. CONSORT 2010 Statement: updated
guidelines for reporting parallel group randomised trials. BMC Med. 2010; 24:18.
tal, Rio de Janeiro, Brazil) who participated as one of the team leaders of
Veitch, A.M., Uedo, N., Yao, K., East, J.E., 2015. Upper GI endoscopy quality and quality as-
GEST and who made a substantial effort to bring this project to fruition surance: optimizing early upper GI cancer detection and reducing miss rates. Nat.
before she passed away in 2014. We wish to thank Miss Katherine Miller Rev. Gastroenterol. Hepatol. 12, 660–667.
(Royal English Language Centre, Fukuoka, Japan) for correcting the En- World Medical Association Declaration of Helsinki, 2013. Ethical principles for medical re-
search involving human subjects. JAMA 310, 2191–2194.
glish used in this article. Yao, K., 2012. Development of e-Learning System for Endoscopic Diagnosis of Gastric Can-
cer: An International Multicenter Trial. Global e-Endo Study Team (GEST) (2012;
References Available from: http://www.temdec.med.kyushu-u.ac.jp/html/katsudo/ATS/
2012ATS/presentation/SIG-5_Kenshi_Yao.pdf).
American Cancer Society. Cancer facts & figures, 2014. Available from http://www. Yao, K., 2013. The endoscopic diagnosis of early gastric cancer. Ann. Gastroenterol. 26,
cancer.org/research/cancerfactsstatistics/cancerfactsfigures2014/. 11–22.
American Gastroenterological Association (AGA), 2008. Institute technology assessment
on image-enhanced endoscopy. Gastroenteology 134, 327–340.
Ezoe, Y., Muto, M., Uedo, N., et al., 2011. Magnifying narrowband imaging is more accurate
than conventional white-light imaging in diagnosis of gastric mucosal cancer. Gastro-
enterology 141, 2017–2025.