Scientometrics Using

CiteSpace

Arif Zainudin
Unit 1: Evolution of the concept of Informetrics
:Librametry, Bibliometry, Scientometrics,
Webometrics.
Unit 2:Theory and Laws: Zipfs Law, Lotka’s Law
Bradford’s Law, Price Theory and circulation
theory
Type Comparison
Attribut Bibliometry Scientometrics
Method Quantitative Quantitative
Output Maping Open Mind Science
❑ The term Scientometrics originated as a Russian term for
the application of quantitative methods to the history of
science.

❑ In 1969, Vassily V. Nalimov & Z. M. Mulchenko coined the

Russian equivalent of the term ‘scientometrics’
(‘naukometriya’) (Nalimov & Mulchenko, 1969).

❑ As the name would imply, this term is mainly used for the
study of all aspects of the literature of science and
technology.

❑ The term had gained wide recognition after the

foundation of the journal Scientometrics by Tibor Braun
in 1978 .
Professor V.V. Nalimov (1910-1997)

5
What is Scientrometrics?
➢ The term Scientrometrics is a field which applies quantitative
methods to the study of science as an information process.
➢ It is the science of measuring the “quality “of science.
➢ It is often done using bibliometrics which is a measurement of
the impact of scientific publication.
➢ It includes all quantitative aspects of the science of science,
communication in science, and science policy.
➢ It deals with analysis, evaluation and graphic representation
of science and technology information. It tells “Who is doing
what and where?”
➢ Thus scientrometrics is a part of the sociology of science and
has application in science policy making.
Definitions
❖Nalimov and Mulchenko defined scientometrics as
“the application of quantitative methods which are
dealing with the analysis of science viewed as an
information process”.

❖Scientometrics is the science of measuring and

analyzing science ("Scientometrics," 2010).
▪ According to Pouris (1989), ‘Scientrometrics is the
application of quantitative techniques(system
analysis, mathematical and statistical techniques
etc.) to scientific communication(science output,
science policy, science administration etc.) with the
objectives of;
▪ Developing science indicators;
▪ Measuring the impact of science on society; and
▪ Comparing the output as well as the impact of
science at national and international levels.
Thus Scientometrics involves studies in :
I. Sociology of science
II. History of science
III. Growth of science and scientific institutions
IV. Behaviour of science and scientists.
V. Science policy and decision- making
VI. Model of Science
 Content, Theories

Text, Journals

People ,
Institutions

Different perspectives in the study of Science and Technology

• Modern scientometrics is mostly based on the work
of Derek J. de Solla Price and Eugene Garfield. The
latter founded the Institute for Scientific Information,
which is heavily used for scientometric analysis.

Eugene Garfield Derek J. de Solla Price

Derek J. de Solla Price
➢ Studied the exponential growth of science and the
half-life of scientific literature; together with the
formulation of Price's Law.
➢ In his book entitled “Little Science – Big Science”
(1963), Derek J. de Solla Price analysed the recent
system of science communication and thus
presented the first systematic approach to the
structure of modern science applied to the science as
a whole.
✓ Scientometrics utilizes quantitative analysis and
science mapping to describe patterns of publication
within a given field or body of literature.
✓ There are two main procedures: performance analysis
and science mapping.

✓ Performance analysis aims at evaluating groups of

scientific actors (countries, universities, departments,
researches) and the impact of their activity on the
basis of bibliographic data.
• Science mapping aims at displaying the structural
and dynamic aspects of scientific research. A science
map is used to represent the cognitive structure of a
research field.
 Research evaluation: Why, what, and
how?
• Why evaluate?
– Advocacy
– Allocation
– Analysis
– Accountability
• What to evaluate?
– Countries
– Research institutions
– Research groups
– Individual researchers
• How to evaluate?
– Expert judgment
– Scientometrics Adam et al. (2018)

16
Scientometric Indicators
• Journal Impact Factor: Measure of the frequency with
which the "average article" in a journal has been cited
in a given period of time.
• H-index: impact of individual scientists rather than
journals: Measuring the number of an individual
Scientist's impact and citation record.
• Measuring the Level of Non-Citation: Uses the level of
non citation of articles within a journal as a measure of
quality.
• Page Rank Algorithm: (used in web-metrics (Google))
Used to provide greater weight to citations from
journals that have high impact than citations from
lower-impact journals.
 Scientometrics tools

The quantitative as well as qualitative analysis of any

Scientometrics study, such as citation mapping,
visualization, bibliographic coupling, co- authorship
network, co-words mapping etc. are carried out by using
Scientometrics tools. This tools are very much useful for
Scientrometricians for mapping their parameters in any
accept of their study.
 Tool Purpose Type
Authormap It is used for citation mapping Web tool
and visualization
Bibcouple It is used for visualization of the Software
bibliographic coupling among application
authors
Citespace It is used for visualizing patterns Map
and trends in scientific literature

Fulltext It is software for co-word Software

mapping of full texts application

HitCite Bibliographic analysis and Software

visualization software
Authormap - citation mapping and visualization
Citespace visualizing patterns and trends in scientific literature
for co-word mapping using full texts
 Why Evaluation?

when Private or Govt. Bodies are asked to award

large sum to scientists for research activity.

Those in-charge of making such decisions

(Policy Makers) feel uneasy about having to base
their decisions only on guess and on the personal
experiences of previous science administrators.

27
 Scientometric
➢ The measurement of science
– not the use of measurement in science

➢ The quantitative study of scientific

communications

28
 Scope….

➢ It is a field wherein the flow of information and

behavior of information are analyzed, measured and
quantitative relations are established
➢ It is a scientific field wherein the developments of
measurement of impact of information are accessed
continuously.
➢ Scientometrics mostly deals with analysis of science
data.

29
 Topics deal with….. (Novelty)

➢ Growth and obsolescence of literature.

➢ Measures of scientific productivity (often referred to
as the author productivity).
➢ Quantitative aspects of library and information
studies, including journal productivity, rank
distribution of words, etc.
➢ Co-citation, bibliographic coupling, co-word analysis,
etc.
➢ Identifying relations among various disciplines,
structure of subjects, national mapping of science, etc.

30
 Scientometrics: Applications
➢ Documentation – where it can count the number of
journals that constitute the core, secondary sources
and periphery of a discipline by analyzing the quantity
of journals needed of the information in a given area
of science

➢ Science policy – where it provides indicators to

measure productivity and scientific quality, thereby
supplying a basis for evaluating and orienting R & D.

31
Citation Analysis: Definition

Citation analysis is the examination of the

frequency, patterns, and graphs of citations in
articles and books. It uses citations in scholarly
works to establish links to other works or other
researchers. Citation analysis is one of the most
widely used methods of bibliometrics. For
example, bibliographic coupling and co-citation
are association measures based on citation
analysis.
32
Citation Analysis

➢Using citations as the raw data for

bibliometric studies

➢Who footnotes whom/who is footnoted

by whom

➢Can be used to assess the influence of an

individual on a field of study

33
Problems in Citation Analysis
➢ Citing behavior is little understood

➢ Citer motivations are little acknowledged

➢ Matthew Effect (Robert K. Merton)

– "To him who has shall be given, and he
shall have abundance: but from him who does
not have, even that which he has shall be taken
away.”

➢ Obliteration by incorporation
34
Content Analysis
• Content analysis is considered a scholarly method
in the humanities by which texts are studied as to
authorship, authenticity, or meaning.
• Content analysis to explore the content of various
media (book, journals, web resources, etc.) in order
to discover how particular issues are presented.
• Content analysis is a summarizing, quantitative
analysis of messages that relies on the scientific
method and is not limited as to the types of
variables that may be measured or the context in
which the messages are created or presented

35
Steps for Conducting CA

➢ Define terms ➢ Find data and

– Knowledge sampling
construction,
socializing, presence
➢ Generate coding
scheme
➢ Specify unit and
analysis
– Words, sentences,
➢ Inter rater reliability
phrases, paintings,
audio, video ➢ Analyze!!!
36
 Who wants Evaluation?

Science Policy Makers

Science Fund Managers
Institutes for rewarding outstanding contributions
Awarding the scientific projects for conducting
research

37
 Methods of Evaluations?

Quantitative Analysis Qualitative analysis

No. of scientific publications Peer Review (Judges Rating)

No of Patents filed Citation Analysis etc.

No of Technology transfers etc.

38
 Examples of Scientific Productivity

Publication productivity is one of the important

indicators to help us to know the scientific
standing of a country among other countries of the
world,Institutions among other institutions, Individual
scientists among other scientists.

39
 Scientometric data sources

• Web of Science (Clarivate Analytics)

– “With the Web of Science platform, you can access an unrivalled breadth of world-class
research literature linked to a rigorously selected core of journals”
– Consists of multiple citation indices (SCIE, SSCI, AHCI, ESCI, CPCI, BCI, …)
– Content selection by Editorial Development team
• Scopus (Elsevier)
– “Scopus is the largest abstract and citation database of peer-reviewed literature”
– Content selection by Content Selection and Advisory Board
• Dimensions (Digital Science)
– “Re-imagining discovery and access to research: grants, publications, citations, clinical trials,
patents and policy documents in one place”
– Based on Crossref and PubMed data, enriched with data from publishers
– Content selection by end user
– Basic web interface is freely accessible; data is freely available for scientometric research

40
Scientometric data sources
• Google Scholar
– Most comprehensive scientometric data source
– Low data quality and easy to manipulate
– No possibilities for large-scale data access
• Microsoft Academic Graph
– Data can be accessed through API and Microsoft
Azure
– ODC-BY license (free to share, create, and adapt
as long as you attribute)

41
Comparison of data sources

Overlap of publications in different data sources

(1996–2017); WoS includes only SCIE, SSCI, AHCI,
and CPCI

42
 References
1. Bibliometric and scientometric . (2006). Retrieved from
http://edweb.sdsu.edu/courses/edtec296/
2. Content Analysis. (2010). Retrieved from
http://amandaklein.blogspot.com/
3. Scientometric to webometrics. (2010). Retrieved from uni-
mysore.ac.in/Asc/2010%20TO%202011/RC/.../mysore2011-
1.ppt
4. Citation Analysis. (2011). Retrieved from
boballen.info/ISS/PPT/ISSchp09.pptx
5. Content analysis. (2008). Retrieved from
http://en.wikipedia.org/wiki/Content_analysis

43
Questions ?
Thank You