lOMoARcPSD|5542521

Computer Based Psychological Testing

Psychometrics (Nelson Mandela University)

StuDocu is not sponsored or endorsed by any college or university

Downloaded by Sahal Yawar ([email protected])
 lOMoARcPSD|5542521

COMPUTERS AND BASIC PSYCHOLOGICAL SCIENCE

IN TESTING
DEFINING COMPUTER-BASED TESTING

 Computer-based test refers to a test that is administered and scored on a computer.

Sometimes a test has both a paper-based and computer-based test. However, a test is
often available in a computerised format only, as the item types used, cannot be
replicated in a paper-based format. When a computer-based test is used, the resultant
type of testing is referred to as computer-based testing (CBT), Foxcroft, C., & Roodt, G.
(2009).

 Computerised adaptive testing (CAT) is a special type of computer-based testing, which

uses a set of statistical procedures that make it possible to tailor the test for the
individual being assessed based on their responses, which allows for more accurate and
efficient measurement.

 Many computer-based tests have computer-based test interpretation (CBTI) systems

which aid assessment practitioners in interpreting test performance and provide
hypotheses related to understanding the test-taker better, making a diagnosis and
suggesting treatment possibilities, Foxcroft, C., & Roodt, G. (2009).

ADVANTAGES OF COMPUTER-BASED TESTING

 In many educational online programs, there is often concern about accuracy, validity,
security, integrity, and quality of online assessment. Yet, computer-based testing offers so
many benefits to online learners, instructors, and programs, mainly in terms of
administration, grading, and scale. As part of a multi-post series on assessment, this section
makes a push for why you may want to embrace (more) computer-based/online testing.

 Multiple-Test Administrations

 Dynamic and Individualized Assessments

- Tests can be personalized and tailored to individual students. The level of difficulty
of each question can be modulated depending on the learner’s previous responses.

 Immediate Grading/ Scoring

- Select-response tests (like multiple choice or True/False) can be scored instantly and
online instructors can make real-time instructional changes based on assessment
evidence. This immediate grading frees up instructors to focus on feedback, which is
critical for learning and is also time consuming. Scores are more accurate and are
available in a short space of time.

Downloaded by Sahal Yawar ([email protected])

 lOMoARcPSD|5542521

 Feedback

- Video-based feedback can provide students with individualized and personalized

feedback on performance. Video feedback is faster to create (by the instructor) and
review (by the learner), it can provide rich, qualitative information on student
performance and do so in a caring and personalized way. Interpreting scores is much
easier and faster. Test reports can be generated and used when giving feedback to
clients.

 Help Learners with Disabilities

- If computer-based assessments are universally designed, they may form less of a

physical impediment to test taking than is the case with paper-based tests. For
example, screen readers, magnification tools, and text-to-voice or voice-to-text
applications can help learners with visual, auditory, and motor impairments;
learners with dyslexia; and learners who simply need more time to complete a test.

DISADVANTAGES OF COMPUTER-BASED TESTING

 While the advantages of computerized assessment are many, this method is not totally
problem-free. One major problem associated with automated administration, scoring,
and interpretation is misuse by unqualified professionals. Skinner and Pakula (1986)
suggest that computerized assessment may inadvertently encourage use by
professionals without adequate knowledge and experience. It is important to keep in
mind that the validity of the information obtained by computerized psychological
assessment can be ensured only in the hands of a professional with adequate training
and experience with the particular test in question.

 Another practical factor that has limited the use of CBT is the availability of human
resources with the knowledge necessary for effective implementation. The design and
implementation of CAT systems involve a great deal of statistical expertise. IRT statistical
procedures are advanced techniques that require a relatively in-depth knowledge of
statistics to effectively use and interpret. Such expertise is usually not available for
projects with tight budgets.

CHALLENGES WITH COMPUTER-BASED TESTING

 CBT Security : One of the major challenges for all testing practice is ensuring test
security

 Item Banking: One security issue that plagues CBT relates to item banking. If the stakes
of a test are high, it has proven extremely difficult to bank a sufficient number of test
questions to maintain test security.

 Test Taker Identity: One of the biggest contemporary challenges of using CBT for high-
stakes decisions relates to test taker identity.

 Storage and Retrieval of Tests and Scores: The safe storage and retrieval of assessment
instruments, scores, and responses can also be a challenge for CBT systems. Computer
hacker’s and individuals who create programs or scripts for illegally gaining information
from servers or Web sites are also a threat to CBT.

Downloaded by Sahal Yawar ([email protected])

 lOMoARcPSD|5542521

DEFINITION OF INTERNET DELIVERING TESTING

 Technological innovations in the computer industry have led to the development of

better interfaces and dramatic increases in the volume of and accessibility to hardware

 The Internet is currently being used widely and access from home and office is readily
available

 This has had a major impact on the way assessment and testing is carried out

 The interconnectivity reached through the Internet is leading to a revolution in testing

and assessment

 In simple definition internet delivering testing is the use of internet to conducting testing
this method may use a computer or any gadget such as phones

ADVANTAGES OF INTERNET DELIVERING TESTING

 internet testing can produce result at the same time unlike the paper based test this
making it convenient and save a lot of time

 The Internet offers many advantages for psychological assessment. These include
enhanced convenience for the applicants with its 24 hour a day access, cost-
effectiveness and a shortened hiring cycle

 Internet-based platforms have a broader reach and therefore allow testing in rural
settings where it is difficult to travel to a testing center

 Tests are also easier to maintain, because norms can be changed readily and new
translations or items can be made available around the world almost instantly

DISADVANTAGE OF INTERNET DELIVERING TESTING

 Potential problems when using Internet-based assessments. The first major issue
involves the quality of assessments available on the Internet. As discussed previously, a
range of tests is made available by unqualified persons and reports are generated and
feedback given on the results

 With Internet assessments, the problem of confidentiality must also be considered.

Participants may feel uncomfortable providing information over the Internet, because
they believe that others may see the result

 There are also some technical issues relating to the speed and bandwidth of the
Internet, as well as network integrity and reliability

 Such groups may experience the Internet medium as difficult. Also, if disadvantaged
groups have less access to the Internet, recruitment and selection via the Internet raise
ethical and legal concerns

Downloaded by Sahal Yawar ([email protected])

 lOMoARcPSD|5542521

CHALLENGE OF WITH INTERNET DELIVERING TESTING

 Previously disadvantage communities may not be familiar with the latest technology let
alone being familiar with the basic computer skills therefore any test made to evaluate
such individuals its validity will be compromise

 Fairness is also an issue with regards to the fact that some test takers have access to
computer technology and some don’t which makes those who don’t to be at a
disadvantage. This disadvantage can impact their test performance due to errors and
slower responses will impact them in tests with time limits.

 Another challenge is personal safety of the individual taking the test, taking into account
the cyber bullying issue the provided personal information maybe be misuse posing a
great harm to the individual

 Internet performance is also a challenge in unsupervised settings. Some test takers

might have disrupted or slow internet connections whilst others might not even have
access to the internet at all

Downloaded by Sahal Yawar ([email protected])