See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/328996233

Test Case Generation Tools - A Review

Article · November 2018

CITATIONS READS

0 306

3 authors:

Rajvir Singh Anita Singhrova

Deenbandhu Chhotu Ram University of Science and Technology, Murthal Deenbandhu Chhotu Ram University of Science and Technology, Murthal
21 PUBLICATIONS   36 CITATIONS    26 PUBLICATIONS   154 CITATIONS   

SEE PROFILE SEE PROFILE

Rajesh Bhatia
PEC University of Technology
59 PUBLICATIONS   475 CITATIONS   

SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Test Case Generation for Object Oriented System View project

Design and Development of Software Clone Detection Technique View project

All content following this page was uploaded by Rajvir Singh on 20 November 2018.

The user has requested enhancement of the downloaded file.

 International Journal of Electronics Engineering (ISSN: 0973-7383)
Volume 10 • Issue 2 pp. 586-596 June 2018-Dec 2018 www.csjournals.co m

Test Case Generation Tools-A Review

Rajvir Singh1, Anita Singhrova2, Rajesh Bhatia3
12
Deaprtment of CSE, Deenbandhu Chhotu Ram University of Science and Technology, Sonepat, India
3
Department of CSE, PEC University of Technology, Chandigarh, India

Abstract: In recent years, various researchers have been working on the tools or methods to optimize the testing time.
The test case generation tools are found to be helpful to reduce the testing time and cost of resources required during
testing phase. The existing literature presents various tools supporting procedural as well as object oriented languages.
Test case generation is main step in software testing. These tools are helpful for automation of test case generation. This
paper presents a review of test case generation tools. This paper will be helpful for those researchers who are working
for the automation of software testing making use of tools. Further, this paper will also be helpful for academic
researchers who are working in the area of software test automation.
Keywords: Object-Oriented software testing tools, Software testing, Software testing tools, open source tools.

Introduction
Software testing is the process of executing the program with the motive to reveal faults. The software testing
tools for generation of test cases play a vital role in automation of software testing which in turn reduces the
testing time and effort as compared to manual testing. Several methods are used for the generation of test
cases by various researchers.
Object oriented testing is used these days in most industries that develop software systems. This paper
presents test case generation(TCG) tools. Automatic test case generation is act of using system to identify
truth table of tests based on set of contexts and outcomes. Automatic Test case generation enables the tester
in speeding up testing cycles with reduced effort and cost. It also helps in maintaining test cases and increases
the efficiency of software testing techniques[1]. The variation on each context on inputs during testing
increases the total permutations of test cases which are to be executed to test the software system. Further, the
existing study presented by Mahadik et. al.[1] discusses only fifteen tools.
The rest of the paper is organized in five sections namely: review method, automated test case generation
tools, analysis of study, conclusion and future work, and finally references.
Review Method
This section presents the review method followed for the collection of data for different test case generation
tools:
Inclusion / Exclusion Criteria
The inclusion / exclusion criteria for the selection of test generation tools are based on the availability in
literature. The different digital libraries: IEEE Explore, Springer Link, citeseerX, ACM digital library,
Science direct DL, Wiley DL, google scholar have been searched for the test generation tools. The search
string combinations used are: ((Test) + (tools) + (software testing tools) + (test case generation tools)). Total
5404 articles were found. The exclusion criteria is applied: (i) on the basis of title 654 (ii) on the basis of field
of study and abstract 4580 articles excluded. (iii) 60 tools are selected after further manual exclusion based
on the availability of online documentation.
The data related to these sixty tools was extracted and analysed. Some data from the website links as
presented in references section were analysed. The next section provides the table of these 60 tools and their
corresponding data extracted.
Automated Test Case Generation Tools
The existing literatures have presented the following sixty test generation tools based on the search criteria.
The brief discussion on these tools is presented below:
Hartman et. al.[2] proposed a model based TCG tool named as ADGES which used commercial UML
modeling framework. The authors advocated that this tool is mature enough. It takes model labeled transition
system specifications of UML model as input and creates test cases as output.
Boshernitsan et. al.[3] presented AgitarOne which is successor of Agitar tool and is a commercial tool for
generation test cases from java source code. It analyses java classes for different types of input data and
creates observations depicting behavior of class. These observations are then transformed to assertions by the
developer using JUnit[36] tool.

Page | 586
 International Journal of Electronics Engineering (ISSN: 0973-7383)
Volume 10 • Issue 2 pp. 586-596 June 2018-Dec 2018 www.csjournals.co m

ALLPAIRS[4] is a web based open source tool which is freely available for its use. It creates minimized
executable test cases, taking .txt file as input. It uses boundary value analysis(BVA), equivalent class
partitioning black-box methods for TCG.
Barnett et. al.[5] presented AsmL tool which is a finite state machine(FSM) based test cases generation tool.
Lakhotia et. al.[6] proposed Austin tool which is a C language code search based TCG tool and is available as
open source. It supports the procedural code analysis.
Romberg et. al.[7] advocated AutoFocus a web based tool created at university of California. This tool
produces packet header traces and is free for academic and research purpose.
Koch et. al.[8] proposed AutoLink tool for test generation using SDL specifications at Institute of
Telematics, Germany. Autolink is commercial tool which generates complete TTCN test suite.
AutoTest presented by Meyer et. al.[9] uses traces in design for TCG and minimizes them. It works in
integration with EiffelStudio IDE and is class based open source project.
C++Test[10] is a unit level TCG tool for C++ programming which uses random, static analysis method for
TCG.
Tanno et. al.[11] presented CATG[11] tool developed at university of Illinois by their team of academic
researchers. This tool produces test cases using random symbolic execution of java byte code and is available
as open source code.
CertifyIT[12] is commercial tool which is a UML model structural coverage based tool. It takes FSM
specifications as input and produces pest paths.
Class Visualizer[13] is an analysis to which generates class dependency graph from java byte code and
available open source.
CodeProAnalytix[14] class based OO TCG tool used for generating JUnit test cases from java source code. It
is product of Google Inc available for commercial use.
CompleteTest[15] is a model based tool developed at Malardalen university. It is structural coverage based
tool and is available for academic use.
Conformiq[16] is model based tool which is available for commercial use and is a path coverage based tool.
Nakornburi et. al.[17] advocated a pair-wise test generation tool called as CPTG. This tool generates test
cases based of statistical user profile data in the form of .csv file.
Cute and jCute are the tools proposed by Sen et. al.[18][31] and are used to generate test data from C code
and java code respectively. These tools are open source and available free for academic and research purpose.
Burnim et. al.[19] presented Crest an open source tool used for TCG for C language programs. It uses
dynamic symbolic execution method.
Daikon[20] tool generates test sequences from java source code and is integrated with JUnit[36] testing
environment. It is available as open source.
Godefroid et. al.[21] proposed DART a code based object oriented testing tool which takes DART source
code as input and gives test cases as output.
DIVERSITY[22] is an open source tool for generating test cases. It generates TTCN-3 based test cases.
Fraser et. al.[23] presented Evosuite tool for executable test cases generation. Evosuite takes java source /
byte code as input and creates genetic algorithm based test cases. Evosuite is available as open source
software.
Cadar et. al.[24] advocated KLEE tool which takes C bit code as input and creates test cases based on
concolic method. It is available as open source software.
Findsbugs[25] is java source code based open source tool. It performs module level static analysis.
FMBT[26] developed by Intel is an open source tool which performs TCG from models written in Python or
AAL (a pre-post condition language) and is capable of online and offline testing on Linux platform.
GATel[27] generates test cases from Lustre language written constraints specification programs and is
available for academic use.
Ma et. al.[28] proposed GRT tool for test data generation which performs random static and run time
analysis. It takes java source / byte code as input. GRT is available freely for academic or research use.

Page | 587
 International Journal of Electronics Engineering (ISSN: 0973-7383)
Volume 10 • Issue 2 pp. 586-596 June 2018-Dec 2018 www.csjournals.co m

HTG[29] is an academic TCG tool for hybrid systems which takes hybrid automation model and creates
C++ test cases.
Jcrasher, a code based tool presented by Csallner et. al.[30] is used for object oriented testing. Java source
codes are taken as input and test file are generated as output. This is an open source tool under the Apache
license.
JMT[32], a code based testing tool which is used for performance evaluation and modeling. Main features of
this tool are Mean value analysis, Simulation, and performance engineering.
Albert et. al.[33] developed jPET, a code based testing tool which uses java source code as input and develop
test case for that. It is annotated with JML specifications and uses symbolic execution technique for test cases
generation.
JTest[34] is a code based testing tool for Java Language programs made by parasoft. This can be used for
static analysis, unit test case generation, regression testing, code review and many more. But this is a
commercial tool.
Sakti et. al.[35] proposed JTExpert, an academic tool which uses code based approach for testing java source
code. It uses search based technique for test case generations. Main focus of this tool is on branch coverage.
Junit[36] is also a Java testing tool which uses code based approach. It’s an open source tool which uses
builder pattern for test case generation.
Simons et. al.[37] proposed Jwalk tool which is an academic tool used for Java testing using code based
approach. It uses specification bases or random systematic technique for test case generation.
Boyapati et. al.[38] proposed Korat an open source tool for java source code testing which follows code
based approach. It uses constraint based techniques for test case generation.
Lurette[39] is an academic tool which uses model based approach and generation test sequences. It mainly
focuses on transition based coverage method.
Lutess tool presented by Bousquet et. al.[40] follows constraint based generation method and generates test
sequences. It’s an academic tool used for lutes sequence generation from environment model.
MISTA[41] is a model based testing tool which is used for testing different language programs such as Java,
PHP, C#,C,C++,Python.
Modbat[42] , a model based testing tool which uses random and stochastic search techniques for test cases
generation. It is open source tool , free to use but not to modified.
ModelJUnit[43] is an open source tool which takes UML models as input and generates class dependency
Graph. It focuses on Path coverage.
MoMut[44] , an academic tool which is used for test case generation from models. It uses UML state
machine, timed automata or Model specification transition code as input and search based and fault based
techniques for test case generation.
Albert et. al.[45] proposed PET, a code based testing tool which is used for white box testing uses Java
source code as input and generates test cases. It’s an academic tool which uses symbolic execution for test
case generation.
PEX tool presented by Tillmann et. al.[46], a code based testing tool applies dynamic symbolic execution for
test case generation. With this tool, parameterized unit test cases can be generated and resulting in high
coverage.
PICT [47] is a model based tool used for object oriented testing. It is an open source tool. It is used to
develop test cases and test configurations for system programs. PICT is a command line tool and used to
gain combinatorial coverage.
PragmaDev [48] is a Model and testing tool. It integrates four different tools such as SDL, TTCN-3, SDL-
RT and UML. It is used for symbolic execution and in gaining structural coverage in system program.
Pacheco et. al.[49] proposed Randoop, a code based tool which uses java source code as input and generates
unit test case as output. It is an open source tool. It uses feedback directed random test generation techniques.
Pacheco et. al.[50] & Pasareanu et. al.[52] advocated Symbolic path finder (SPF) tool which takes java byte
code as input. It is used to generate test cases automatically and check errors in java byte code program. In
SPF, symbolic execution with model checking is used to perform this work.

Page | 588
 International Journal of Electronics Engineering (ISSN: 0973-7383)
Volume 10 • Issue 2 pp. 586-596 June 2018-Dec 2018 www.csjournals.co m

Clarke et. al.[51] proposed STG a model based tool which generates test cases for LTS. This tool takes FSM
file as input and produces test paths as output. STG is an academic tool which uses NTIF language.
Prasetya et. al.[53] proposed T3, a code based tool used to test java programs. T3 is an open source tool
under GPL Ver. 3. Random dynamic testing is used to generate test cases for java programs.
Tcases[54] is an model based tool used for object oriented testing. Basically, XML files are taken as input
and junit test cases are generated as output. It is an open source tool used for black box testing to gain
structural coverage and constraints solving.
Muniz et. al.[55] presented TCG, a model based testing tool used for functional and statistical testing.
Techniques which are used in this tool are Search based , random Generation, and specification based. It’s an
open source tool and free to use.
Testcomposer[56] is a object oriented testing tool used for model driven application testing. It goes under the
commercial license. It can also be used for remote server procedures testing and local testing.
TestGen4j[57] , a code based tool which is used to test java programs. It takes java programs as input and
generated unit test cases as output. This tool basically focuses on boundary value analysis.
TGV[58] is model based test case generation tool which uses LOTOS files as input. This tool permits
generation of abstract test cases. It is an academic tool used for LTS.
Herout et. al.[59] proposed UMLTest, a model based tool used for object oriented testing. It focuses on
gaining path coverage by taking XML files as Input and generating test paths as output.
VERA [60] is a web based tool used for object oriented testing. This is an academic tool. In VERA, Search
based techniques are used for generation of test cases. Main focus of this tool is on Structural coverage.
The below is the summary presented in table 1 and following abbreviations are:
Column Headings: TT-Testing type, LS-Language Support, AL – Availability / License, TTM-Testing
Technique / Method.
Testing Types: MB- Model Based, CB- Code based, WB – Web Based.
Language Support type: OO- Object Oriented, P- Procedural, T- Test framework.
Input: JSC- Java Source Code, JBT- Java Byte Code, FBD – Function block diagram, MS – Model
Specifications, TF- .txt file, FSM- Finite State Machine, CSC- C Source Code, CLP – Constraint Logic
Program.

Table 1: Test generation tools

Tool Name TT LS Input Output Institution Domain AL Language
Sr. / Authors
No. TTM
AGEDIS MB OO MS Test cases A. Hartman and Desktop / Academic/ AGEDIS
K. Nagin, IBM downloada Commercia Modeling/
Research labs ble l /Research UML /AML
1 LTS
Agitar CB OO JSC Junit test M. Desktop Commercia Java
cases Boshernitsan, R. l
Doong, A.
Savoia, at
Agitator
Technologies

Observation
2 Driven
AgitarOne CB OO JSC Junit test Agitator Desktop Commercia Java Random
cases Technologies l Observation
3 Drived
ALLPAIRS WB OO TF Minimized James Bach Online web open source Python / .txt BVA,
Executable /Microsoft link file Equivalence
Test cases partitioning,
pairwise
combinations
method,
Combinatoria
l, black-box
4 testing
AsmL MB OO FSM Test case Microsoft Desktop Research AsmL
5 sequences Institute FSM
Austin CB P CSC test cases Desktop Open C
6 Source Search Based

Page | 589
 International Journal of Electronics Engineering (ISSN: 0973-7383)
Volume 10 • Issue 2 pp. 586-596 June 2018-Dec 2018 www.csjournals.co m

AutoFocus WB T CLP Packet Cristian Estan, Online Free for Autofocus

header University of downloada Academic
traces California, San ble purpose or
Diego research
purpose / Constrained
downloada Logic
7 ble Programming
AutoLink MB OO SDL, Complete Institute of Downloada Commercia Specification
MSC, TTCN test Telematics, ble l and
TTCN suite Germany Description
Language(S
DL),
Message
sequence
chart(MSC),
Tree and
Tabular
Combined formal
Notation(TT specification
8 CN) based
AutoTest CB OO C++ / editable test used and Desktop/ open- Python
JSC cases developed by a Downloada source
number of ble from project
organizations, GitHub / under the
including Linux GPL
Google, IBM,
Red Hat, and
many others
Code
coverage/pat
h coverage
9 based
C++Test CB OO C++ Unit tests Parasoft Desktop Commercia C++
Source l
& Random
binary Static
10 code Analysis
CATG CB OO JBC Test cases Kaushik Sen, Desktop Open Java
Symbolic
University of Source
execution,
Illinois BSD
Random
11 testing
CertifyIT MB OO FSM - Test cases Smart Testing - Windows / Commercia Search based,
UML CertifyIt offline l HTML/XML model
solution /Perl/Python / checking,
Java Structural
Coverage,
Test based
12 specifications
Class MB OO JBC Class NA / free Desktop Free Java
Visualizer Dependenc /Download
y Graph able
13 class base
CodePro CB OO JSC Junit test Google Inc. Desktop / Commercia Java
Analytix cases downloada l
ble
Random
14 /White Box
CompleteT MB OO FBD Abstract Malardalen Desktop Academic C / Java Model
est (uses test cases/ University checking,
UPPAAL executable Search based
model test cases in structural
15 checker) C / Java coverage
Conformiq MB OO Model Test scripts Conformiq team Downloada Commercia Java Script
of for ble l Path
SUT automated coverage
16 testing based
CPTG CB NA CSV Test cases Sompong Not NA NA
file Nakornburi et. available
al,
Chulalongkorn Pairwise
University, testcase
17 Thailand generation
CUTE CB P JSC Test cases K. Sen and G. Desktop Open C
Agha Source / Concolic /
Academic symbolic
18 & Research execution
Crest CB P C Test cases GitHub Team Desktop Open C Dynamic test
source Source generation /
code symbolic
19 execution
Daikon CB OO JSC Junit test Massachusetts Desktop Open Java
cases Institute of Source
Technology & Observation
20 University of Driven

Page | 590
 International Journal of Electronics Engineering (ISSN: 0973-7383)
Volume 10 • Issue 2 pp. 586-596 June 2018-Dec 2018 www.csjournals.co m

Washington

DART CB OO DART test cases Desktop Open DART /C

/C Object Source
source oriented
21 code Concolic
DIVERSIT MB OO xLIA(e Test cases European Open xLIA /
Y Xecuta in TTCN-3 Telecommunicat Source TTCN-3
ble ion Standards
Langu Institute)
age for
Interac
tion & Symbolic
Assem Transition
22 blage) based
EVOSUIT CB OO JSC / Junit test Research Project Desktop Academic Java
E JBC cases with by Dr. Gordon Research &
reduced test Fraser and Dr Open
suite Andrea Arcuri Source
LGPL
liscense
Search Based
23 GA
KLEE CB P C bit Test cases C. Cadar, D. Desktop Open C
code Dunbar, D. Source
Engler
24 Concolic
Findsbugs CB OO JBC Test data Eclipse Desktop Open Java Static
Source Analysis,
Unit /
Module
25 Testing
FMBT MB OO Model Test cases GitHub Team Desktop: Open AAL/Python,
s in Online / Source AAL/C++,
AAL/P offline AAL/Java
ython Linux
/Ubuntu
Search based,
structural
26 coverage
GATeL MB OO Luster Test Cases French Nuclear Downloada Academic Lustre
Model Research ble
Constrained
Agency (CEA)
logic
27 programming
GRT CB OO JSC / Junit test Leima, Cheng, Desktop Academic Java
JBC cases Hiroyuki, Research,
Johannes, Free
Rudolf Random
Static & Run
28 time Analysis
HTG MB OO Hybrid Test cases T. Dang Offline Academic C++ Random
automa in C++ generation
tion search based,
model Transition or
/ functional
SPICE based data
29 netlist coverage
Jcrasher CB OO JSC Test file Christoph and Desktop Academic Java
Yannis Research,
Open
Source,
Apache Robustness /
30 Liscence random
jCUTE CB OO JSC Unit Tests Kaushik Sen, Desktop Open Java
Search Based
University of Source
Concolic
Illinois
Symbolic
31 Execution
JMT CB OO JSC / OO Metrics Java
32 JBC
jPET CB OO JSC / test cases Linux Closed Java
JBC Desktop source / Symbolic
33 commercial Execution
JTest CB OO JSC Junit test Parasoft Desktop & Commercia Java White Box &
cases Server l Static
34 Analysis
JTExpert CB OO JSC Whole test Abedelilah Desktop Academic Java
suite Sakti, Gilles Research,
Pesant, Yann- Free
gael, Gueheneuc

35 Search Based
JUnit CB OO JSC Executable Desktop Open Java Builder
36 Test cases Source pattern

Page | 591
 International Journal of Electronics Engineering (ISSN: 0973-7383)
Volume 10 • Issue 2 pp. 586-596 June 2018-Dec 2018 www.csjournals.co m

Jwalk CB OO JSC Test report University of Desktop Academic Java Specification

Sheffleld Research Based /
Random
37 Systematic
Korat CB OO JSC Test traces C. Boyapati, S. Desktop Open Java
Khurshid, and Source
Constraint
D. Marinov
Based
38 Generation
Lurette MB OO Lustre Test Team of Online Academic Lutin
Sequen sequences Verimag Group
ce
generat
ed
from
Enviro Transition
nment based
39 Model coverage
Lutess MB OO Lutess Test Team of Downloada Academic Lustre
Sequen sequences Verimag Group ble
ce
generat
ed
from
Enviro Constraint
nment Based
40 Model Generation
MISTA MB OO Model Test cases GitHub Team Online / Open Java, C, C++, Operational,
Specifi offline Source C#, PHP, Transition
cation Python, based,structu
transiti HTML, and al coverage,
on VB Search
code( Based,
.xmid random
41 file) generation
Modbat MB OO EFSM Sequences Cyrille Artho, Open EFSM /
of method Armin Biere Source / Scala Based Random &
calls free to use domain Stochastic
bu not to be specific based
42 modified language Search, FSM
ModelJUnit MB OO UML Class GitHub Team Downloada open source Java Path
Model Dependenc ble coverage
43 y Graph based
MoMuT MB OO Model Test cases Austrian Offline Academic UML State
Specifi from Institute of charts,
cation models Technology, Action
transiti systems,
on Timed
code, Automata,
UML Assume-
state Guarantee Search
machin Contracts Based,
e, Mutation /
Timed Fault based
automa test case
44 ta generation
PET CB OO JBC Test cases Elvira and Desktop Academic Java Symbolic
Miguel Research, execution,
45 Free white Box
PEX / CB OO C# parametrize Microsoft Windows Academic / .NET C#
INTELLIT .NET d unit tests Liscensed / Desktop Commercia
Dynamic
EST code closed source l
Symbolic
46 Execution
PICT MB OO parame Test Cases Microsoft / Desktop Open Perl
ter and Test GitHub source
value Configurati
choice ons
s Test Combinatoria
47 Cases l Testing
PragmaDev MB OO MBT Test cases PRAGMADEV Windows, Commercia TTCN-3 / C / Symbolic
Model in TTCN-3 SARL, Paris Linux, and l /Free C++/SDL execution,
s in ,France Mac Version Structural
SDL small MBT Coverage,
projects Random and
48 Stochastic
Randoop CB OO JSC Unit test MIT CSAIL Desktop Open Java Feedback
Suite Source directed
random Unit
49 Test Suite
SPF (uses CB OO JBC Test paths GitHub Team Desktop Open Java
javaPathFin Source
der for Symbolic
50 execution) Execution

Page | 592
 International Journal of Electronics Engineering (ISSN: 0973-7383)
Volume 10 • Issue 2 pp. 586-596 June 2018-Dec 2018 www.csjournals.co m

STG MB OO LTS / Test paths STG Downloada Academic NTIF

FSM ble
51 file LTS
Symbolic MB OO JSC Test Cases Microsoft / Web Open Java
Path Finder NASA Application Source
Software, Symbolic
used at execution,
NASA free Model
52 for research Checking
T3 CB OO JSC Test suite Wisnuprasetya Desktop Open Java Random
Source dynamic
53 GPL Ver. 3 testing
Tcases MB OO XML Junit test Maven Central Desktop Open XML / Java Black box,
file of cases Repository:Corn Source structural
SUT utum Project Coverage,
Constraints
54 solving
TCG - MB OO mealy Test Cases Microsoft Windows Open FSM Search based,
Plugin of machin from both source / random
LoTuS e probabilisti Free generation,
c and non- Specification
probabilisti based,
c Models pairwise
55 testing
TestCompo MB OO FSM Test Paths Canam Software Windows Commercia SDL
ser model Labs l
specifi
cations
56 in SDL LTS/EFSM
TestGen4J CB OO JSC Unit Test Java Source Inc Desktop Open Java Boundary
57 cases Source level
TGV - MB OO LOTO Test cases Verimag Windows Academic LTS-
plugin for S file API(LOTOS,
LoTuS SDL,UML)
58 LTS
UMLTest MB OO XML Test paths GitHub Team Desktop Open XML
file of Source
SUT (
UML
class Path
diagra coverage
59 m) based
VERA WB OO EFSM Test cases Vera’s offices Windows Academic FSM, XML
Search
,California /Linux
Based,
/Unix
Structural
60 Coverage

The above table data is helpful for the researchers, for selecting the tool as per testing type, input or output
format required, institution or authors, domain like desktop or downloadable or online available, type e.g.
academic / open source or commercial, object oriented or procedural, method or technique.
Analysis of study
A. Object Oriented Tools
The percentage of object-oriented(OO) and other tools selected in this paper are shown in below fig 1. This
study considered the maximum tools which support OO languages. The most of the tools available for OO
testing are java language support tools. The other tools include P-procedural language support tools, T-Test
framework, NA- not applicable.

Page | 593
 International Journal of Electronics Engineering (ISSN: 0973-7383)
Volume 10 • Issue 2 pp. 586-596 June 2018-Dec 2018 www.csjournals.co m

The percentage of OO and other Tools

100

% age of tools
50
0
OO P T
NA

OO P T NA
Series1 91.666 0.05 0.016667 0.016667

Figure 1. The percentage of OO and other tools

B. Test Case Generation Tools based on Testing Type

Based on the type of testing e.g. model based, web based and code based input type, the above tools listed
in table 1 are in the percentage as shown in below fig. 2.

Percentage of MB,WB & CB Tools

60
50
Percentage

40
30
20
10
0
MB CB WB
Series1 43.333 51.667 0.05

Figure 2. The percentage of OO and other tools

C. Test Case Generation Tools Availablebity

The tools available open source or free for academic / research purposes or commercial are as shown in
below fig. 3.

0.25

46.67
0.25
28.33

Academic Open Source Commercial

Figure 3. The percentage of OO and other tools

Page | 594
 International Journal of Electronics Engineering (ISSN: 0973-7383)
Volume 10 • Issue 2 pp. 586-596 June 2018-Dec 2018 www.csjournals.co m

Conclusion and Future Work

In this paper a comprehensive study of various test case generation tools have been presented. In the study
the percentage of object oriented test case generation tools indicated that there are a good number of tools
available in the field of object oriented testing. The academic researchers are working progressively as the
academic tools are 28.33%. The open source tools (46.67%) are available freely to the researchers. Further,
the commercial tools are available as 0.25 %, this indicated that commercial tools are not much in use.
References

[1]. P. P. Mahadik and D.M. Thakore, “Survey on automatic test data generation tools and techniques for object
oriented code”, international journal of innovative research in computer and communication engineering, 2016,
4(1), pp. 357-364.
[2]. A. Hartman, K. Nagin, "The AGEDIS Tools for Model Based Testing”, LNCS, 2004, vol 3297. Springer, Berlin,
Heidelberg.
[3]. M. Boshernitsan, R. Doong, A. Savoia (2006) "From Daikon to Agitator: lessons and challenges in building a
commercial tool for developer testing", In Proc. of ISSTA '06, pp. 169-180. DOI: 10.1145/1146238.1146258
[4]. ALLPAIRS:https://allpairs.soft112.com/
[5]. M. Barnett, et.al.(2004), "Towards a Tool Environment for Model-Based Testing with AsmL", LNCS, vol 2931.
Springer, Berlin, Heidelberg.
[6]. K. Lakhotia, M.Harman, H. Gross, "AUSTIN: A tool for Search Based Software Testing for the C Language and
itsEvaluation on Deployed Automotive Systems", 2nd International Symposium on Search Based Software
Engineering, 2010,pp. 101-110. DOI: 10.1109/SSBSE.2010.21
[7]. J. Romberg, J. Jurjens, G. Wimmel, O. Slotosch and G. Hahn, "AutoFOCUS and the MoDe tool," Third
International Conference on Application of Concurrency to System Design, 2003. Proceedings., Guimaraes,
Portugal, 2003, pp. 249-250. doi: 10.1109/CSD.2003.1207727
[8]. B. Koch, J. Grabowski, D. Hogrefe and M. Schmitt, "Autolink-a tool for automatic test generation from SDL
specifications," Proceedings. 2nd IEEE Workshop on Industrial Strength Formal Specification Techniques, Boca
Raton, FL, USA, 1998, pp. 114-125. doi: 10.1109/WIFT.1998.766305
[9]. B. Meyer et al. (2009) "Programs That Test Themselves," Computer, vol. 42, 2009, pp. 46-55. DOI:
10.1109/MC.2009.296
[10]. C++Test: https://www.parasoft.com/products/ctest.
[11]. Tanno, X Zhang, T Hoshino, K Sen ,”TesMa and CATG: automated test generation tools for models of enterprise
applications”, proceedings of the 37th International Conference on Software Engineering.
[12]. Smartesting CertifyIt. http://www.smartesting.com/en/certifyit/
[13]. ClassVisualizer: https://www.class-visualizer.net/
[14]. Google Inc.,” Codeproanalytix user guide”, available at: http://developers.google.com/java-dev-
tools/codepro/doc/.
[15]. CompleteTest. http://www.completetest.org/about/
[16]. Conformiq: https://www.verifysoft.com/en_conformiq_automatic_test_generation.html
[17]. S. Nakornburi and T. Suwannasart, "A tool for constrained pairwise test case generation using statistical user
profile based prioritization," 2016 13th International Joint Conference on Computer Science and Software
Engineering (JCSSE), Khon Kaen, 2016, pp. 1-6. doi: 10.1109/JCSSE.2016.7748881
[18]. K. Sen, G. Agha,"CUTE and jCUTE: Concolic Unit Testing and Explicit Path Model-Checking Tools," Computer
Aided Verification. CAV 2006, LNCS, vol 4144. Springer, Berlin, Heidelberg.
[19]. J. Burnim and K. Sen (2008) "Heuristics for Scalable Dynamic Test Generation," In Proc. ASE'08, IEEE, pp. 443-
446. DOI: 10.1109/ASE.2008.69
[20]. Daikon: https://plse.cs.washington.edu/daikon/
[21]. P. Godefroid, N. Klarlund, and K. Sen. (2005) "DART: directed automated random testing." In Proc. PLDI '05.
ACM, pp. 213-223. DOI: 10.1145/1065010.1065036
[22]. Eclipse Formal Modeling Project(DIVERSITY). https://projects.eclipse.org/proposals/eclipse-formalmodeling-
project
[23]. G. Fraser and A. Arcuri (2013) "Whole Test Suite Generation," IEEE Trans. on Software Engineering, vol. 39, iss.
2, pp. 276-291. DOI: 10.1109/TSE.2012.14.
[24].C. Cadar, D. Dunbar, D. Engler (2008) "KLEE: Unassisted and Automatic Generation of High-Coverage Tests for
Complex Systems Programs." In Proc. of OSDI'08, pp. 209-224.
[25]. Findsbugs: http://findbugs.cs.umd.edu/eclipse/
[26]. FMBT. https://01.org/fmbt/
[27]. GATeL: https://www.ercim.eu/publication/Ercim_News/enw58/blanc.html
[28]. L. Ma, C. Artho, C. Zhang, H. Sato, J. Gmeiner and R. Ramler,” GRT: Program-Analysis-Guided Random
Testing”, to appear in Int'l Conf. Automated Software Engineering 2015, Nov. (Distinguished Paper Award), 212-
223.
[29]. HTG. https://sites.google.com/site/htgtestgenerationtool/home
[30]. C. Csallner and Y. Smaragdakis (2004) "JCrasher: An automatic robustness tester for Java," Software -- Practice ∧
Experience, vol. 34, no. 11, pp. 1025-1050. DOI: 10.1002/spe.602
[31]. Cute: https://cute-test.com/

Page | 595
 International Journal of Electronics Engineering (ISSN: 0973-7383)
Volume 10 • Issue 2 pp. 586-596 June 2018-Dec 2018 www.csjournals.co m

[32]. JMT: http://jmt.sourceforge.net/Download.html

[33]. E. Albert, I. Cabanas, A. Flores-Montoya, M. Gomez-Zamalloa, and S. Gutierrez," jPET: An Automatic Test-Case
Generator for Java", In Proceedings of the 2011 18th Working Conference on Reverse Engineering (WCRE '11).
IEEE Computer Society, Washington, DC, USA, 441-442. DOI: https://doi.org/10.1109/WCRE.2011.67
[34]. Parasoft, “Jtest: Java unit testing and code compliance-Parasoft”,2007. http://www.parasoft.com
/jsp/products/home.jsp?product=Jtest.
[35]. A. Sakti, G. Pesant, Y.-G. Guéhéneuc (2015) "Instance Generator and Problem Representation to Improve Object
Oriented Code Coverage," in Software Engineering, IEEE Transactions on, vol.41, no.3, pp.294-313. DOI:
10.1109/TSE.2014.2363479
[36]. JUnit. http://junit.org/junit4/
[37]. Simons, A. J. H.,” JWalk: a tool for lazy systematic testing of Java classes by design introspection and user
interaction”, 2007, Software. Eng., 14 (4), Springer USA (2007), 369-418.
[38]. C. Boyapati, S. Khurshid, and D. Marinov (2002) "Korat: Automated testing based on Java predicates", In Proc.
ISSTA'02, pp. 123-133. DOI: 10.1145/566172.566191
[39]. Lurrette. http://www-verimag.imag.fr/Lurette,107.html
[40]. L. du Bousquet and N. Zuanon, "An overview of Lutess a specification-based tool for testing synchronous
software," 14th IEEE International Conference on Automated Software Engineering, Cocoa Beach, FL, USA,
1999, pp. 208-215.doi: 10.1109/ASE.1999.802255
[41]. MISTA - Model-Based Testing. http://cs.boisestate.edu/~dxu/research/MBT.html
[42]. Modbat. https://people.kth.se/~artho/modbat/
[43]. ModelJUnit: https://sourceforge.net/projects/modeljunit/
[44]. Momut. https://momut.org/
[45]. E. Albert, M. Gomez-Zamalloa, and G. Puebla, "PET: A Partial Evaluation-based Test Case Generation Tool for
Java Byte code”, 2010, In Proc. PEPM, ACM, pp. 25-28. DOI: 10.1145/1706356.1706363.
[46]. N. Tillmann and J. de Halleux (2008) "Pex -- White Box Test Generation for .NET," In Prof. TAP'08, Springer,
pp. 134-153. DOI: 10.1007/978-3-540-79124-9_10
[47]. PICT: https://github.com/Microsoft/pict
[48]. PragmaDev - Modeling and Testing tools. http://pragmadev.com/
[49]. C. Pacheco and M. D. Ernst,” Randoop: Feedback-Directed Random Testing for Java” 2007, In OOP-SLA 2007:
Conference on Object Oriented Programming Systems Languages and Applications, ACM.
[50]. C. Pacheco, S. Lahiri, M. Ernst, T. Ball, “ Feedback-directed random test generation”, Int. Conf. on Software
Engineering, ICSE’07, 2007; 75–84, doi:10.1109/ICSE.2007.37.
[51]. D. Clarke, T. Jéron, V. Rusu, and E. Zinovieva. 2001. STG: a tool for generating symbolic test programs and
oracles from operational specifications. In Proceedings of the 8th European software engineering conference held
jointly with 9th ACM SIGSOFT international symposium on Foundations of software engineering (ESEC/FSE-9).
ACM, New York, NY, USA, 301-302. DOI: https://doi.org/10.1145/503209.503252
[52]. C. S. Pasareanu et al, "Symbolic PathFinder: integrating symbolic execution with model checking for Java
bytecode analysis," 2013, Automated Software Engineering 20:3, pp 391-425. DOI: 10.1007/s10515-013-0122-2.
[53]. W.B. Prasetya,”T3i: A Tool for Generating and Querying Test Suites for Java”, 10th Joint Meeting of the
European Software Engineering Conference (ESEC) and the ACM SIGSOFT Symposium on the Foundations of
Software Engineering (FSE), ACM, 2015.
[54]. Tcases. https://github.com/Cornutum/tcases
[55]. Muniz, L.L., Netto, U.S., Maia, P.H.M.: TCG: a model-based testing tool for functional and statistical testing. In:
ICEIS 2015-Proceedings of the 17th International Conference on Enterprise Information Systems, pp. 404–411
(2015)
[56]. Testcomposer:http://www.canamsoftware.com/Products/CAGenSolutions/TestComposer%E2%84%A2/
Overview.aspx
[57]. TestGen4j: https://sourceforge.net/projects/spike-test-gen/
[58]. LoTuS: https://www.ibm.com/developerworks/topics/lotus%20notes%20plugins
[59]. P. Herout and P. Brada, "UML-Test Application for Automated Validation of Students' UML Class Diagram,"
2016 IEEE 29th International Conference on Software Engineering Education and Training (CSEET), Dallas, TX,
2016, pp. 222-226. doi: 10.1109/CSEET.2016.33
[60].Vera. http://www.spacios.eu/index.php/spacios-tool/

Page | 596

View publication stats