A Comparative study on Automation Testing Tools:

Selenium and TestComplete

1st Umair Mushtaq 2nd Muhammad Umer 3rd Jahanzaib Tariq
dept. Software Engineering dept. Software Engineering dept. Software Engineering
University of Gujrat, Sialkot Campus University of Gujrat, Sialkot Campus University of Gujrat, Sialkot Campus

4th Maryam Nawaz

dept. Software Engineering
University of Gujrat, Sialkot Campus

Abstract—The purpose of our research is to conduct a survey formance, reliability and security testing which are classied
and comparative study of the different testing tools available by purpose and are classied into [3]. TestComplete is easy
in market to ensure the quality of software products which to use and has a good impact for those applications that
will help the professional in order to fulll the business needs
and requirements. Keeping in this mind, there exist many requires less security and similarly We performed automated
differences and similarities between these testing tools that have testing of web based applications through Selenium and Test-
been compared based on their different attributes like Operating Complete. Model based testing refers generating test cases
system, Language, license supports etc. Since many researches automatically. It is based on test generations, test strategies
already have been done but we are interested to present taxonomy and techniques. [4] It allows the generation of adequate test
of different testing tools and performing their comparison.
Index Terms—Automation Testing, Selenium, TestComplete cases. We performed a comparison study on the performance
of various testing tools such as TestComplete, Selemium and
I. I NTRODUCTION their performance results are evaluated in different browsers.
Basically performance testing is a nonfunctional type of testing
Software testing is a process to verify whether the outcome
to ensure speed, reliability, stability, and scalability of system.
of an input match the expected results and to ensure that the
The same website has been used to check the performance
developed system is error free. Testing can be performed in
under these performance tools and their results has been
two ways: Manual Testing and Automation Testing (our focus
compared to select the best tool among them. We described
is going to be on this type). Manual testing is done by a person
the comparative study of automated testing tools like Selenium
sitting in front of a system carefully executing the test cases
and TestComplete and their performed is determine based on
manually. It can be time consuming and costly. Sometimes
Efciency, Licensing Costs, Application Support, Usage, etc.
tester can get frustrated [1].On the other hand, automation
TestComplete and Selenium has been compared and evaluated.
testing is totally different. It is performed using automation
tools which are available on internet. Some tools are free III. T OOLS USED FOR T ESTING
but most of them are paid. Automation tools can also enter A. Selenium
test data into the system under test, compare expected and
actual results and generate detailed test reports. Automation Selenium IDE is a free and open source add-on for Firefox
testing reduce number of test case and eliminate manual testing web browser. [5] Selenium supports a variety of languages
altogether. We are going to perform automation testing on that include Java, Python, PHP, C-Sharp, Ruby and even pure
a web application and then we shall verify the results of JavaScript. Selenium is at present the most powerful Open
that tests [2]. Web application are those which runs on web Source Automation tool available and it is based on java script-
browsers. The tools which we are going to use in this research ing to a large extent. It is more suited for agile methodology of
are: TestComplete and Selenium. We will test our application coding and testing. [6] In this paper we analyzed the Integrated
with all the tools mentioned above and then we are going to Development Environment of Selenium, a software testing
compare the results. After that we will generate the report of tool and also performed functional testing of web application
results that we achieved. And at the end we will conclude our www.1337x.to.
research. B. TestComplete
II. L ITERATURE R EVIEW TestComplete is an automated UI testing tool that makes
The different strategies for software testing tools that can it fast and easy to create, maintain, and execute functional
be used to efficiently test the software like correctness, per- tests across desktop, web, and mobile applications. With
TestComplete, you can increase test coverage and ensure you
Identify applicable funding agency here. If none, delete this. ship high-quality, battle-tested software. [7]
 TABLE I
C OMPARISON FEATURES OF S ELENIUM AND T EST C OMPLETE

Features Selenium TestComplete

License Cost Open source and free of cost Open source
Client server applications (like built in TCL/TK
Application Support Web Apps only
and PowerBuilder)
Browser Support Support IE, Chrome and firefox Supports only IE and Firefox
Operating System Windows, Mac, UNIX Windows Platform only.
Object Oriented Language Support Java, .Net, Perl, PHP, Python Supports VBScript or JavaScript.
Usage Need a quite expertise Easy to learn.
Technical Support No official technical support Good technical support via phone, mail, web forum.
Test scripts can be developed in various IDEs
Test Development Support Developed only in QTP.
like Eclipse, Visual Studio, Net beans, etc.
Support for File Upload Not Available Supports all kinds of File upload
Database Application Not so convenient Very well with Database applications.
Integration with Jenkins can give good
Report Generation Quality Center has built-in dashboards.
reporting.

R EFERENCES
[1] Harman, Mark, Yue Jia, and Yuanyuan Zhang. ”Achievements, open
problems and challenges for search based software testing.” 2015 IEEE
8th International Conference on Software Testing, Verification and
Validation (ICST). IEEE, 2015.
[2] Takanen, Ari, et al. Fuzzing for software security testing and quality
assurance. Artech House, 2018.
[3] Ahmed, Tarek M., et al. ”Studying the effectiveness of application
performance management (APM) tools for detecting performance re-
gressions for web applications: an experience report.” Proceedings of the
13th International Conference on Mining Software Repositories. ACM,
2016.
[4] Khan, Mohd Ehmer. ”Different forms of software testing techniques for
finding errors.” International Journal of Computer Science Issues (IJCSI)
7.3 (2010): 24.
[5] Kaur, Harpreet, and Gagan Gupta. ”Comparative study of automated
testing tools: selenium, quick test professional and testcomplete.” Int.
Journal of Engineering Research and Applications 3.5 (2013): 1739-
1743.
[6] Razak, Rosnisa Abdull, and Fairul Rizal Fahrurazi. ”Agile testing with
Selenium.” 2011 Malaysian Conference in Software Engineering. IEEE,
2011.
[7] Kaur, Manjit, and Raj Kumari. ”Comparative study of automated testing
tools: Testcomplete and quicktest pro.” International Journal of Com-
puter Applications 24.1 (2011): 1-7.