What is Web Usage Mining?
Last Updated :
02 Oct, 2022
Web usage mining, a subset of Data Mining, is basically the extraction of various types of interesting data that is readily available and accessible in the ocean of huge web pages, Internet- or formally known as World Wide Web (WWW). Being one of the applications of data mining technique, it has helped to analyze user activities on different web pages and track them over a period of time. Basically, Web Usage Mining can be divided into 2 major subcategories based on web usage data.
There are 3 main types of web data:
1. Web Content Data: The common forms of web content data are HTML, web pages, images audio-video, etc. The main being the HTML format. Though it may differ from browser to browser the common basic layout/structure would be the same everywhere. Since it’s the most popular in web content data. XML and dynamic server pages like JSP, PHP, etc. are also various forms of web content data.
2. Web Structure Data: On a web page, there is content arranged according to HTML tags (which are known as intrapage structure information). The web pages usually have hyperlinks that connect the main webpage to the sub-web pages. This is called Inter-page structure information. So basically relationship/links describing the connection between webpages is web structure data.
3. Web Usage Data: The main source of data here is-Web Server and Application Server. It involves log data which is collected by the main above two mentioned sources. Log files are created when a user/customer interacts with a web page. The data in this type can be mainly categorized into three types based on the source it comes from:
- Server-side
- Client-side
- Proxy side.
There are other additional data sources also which include cookies, demographics, etc.
Types of Web Usage Mining based upon the Usage Data:
1. Web Server Data: The web server data generally includes the IP address, browser logs, proxy server logs, user profiles, etc. The user logs are being collected by the web server data.
2. Application Server Data: An added feature on the commercial application servers is to build applications on it. Tracking various business events and logging them into application server logs is mainly what application server data consists of.
3. Application-level data: There are various new kinds of events that can be there in an application. The logging feature enabled in them helps us get the past record of the events.
Advantages of Web Usage Mining
- Government agencies are benefited from this technology to overcome terrorism.
- Predictive capabilities of mining tools have helped identify various criminal activities.
- Customer Relationship is being better understood by the company with the aid of these mining tools. It helps them to satisfy the needs of the customer faster and efficiently.
Disadvantages of Web Usage Mining
- Privacy stands out as a major issue. Analyzing data for the benefit of customers is good. But using the same data for something else can be dangerous. Using it within the individual’s knowledge can pose a big threat to the company.
- Having no high ethical standards in a data mining company, two or more attributes can be combined to get some personal information of the user which again is not respectable.
Some Techniques in Web Usage Mining
1. Association Rules:The most used technique in Web usage mining is Association Rules. Basically, this technique focuses on relations among the web pages that frequently appear together in users’ sessions. The pages accessed together are always put together into a single server session. Association Rules help in the reconstruction of websites using the access logs. Access logs generally contain information about requests which are approaching the webserver. The major drawback of this technique is that having so many sets of rules produced together may result in some of the rules being completely inconsequential. They may not be used for future use too.
2. Classification: Classification is mainly to map a particular record to multiple predefined classes. The main target here in web usage mining is to develop that kind of profile of users/customers that are associated with a particular class/category. For this exact thing, one requires to extract the best features that will be best suitable for the associated class. Classification can be implemented by various algorithms – some of them include- Support vector machines, K-Nearest Neighbors, Logistic Regression, Decision Trees, etc. For example, having a track record of data of customers regarding their purchase history in the last 6 months the customer can be classified into frequent and non-frequent classes/categories. There can be multiclass also in other cases too.
3. Clustering: Clustering is a technique to group together a set of things having similar features/traits. There are mainly 2 types of clusters- the first one is the usage cluster and the second one is the page cluster. The clustering of pages can be readily performed based on the usage data. In usage-based clustering, items that are commonly accessed /purchased together can be automatically organized into groups. The clustering of users tends to establish groups of users exhibiting similar browsing patterns. In page clustering, the basic concept is to get information quickly over the web pages.
Applications of Web Usage Mining
1. Personalization of Web Content: The World Wide Web has a lot of information and is expanding very rapidly day by day. The big problem is that on an everyday basis the specific needs of people are increasing and they quite often don’t get that query result. So, a solution to this is web personalization. Web personalization may be defined as catering to the user’s need-based upon its navigational behavior tracking and their interests. Web Personalization includes recommender systems, check-box customization, etc. Recommender systems are popular and are used by many companies.
2. E-commerce: Web-usage Mining plays a very vital role in web-based companies. Since their ultimate focus is on Customer attraction, customer retention, cross-sales, etc. To build a strong relationship with the customer it is very necessary for the web-based company to rely on web usage mining where they can get a lot of insights about customer’s interests. Also, it tells the company about improving its web-design in some aspects.
3. Prefetching and Catching: Prefetching basically means loading of data before it is required to decrease the time waiting for that data hence the term ‘prefetch’. All the results which we get from web usage mining can be used to produce prefetching and caching strategies which in turn can highly reduce the server response time.
Similar Reads
What is Web Performance?
Web performance encompasses how the website operates and the performance of the operations that are intended for the users. In today’s world filled with high-speed technologies, a slow website results in unsatisfied audiences, loss of traffic, and even some harm to your brand. It also leads to impro
7 min read
What is a Progressive Web App (PWA)?
A Progressive Web App (PWA) is a type of web application that uses modern web technologies to provide a user experience similar to that of a native mobile application. PWAs are designed to work seamlessly across various devices and browsers, offering a responsive and engaging user interface. They co
2 min read
Why we should use ASP.NET?
ASP.NET is a web framework designed by Microsoft Inc. that is extensively used to build robust web applications. In this article, we will analyze why ASP.NET should be chosen over other accessible web frameworks. Following are some main advantages of ASP.NET which makes it better than other framewor
2 min read
Web 4.0 - Intelligent Web
Web 4.0 represents the next evolution of the Internet where artificial intelligence, machine learning and advanced technologies work together to create a smarter, more intuitive online experience. Unlike previous versions of the web which focused primarily on connectivity and user-generated content.
5 min read
Web Scripting and its Types
The process of creating and embedding scripts in a web page is known as web-scripting. A script or a computer-script is a list of commands that are embedded in a web-page normally and are interpreted and executed by a certain program or scripting engine. Scripts may be written for a variety of purpo
2 min read
What is HTML5 Modernizr ?
In today's modern world, There are many features available in HTML and CSS and also very few browsers support all features. Sometimes it's a very difficult task to find is our web browser will support these features or not. So, here Modernizr comes into the picture it is very useful in these scenari
2 min read
Introduction to Web Scraping
Web scraping is a technique to fetch data from websites. While surfing on the web, many websites prohibit the user from saving data for personal use. This article will brief you about What is Web Scraping, Uses, Techniques, Tools, and challenges of Web Scraping. Table of Content What is Web Scraping
6 min read
Various terms in Data Mining
Data mining has applications in multiple fields like science and research. It is a prediction based on likely outcomes. Its focuses on the last data set. Data mining is the procedure of mining knowledge from data. The knowledge extracted so can be used for any of the following applications such as p
3 min read
Web crawling with Python
Web crawling is widely used technique to collect data from other websites. It works by visiting web pages, following links and gathering useful information like text, images, or tables. Python has various libraries and frameworks that support web crawling. In this article we will see about web crawl
4 min read
Explain Web Worker in HTML
HTML is a Markup language that is used to design web pages and JavaScript is a programming language that enables dynamic interactivity on websites when it is applied to an HTML. It helps users to build modern web applications. But the problem with this JavaScript was designed to run in a single-thre
4 min read