# What is Big Data
# What is Big Data
Variety refers to heterogeneous sources and the nature of data, both structured and
unstructured. During earlier days, spreadsheets and databases were the only sources of data
considered by most of the applications. Nowadays, data in the form of emails, photos, videos,
monitoring devices, PDFs, audio, etc. are also being considered in the analysis applications.
This variety of unstructured data poses certain issues for storage, mining and analyzing data.
# What is Big Data? Introduction, Types,
Characteristics, Examples
(iii) Velocity – The term ‘velocity’ refers to the speed of generation of data. How fast the
data is generated and processed to meet the demands, determines real potential in the
data.
Big Data Velocity deals with the speed at which data flows in from sources like business
processes, application logs, networks, and social media sites, sensors, Mobile devices, etc.
The flow of data is massive and continuous.
(iv) Variability – This refers to the inconsistency which can be shown by the data at times,
thus hampering the process of being able to handle and manage the data effectively.
# Advantages Of Big Data Processing
i. Improved Decision Making: Provides more accurate and timely decisions based
on comprehensive data analysis.
ii. Cost Reduction: Big data tools can reduce costs through more efficient storage
and processing.
iii. Better customer service: Enables personalized recommendations and better user
experience.
iv. Competitive Advantage: Organizations that can process and analyze big data can
gain insights that give them competitive edge.
v. Innovation: The ability to analyze big data allows for the development of new
products, services, and business models.
#
Big Data does not take care of how much data is there, but how it can be used. Data can be taken
from various sources for analyzing it and finding answers which enable:
i. • Reduction in cost.
1) Rapid Data Growth: The growth velocity at such a high rate creates a problem
to look for insights using it. There no 100% efficient way to filter out relevant
data.
2) Storage: The generation of such a massive amount of data needs space for
storage, and organizations face challenges to handle such extensive data
without suitable tools and technologies.
3) Unreliable Data: It cannot be guaranteed that the big data collected and
analyzed are totally (100%) accurate. Redundant data, contradicting data, or
incomplete data are challenges that remain within it.
4) Data Security: Firms and organizations storing such massive data (of users) can
be a target of cybercriminals, and there is a risk of data getting stolen. Hence,
encrypting such colossal data is also a challenge for firms and organizations.
# Introduction to Big Data platform
A big data platform is a comprehensive system designed to process, store, and analyze large
volumes of data that exceed the capabilities of traditional databases. These platforms integrate
a wide range of technologies, including data storage, processing engines (like Hadoop or
Spark), and tools for data analytics and visualization.
1. Big data platform is a type of IT solution that combines the features and
capabilities of several big data application and utilities within a single solution.
2. It is an enterprise class IT platform that enables organization in developing,
deploying, operating and managing a big data infrastructure/ environment.
3. Big data platform generally consists of big data storage, servers, database, big data
management, business intelligence and other big data management utilities.
4. It also supports custom development, querying and integration with other
systems.
5. The primary benefit behind a big data platform is to reduce the complexity of
multiple
vendors/ solutions into a one cohesive solution.
6. Big data platform are also delivered through cloud where the provider provides an
all inclusive big data solutions and services.
# Features of Big Data analytics platform
1. Big Data platform should be able to accommodate new platforms and tool based on
the business requirement.
7. It should have tools for searching the data through large data sets.
# Why there is need of data analytics ?