04 - Data Management, Big Data, and Business Intelligence
04 - Data Management, Big Data, and Business Intelligence
Management
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Learning Objectives
Data
Database
Warehouse
Management
and Big Data
Systems
Analytics
Electronic
Data and Text
Records
Mining
Management
Business
Intelligence
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
• Databases
– Collections of data sets or records stored in a
systematic way.
– Stores data generated by business apps, sensors,
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
• Data Warehouses
– Integrate data from multiple databases and data silos,
and organize them for complex analysis, knowledge
discovery, and to support decision making.
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
• Data Marts
– Small-scale data warehouses that support a single
function or one department.
– Enterprises that cannot afford to invest in data
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
• Business intelligence (BI)
– Tools and techniques that process data and conduct
statistical analysis for insight and discovery.
– Used to discover meaningful relationships in the data,
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
• Database Management System (DBMS)
– Integrate with data collection systems such as TPS and
business applications.
– Stores data in an organized way.
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
• Relational Management System (DBMS)
– Provides access to data using a declarative language.
• Declarative Language
– Simplifies data access by requiring that users only
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
• DBMS Functions
– Data filtering and profiling
– Data integrity and maintenance
– Data synchronization
Chapter 3
– Data security
– Data access
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
Online Transaction Processing and Online Analytics
Processing
• Online Transaction Processing (OLTP)
– Designed to manage transaction data, which are
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
• DBMSs (mid-2014)
– Oracle’s MySQL
– Microsoft’s SQL Server
– PostgreSQL
Chapter 3
– IBM’s DB2
– Teradata Database.
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
• Trend Toward NoSQL Systems
– Higher performance
– Easy distribution of data on different nodes
• enables scalability and fault tolerance
Chapter 3
– Greater flexibility
– Simpler administration
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
Centralized and Distributed Database Architecture
• Centralized Database Architecture
– Better control of data quality.
– Better IT security.
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
Garbage In, Garbage Out
• Dirty Data
– Lacks integrity/validation and reduces user trust.
Chapter 3
Cost to Cost to
Cost of Poor Lost
Prevent Correct
Quality Data Business
Errors Errors
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
• Principle of Diminishing Data Value
– The value of data diminishes as they age.
– Blind spots (lack of data availability) of 30 days or
longer inhibit peak performance.
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
• Principle of data in context
– The capability to capture, process, format, and
distribute data in near real time or faster requires a
huge investment in data architecture.
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
Data Life Cycle
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Database Management Systems
1. Describe a database and a database management system
(DBMS).
2. Explain what an online transaction-processing (OLAP)
system does.
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Learning Objectives
Data
Database
Warehouse
Management
and Big Data
Systems
Analytics
Electronic
Data and Text
Records
Mining
Management
Business
Intelligence
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data Warehouse and Big Data
Analytics
• Market share
– Percentage of total sales in a market captured by a
brand, product, or company.
• Operating Margin
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data Warehouse and Big Data
Analytics
TORTURE DATA LONG ENOUGH AND IT WILL
CONFESS . . .
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data Warehouse and Big Data
Analytics
• Human Expertise and Judgment Required
– Data are worthless if you cannot analyze, interpret,
understand, and apply the results in context.
– Data need to be prepared for analysis.
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data Warehouse and Big Data
Analytics
• Enterprise data warehouses (EDW)
– Data warehouses that pull together data from disparate
sources and databases across an entire.
– Warehouses are the primary source of cleansed data
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data Warehouse and Big Data
Analytics
• Procedures to Prepare EDW Data for Analytics
– Extract from designated databases.
– Transform by standardizing formats, cleaning the data,
integration.
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data Warehouse and Big Data
Analytics
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data Warehouse and Big Data
Analytics
• Active Data Warehouse (ADW)
– Real-time data warehousing and analytics.
– Transform by standardizing formats, cleaning the data,
integration.
Chapter 3
• They Provide
– Interaction with a customer to provide superior
customer service.
– Respond to business events in near real time.
– Share up-to-date status data among merchants,
vendors, customers, and associates.
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data Warehouse and Big Data
Analytics
• Supporting Actions as well as Decisions
– Marketing and Sales
– Pricing and Contracts
– Forecasting
Chapter 3
– Sales
– Financial
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data Warehouse and Big Data
Analytics
• Really Big Data
– Low-cost sensors collect data in real time in all types
of physical things (machine-generated sensor data):
• Regulate temperature and climate
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data Warehouse and Big Data
Analytics
Chapter 3
Figure 3.16 Machine generated data from physical objects are becoming
a much larger portion of big data and analytics..
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data Warehouse and Big Data
Analytics
• Hadoop and MapReduce
– Hadoop is an Apache processing platform that places
no conditions on the processed data structure.
– MapReduce provides a reliable, fault-tolerant software
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data Warehouse and Big Data
Analytics
1. Why are human expertise and judgment important to data
analytics? Give an example.
2. What is the relationship between data quality and the value of
analytics?
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Learning Objectives
Data
Database
Warehouse
Management
and Big Data
Systems
Analytics
Electronic
Data and
Records
Text Mining
Management
Business
Intelligence
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data and Text Mining
• Creating Business Value
– Business Analytics: the entire function of applying
technologies, algorithms, human expertise, and
judgment.
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data and Text Mining
• Text Analytics (Mining) Procedure
– Exploration
• Simple word counts
• Topics consolidation
Chapter 3
– Preprocessing
• Standardization
• May be 80% of processing time
• Grammar and spell checking
– Categorizing and Modelling
• Create business rules and train models for accuracy
and precision
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data and Text Mining
• Text Analytics Procedure
– Exploration
• Simple word counts
• Topics consolidation
Chapter 3
– Preprocessing
• Standardization
• May be 80% of processing time
• Grammar and spell checking
– Categorizing and Modelling
• Create business rules and train models for accuracy
and precision
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Data and Text Mining
1. Describe data mining.
2. How does data mining generate or provide value? Give
an example.
3. What is text mining?
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Learning Objectives
Data
Database
Warehouse
Management
and Big Data
Systems
Analytics
Electronic
Data and Text
Records
Mining
Management
Business
Intelligence
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Business Intelligence
• Key to competitive advantage
– Across industries in all size enterprises
– Used in operational management, business process,
and decision making
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Business Intelligence
• Challenges
– Data Selection & Quality
– Alignment with Business Strategy and BI Strategy
• Alignment
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Business Intelligence
insights.
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Business Intelligence
• BI Architecture and Analytics
– Advances in response to big data and end-user
performance demands.
– Hosted on public or private clouds.
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Business Intelligence
1. How has BI improved performance management at
Quicken Loans?
2. What are the business benefits of BI?
3. What are two data-related challenges that must be resolved
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Learning Objectives
Data
Database
Warehouse
Management
and Big Data
Systems
Analytics
Electronic
Data and Text
Records
Mining
Management
Business
Intelligence
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Electronic Records Management
• Business Records
– Documentation of a business event, action, decision,
or transaction.
• Electronic Records Management (EMR)
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Electronic Records Management
• Best Practices
– Effective systems capture all business data.
– Input from online forms, bar codes, sensors, websites,
social sites, copiers, e-mails, and more.
Chapter 3
• Industry Standards
– Association for Information and Image Management
(AIIM; www.aiim.org)
– National Archives and Records Administration
(NARA; www.archives.gov)
– ARMA International (formerly the Association of
Records Managers and Administrators; www.arma.org
)
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Electronic Records Management
• Primary Benefits
– Access and use the content contained in documents.
– Cut labor costs by automating business processes.
– Reduce time and effort to locate required information
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Electronic Records Management
• DISASTER RECOVERY, BUSINESS CONTINUITY,
AND COMPLIANCE
1. Does the software meet the organization’s needs? For
example, can the DMS be installed on the existing
network? Can it be purchased as a service?
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
Electronic Records Management
1. What are business records?
2. Why is ERM a strategic issue rather than simply an IT
issue?
3. Why might a company have a legal duty to retain
Chapter 3
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.
fyi
• Internet of Things
– Connect dengan internet
– Contoh: Gojek
• Cloud Computing
• Big Data
• Block Chain cek ya
• Artificial Intellegence
Copyright © 2015 John Wiley & Sons, Inc. All rights reserved.