Data MGMT Best Practices
Data MGMT Best Practices
Successful
Data
Governance
Program
[email protected] +1.804.382.5957 Peter
© Copyright 2023 by Aiken,
Peter PhD Slide #
Aiken 1
2
Successful Data Programs Core Components
Data Quality & Integrity Business accountability for data
Framework that ensures the with ‘fit for purpose’ operating
availability, usability, integrity, models/processes and a
and sustainability of our most complementary org construct to
critical data in support of provide a structured & repeatable
analytics, business operations process for sustained data
and compliance Successful integrity and value creation
Data
Programs
Data Architecture and Decision Tree to identify critical
Applications that are directly data and ensure governance
aligned to business objectives, actions are always based on value
integrate seamlessly, scale and drivers and follow a repeatable
promote data collaboration, and scalable model with metrics
efficiency and literacy aligned to business objectives
3
Not All Data Requires Governing –
Focus on What Matters
Precisely’s Methodology of Quickly Achieving Value via Critical Data Elements
4
Precisely’s Data Governance Methodology
Leveraging a Repeatable Governance Framework to ensure ongoing information integrity
The Result
Who should
Govern? Critical Data is being
Where should Governed proactively via a
?
structured, enterprise level,
we Govern? Who within the cross-functional capability
How should organization has driving information trust.
decision rights for what
we Govern? Where in our business
What do ‘good’ data looks like Vs.
processes and systems and who should
we Govern? should we apply the A data state of an
How will this data govern it?
rules and validation unstructured and reactive
impact the business and
checks to ensure approach to managing data
Does this data represent what is the governance within organizational silos.
accurate, high-quality
strategic value? approach?
data?
(i.e., Active, Passive,
Procedure) should be
Are there Compliance,
Analytical, Financial or used?
Operational Impacts?
5
Demonstrating Business Value
Transform the Business
e.g., KPIs / metrics,
Critical information driving
Strategic business goals, objectives,
strategic programs,
data privacy & protection
KPIs, and metrics
12,000 99
customers of the Fortune 100
100 2,500
countries employees
- Recognized Data Thought Leadership
8
Precisely Strategic Services
• Trusted voice and strategic advisors
• Value-based approach with a lean
delivery model
• Industry-leading practice points of view
• Operationalizing people, processes
and performance measures
• Teach to Fish delivery models
9
Learn More
Precisely.com
precisely.com/contact
Program
• Data's Confounding Characteristics
– Uneven understanding
– Has lead fractured views of data and to
– Increasing organizational data debt
1. Keeping DG practically focused on strategy
– This is a young profession and must
– Directly support organizational strategy by Key Elements of a
– Improving data and its use in the short and long term
2. DG must exist at the same level as HR
Successful Data
– In order to achieve effectiveness, Governance
Program
– DG is central to DM (and central to digitization efforts)
– Must be de-coupled from IT strategy
3. Gradually add ingredients (practicing and getting better)
– Digital and data are dependent on high speed automation/data processing
– Employ a DG Frameworks to refine focus
– Plan to evolve (PDCA)
4. Data governance in action: Storytelling
• Take Aways/References/Q&A
It isItlike
is like
a warehouse!
a wall! It isItlike
is like a fan!
a dashboard!
It is like a story!
rope!
ItIt isis like
like aa snake!
pipes!
It Itisislike
likestatistics!
a tree! Blind Persons and the Elephant
adapted from: http://www.dailymirror.lk/print/opinion/editorial-we-need-to-become-channels-of-peace/172-27164
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 4
Confusion as to data responsibility
• IT thinks data is a business problem
– "If they can connect to the server, then my job is done!"
• The business thinks IT is managing data adequately
– "Who else would be taking care of it?"
mo re?
wo rth
ata
niz e dd
ll o rga
Is we
– Lexicons
– Maps https://www.youtube.com/watch?v=60oD1TDzAXQ&feature=emb_logo
https://www.youtube.com/watch?v=r10Sod44rME&t=1s
https://www.youtube.com/watch?v=XD2OkDPAl6s
– Diagrams
– Redundant
– Obsolete
– Trivial
https://uk.nttdataservices.com/en/blog/2020/february/how-to-get-rid-of-your-data-debt
https://anythingawesome.com
https://johnladley.com/a-bit-more-on-data-debt/ https://www.merkleinc.com/blog/are-you-buried-alive-data-debt © Copyright 2023 by Peter Aiken Slide # 12
2020
Ameri
ca
AAdva n Airlines
2020 n m
United tage value arket value
marke d betw ~ $6b
Milea t v alue ~ e e n $19.5
gePlu $ -$31.5
s ~ $2 9b b
2b
https://anythingawesome.com
https://www.forbes.com/sites/advisor/2020/07/15/how-airlines-make-billions-from-monetizing-frequent-flyer-programs/?sh=66da87a614e9 © Copyright 2023 by Peter Aiken Slide # 13
Program
• Data's Confounding Characteristics
– Uneven understanding
– Has lead fractured views of data and to
– Increasing organizational data debt
1. Keeping DG practically focused on strategy
– This is a young profession and must
– Directly support organizational strategy by Key Elements of a
– Improving data and its use in the short and long term
2. DG must exist at the same level as HR
Successful Data
– In order to achieve effectiveness, Governance
Program
– DG is central to DM (and central to digitization efforts)
– Must be de-coupled from IT strategy
3. Gradually add ingredients (practicing and getting better)
– Digital and data are dependent on high speed automation/data processing
– Employ a DG Frameworks to refine focus
– Plan to evolve (PDCA)
4. Data governance in action: Storytelling
• Take Aways/References/Q&A
100%
92.2%
75%
50%
le /p ro ce s s based!
re peop
25%
alle nge s a
ch
80% of data
7.8%
0%
technology people/process
2021
Driving Innovation with Data 49%
Source: Big Data and AI Executive Survey 2021 by Randy Bean and Thomas Davenport www.newvantage.com
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 16
Corporate Governance
• "Corporate governance - which
can be defined narrowly as the
relationship of a company to its
shareholders or, more broadly,
as its relationship to society….",
Financial Times, 1997.
IT Governance
• "Putting structure around how organizations align IT strategy with business
strategy, ensuring that companies stay on track to achieve their strategies
and goals, and implementing good ways to measure IT’s performance.
• It makes sure that all stakeholders’ interests are taken into account and
that processes provide measurable results.
• Framework should answer some key
questions, such as how the IT
department is functioning overall,
what key metrics management needs
and what return IT is giving back to
the business from the investment
it’s making." CIO Magazine (May 2007)
• IT Governance Institute, 5 foci:
– Strategic Alignment
– Value Delivery
– Resource Management
– Risk Management
– Performance Measures
Managing Would
you
Data
want
your
sole,
non-
depletable,
with
non-
degrading,
durable,
strategic
asset
Guidance
managed
without
guidance?
Managing Would
you
Data Decisions
want
your
sole,
non-
depletable,
with
non-
degrading,
durable,
strategic
asset
Guidance
managed
without
guidance?
• Wrong question:
• Right question:
What is Strategy?
A thing
Every Day
Low Price
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 27
Wayne
Gretzky’s
Strategy He skates to where he
thinks the puck will be ...
Strategy Example 3
Good Guys
(Us)
Bad Guys
(Them)
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 30
Strategy Example 3
Bad Guys
(Them)
Good Guys
(Us)
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 31
A pattern
in a stream
of decisions
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 32
Complex Data Governance Environment
DATA COMMISSION
EXECUTIVE Data sharing and analytics
• Identify goals and objectives
• Prioritize initiatives
Region representatives • Study & report
• Recommend changes to budget and code
LEGISLATIVE
JUDICIAL
Advise Governor
• Define, approve, and communicate data strategies, policies,
standards, rules, guidelines, & best practices
TRUSTEE • Provide a governance, policy, and technology framework
• Define agency data governance responsibilities
• Encourage & facilitate data sharing
• Facilitate coordination to prevent duplication
• Coordinate policy and technology proposals and recommendations
• Administer and manage the commonwealth data trust
execute • Track and enforce compliance and conformance
• Oversee dissemination of open data
Data
Data Strategy Governance
Feedback
$
X ≈
Data ≈
Improves ≈
Data Community Participants
X
≈
Over
Time X
≈ $
$
≈
≈
Data Leadership
Data Stewards
Data X $
Governance ≈
Data
≈ Organizational
X ≈
Things
Happen X
≈ $$ Things
Happen
Data
≈
≈
Improvement
X
≈
Data ≈
Improves As ≈ $
A Result of X ≈ $
Focus
≈
DIP
s X ≈ $
≈
≈
≈
Business
Process
IT
o o t c ause
R
Process
n a l ys is is
a
r t o f data
pa
Business
IT
Business
System
Process
v e rn a nce
Challenge go Business
Challenge
Business
Challenge
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 38
Consistency Encourages Quality Analysis
Business Business
Challenge Challenge
Business
Challenge
Business
EliminatiITng Process
data debt IT
requires a t
System System
eam with Business
specialized Challenge
skills
deployed to
create a Business
repeatableIT p Process
rocess
and developProcess
sustained
organization
al Business
IT
skillsets
Business
System
Process
Challenge Business
Challenge
Business
Challenge
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 39
– Productivity
– Redundant and
siloed efforts
– Reactive instead of
proactive initiatives
– 20-40% of IT spending
can be reduced through
better data governance
Program
• Data's Confounding Characteristics
– Uneven understanding
– Has lead fractured views of data and to
– Increasing organizational data debt
1. Keeping DG practically focused on strategy
– This is a young profession and must
– Directly support organizational strategy by Key Elements of a
– Improving data and its use in the short and long term
2. DG must exist at the same level as HR
Successful Data
– In order to achieve effectiveness, Governance
Program
– DG is central to DM (and central to digitization efforts)
– Must be de-coupled from IT strategy
3. Gradually add ingredients (practicing and getting better)
– Digital and data are dependent on high speed automation/data processing
– Employ a DG Frameworks to refine focus
– Plan to evolve (PDCA)
4. Data governance in action: Storytelling
• Take Aways/References/Q&A
m,
Data evolution is separate fro
stem
external to, and precedes sy
ities!
Dat development life cycle activ
ap
rog
ram
me
sd
Systems rive
I Tp
rog
Development ram
s
Activities
Create
New Organizational
Capabilities
m,
Data evolution is separate fro
ste m
external to, and precedes sy
ities!
development life cycle activ
External Comprehension
Data Progra
Governance and the other data
stuff that needs to be done
m
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 48
ra m
Differences between Programs and Projects
g s
• Programs are Ongoing, Projects End
o
r st a
– Managing a program involves long term strategic planning and
p
continuous process improvement is not required of a project
a
• Programs are Tied to the Financial Calendar
t
a at l e a
– Program managers are often responsible for delivering
d R
results tied to the organization's financial calendar
r H
• Program Management is Governance Intensive
u t r
– Programs are governed by a senior board that provides direction,
Yo t las you !
oversight, and control while projects tend to be less governance-intensive
• Programs Have Greater Scope of Financial Management
s
– Projects typically have a straight-forward budget and project financial
u s am
management is focused on spending to budget while program planning,
a
management and control is significantly more complex
m ng gr
• Program Change Management is an Executive Leadership
Capability
lo pro
– Projects employ a formal change management process while at the program
level, change management requires executive leadership skills and program
change is driven more by an organization's strategy and is subject to market
conditions and changing business goals
Adapted from http://top.idownloadnew.com/program_vs_project/ and http://management.simplicable.com/management/new/program-management-vs-project-management
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 49
Body of Knowledge (DM BoK V2)
Data Management
Metadata
Management
Practice
Areas
https://anythingawesome.com from The DAMA Guide to the Data Management Body of Knowledge 2E © 2017 by DAMA International © Copyright 2023 by Peter Aiken Slide # 50
Iteration 1
Perfecting
operations in 3
data management
practice areas
1X
1X
Data 1X
Strategy
Iteration 2
Perfecting
operations in 3
data management
practice areas 1X
2X
Data 2X
Strategy
Data BI/
Governance Warehouse Metadata
Perfecting
operations in 3
data management
practice areas
3X
Data 3X
Strategy
1X
Organizational Strategy
ess in
Ne
bus
the e)
by to improv
(O
e
cca
de
s io
n
dD
st
use pportunities
oP
rac
ata
tic
e)
(O
Sk
ills
a
Dat
x
considered within the scope of IT
projects
• Problems with this approach: IT
– Ensures data is formed to the
applications and not around the Projects
organizational-wide information
requirements
– Process are narrowly formed around
applications Data/
– Very little data reuse is possible
Information
https://anythingawesome.com Original articulation from Doug Bagley @ Walmart © Copyright 2023 by Peter Aiken Slide # 55
Organizational Strategy
IT Strategy
Data Strategy
Organizational Strategy
Data-Centric Development
https://anythingawesome.com Original articulation from Doug Bagley @ Walmart © Copyright 2023 by Peter Aiken Slide # 58
Program
• Data's Confounding Characteristics
– Uneven understanding
– Has lead fractured views of data and to
– Increasing organizational data debt
1. Keeping DG practically focused on strategy
– This is a young profession and must
– Directly support organizational strategy by Key Elements of a
– Improving data and its use in the short and long term
2. DG must exist at the same level as HR
Successful Data
– In order to achieve effectiveness, Governance
Program
– DG is central to DM (and central to digitization efforts)
– Must be de-coupled from IT strategy
3. Gradually add ingredients (practicing and getting better)
– Digital and data are dependent on high speed automation/data processing
– Employ a DG Frameworks to refine focus
– Plan to evolve (PDCA)
4. Data governance in action: Storytelling
• Take Aways/References/Q&A
Digital Insight
DIGITAL DATA
DATA DIGITAL
? DATA
• Subtract data from digital and what do you have?
• Subtract digital from data and you still have data
https://www.linkedin.com/in/mark-johnson-518a752/
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 60
Digital
It isn't possible to go digital
Dat
ing ' data'
ell
By just sp
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 62
It requires more work
!
Dat
a
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 63
GI➜GO!
Garbage
Garbage Business
Machine
Perfect
Data Digital
Block
Technology
Analytics
MDM
AIChain
Data Governance
Intelligence
Warehouse
Learning
Model Results
GI➜GO!
Data
Warehouse
Business
Intelligence
Block Chain
Machine
Perfect Garbage
Quality
Learning
Model Digital
Data
Data Results
Governance
Analytics
MDM
AI
Technology
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 66
GI➜GO!
Data
Warehouse
Business
Intelligence
Block Chain
Machine
Perfect Garbage
Quality
Learning
Model Digital
Data
Data Results
Governance
Analytics
MDM
AI
Technology
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 67
QI➜QO!
Data
Warehouse
Business
Intelligence
Block Chain
Machine
Perfect Quality
Quality
Learning
Model Digital
Data
Data Results
Governance
Analytics
MDM
AI
Technology
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 68
Today
Machine Quality
Quality
Learning Digital
Data
Results
s de liv e ry
AI'
o f te n ah ead
is
of value
Data literacy
Standard data
Data supply
Data literacy
Standard data
Data supply
Data literacy
Standard data
Data supply
Quality engineering/
architecture work products
do not happen accidentally!
Data literacy
Standard data
Data supply
from The DAMA Guide to the Data Management Body of Knowledge © 2009 by DAMA International
http://www.datagovernance.com/
KiK Consulting
http://www.kikconsulting.com/
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 80
http://www-01.ibm.com/software/data/system-z/data-governance/workshops.html
ou
rc
es
Data/Feedback
More time is dedicated ← | → Less time is dedicated
IT/Systems Development
(data decision makers) (data makers & consumers)
Data/feedback
Decisions
Changes
Guidance
n
tio
Ac
Stewards Participants/Experts
(data trustees) (data subject matter experts)
Ideas
IT/Systems Development
Data/Feedback
Changes
Guidance
n
tio
Ac
Stewards Participants/Experts
(data trustees) (data subject matter experts)
Ideas
DG roadmap
Policy/Standards Reqs.
Data Stewards
Operational processes
Executive mandate
Illustration from The DAMA Guide to the Data Management Body of Knowledge © 2009 by DAMA International
• Data Standards
• Resolved Issues
Illustration from The DAMA Guide to the Data Management Body of Knowledge © 2009 by DAMA International
• Suppliers: • Participants:
– Business Executives – Executive Data Stewards
– IT Executives – Coordinating Data Stewards
– Data Stewards – Business Data Stewards
– Regulatory Bodies – Data Professionals
• Consumers: – DM Executive
– Data Producers – CIO
– Knowledge Workers
– Managers and Executives
– Data Professionals
– Customers
Illustration from The DAMA Guide to the Data Management Body of Knowledge © 2009 by DAMA International
• Data Management
Cost
• Achievement of
Objectives
• # of Decisions Made
• Steward Representation/Coverage
✓ Data Inventories
✓ Data Quality
✓ Data Access
Illustration from The DAMA Guide to the Data Management Body of Knowledge © 2009 by DAMA International
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 93
Evolve
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 94
https://www.google.com/url?sa=i&url=https%3A%2F%2Fround-lake.dustinice.workers.dev%3A443%2Fhttps%2Fprezi.com%2Fel_1jxok7t-x%2Fevolution-is-not-goal-oriented%2F&psig=AOvVaw3rFrerRanKFatDfESqab4C&ust=1591700086354000&source=images&cd=vfe&ved=0CAIQjRxqFwoTCODBiIyH8ukCFQAAAAAdAAAAABAD
Evolve
DG roadmap
Policy/Standards Reqs.
Data Stewards
(Repeats)
Execute plan
Operational processes
Evaluate results
Executive mandate
Revise plan
https://en.wikipedia.org/wiki/PDCA
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 96
Program
• Data's Confounding Characteristics
– Uneven understanding
– Has lead fractured views of data and to
– Increasing organizational data debt
1. Keeping DG practically focused on strategy
– This is a young profession and must
– Directly support organizational strategy by Key Elements of a
– Improving data and its use in the short and long term
2. DG must exist at the same level as HR
Successful Data
– In order to achieve effectiveness, Governance
Program
– DG is central to DM (and central to digitization efforts)
– Must be de-coupled from IT strategy
3. Gradually add ingredients (practicing and getting better)
– Digital and data are dependent on high speed automation/data processing
– Employ a DG Frameworks to refine focus
– Plan to evolve (PDCA)
4. Data governance in action: Storytelling
• Take Aways/References/Q&A
Non-Fungible Tokens
$48M. $280
• 100 Sensors
– Establish optimal monitoring targets
– Finer tuned and safer maintenance
– Mission Readiness ???
– Storage $$$
– Handling $$$
– Opportunity $$$
– Systemic $$$
– Maintenance $$$
– Total > $1.5 Billion
Take Aways
• Need for DG is increasing
– Increase in data volume
– Lack of rigorous practice improvement
• DG is a new discipline
– Must conform to constraints
– No one best way
• DG must be driven by 4 key elements
1. Keep DG practically focused on strategy
2. Implement DG (and data) as a program not a project
3. Gradually add ingredients
4. Learn the value of stories/storytelling
• The goal is to improve DG effectiveness and efficiencies (and the
data itself) over time
• The more data literate the organization, the easier the
transformation
https://anythingawesome.com © Copyright 2023 by Peter Aiken Slide # 104
By the book
• Data Governance: How to
Design, Deploy, and
Sustain an Effective Data
Governance Program
• John Ladley
References
Websites
Compliance Book
Event Pricing
on Peter's Books
• 20% off
directly from the
publisher
on select titles
• My 'Book Store' @
https://anythingawesome.com/books-overview.html
anythingawesome
Upcoming Events
Conceptual vs. Logical vs.
Physical Data Modeling
11 July 2023
Co
? lla
bo
es ig n R eview? toring rat
Critical D M en ion
?
Executive
Data
Independent Verification & Validation
Literacy T
ra ining?
[email protected] +1.804.382.5957
Thank You!
Reverse Engineering Expertise?
Hirin
g Assis
tance
?
Tool/autom
Use your data more strategically? at ion evaluatio
Book a call with Peter to discuss anything - https://anythingawesome.com/OfficeHours.html n? © Copyright 2023 by Peter Aiken Slide # 110