business intelligence notes
business intelligence notes
1
organization make a profit. Growth in Hardware Given the information about the growth in
data and the growth in usage, it should be obvious that scalability of the BI hardware
architecture is key. But before you plan five years ahead, remember that the hardware cost is
only one part of the total BI cost. Look at a planning horizon of 12 to 24 months; it is best to
start small but also plan for long-term growth. Consider the following factors. Keep in mind
the capacity threshold of your BI platform. If you exceed that capacity, you have to add more
processors, I/O channels, independent disk controllers, and other high-speed components to
keep the BI decision-support environment at an acceptable level of performance. Of all the
BI hardware, the BI server platform is the most important. When ordering new hardware of
any kind, there must be enough lead time to have the equipment delivered, tested, and
prepared for the development and production environments. Parallel technology is an
absolute must for VLDBs. The ability to store data across striped disks and the ability to have
multiple independent disk controllers play an enormously important role in the performance
of processes running against the BI target databases. The Transmission Control
Protocol/Internet Protocol (TCP/IP) is appropriate for most hardware platforms. TCP/IP is
rapidly becoming a standard for scalability, growth considerations, and multiplatform
environments. Consider the advantages of a data mart approach with separate BI target
databases. This approach permits scalability in smaller and less expensive increments
2
the initial load process, followed by the historical load process. Also load the meta data
repository with meta data from your various meta data sources such as spreadsheets,
computer-aided software engineering (CASE) tool, ETL tool, and online analytical processing
(OLAP) tool. 5. Prepare for ongoing support. Establish a schedule for on-call emergency
support. Schedule regular backups as well as occasional database reorganizations for all
production databases. Plan to use the DBMS-provided utilities for these database
maintenance activities. In addition, plan to monitor performance, growth, usage, and quality
as part of the ongoing database maintenance activities. Periodically review and revise
capacity plans for processors, disk storage, network, and bandwidth. 6. Figure 15.5.
Implementation Activities
Roles Involved in These Activities Application developers The application developers work
with the operations staff to move the report programs, query scripts, interface programs,
and online help function programs into the production application program library.
Application lead developer The application lead developer supervises the implementation
activities of the access and analysis portion of the BI application. He or she is in charge of
setting up the production application program library and writing the access and analysis
portion of the operating procedures and the reference guide. He or she also has the
responsibility of setting up the application report programs on the job scheduler. Data mining
expert The data mining expert works with the database administrator to create, revise, and
maintain the data mining databases for the planned data mining activities. Data mining is an
iterative and ad hoc endeavor that requires ongoing changes to the data mining databases,
3
the analytical data models, and the data mining operations. Database administrator The
database administrator creates the production BI target databases and the production meta
data repository database and grants appropriate access authority for these production
databases. He or she must run the initial load process and the historical load process to load
the BI target databases. He or she schedules database maintenance activities (backups,
reorganizations) as well as ongoing database monitoring activities (for performance, growth,
usage). He or she also reviews the capacity plans for processors, disk storage, and network
bandwidth. ETL developers The ETL developers work with the operations staff to move the
ETL programs into the production ETL program library. ETL lead developer The ETL lead
developer supervises the implementation activities of the ETL portion of the BI application.
He or she works with the operations staff to prepare the production environment and set up
the production ETL program library. He or she should write the ETL portion of the operating
procedures and the reference guide. He or she is also responsible for setting up the ETL
process on the job scheduler. Meta data administrator The meta data administrator is
responsible for moving all the meta data repository programs into the production meta data
repository program library. He or she also has to run the meta data migration (load) process
and schedule ongoing data quality monitoring activities, such as gathering meta data metrics
and performing data quality spot checks. Meta data repository developers The meta data
repository developers assist the meta data administrator with moving all the meta data
repository programs into the production meta data repository program library. Web
developers The Web developers are responsible for moving their Web pages and scripts from
their local servers to the production Web server. Web master The Web master is responsible
for setting up the production Web server. He or she also has to work with the staff of security
services and network services to install and test the firewall and other required security
features
4
4. Discuss in detail release evaluation activities.
5
Figure 16.4. Release Evaluation Activities
6
5. Write a note on post implementaion reviews
7
8
Organizing a Post-Implementation Review Consider the following items when organizing a
project review. How to prepare for the review: The project manager has to take some time to
prepare for the review by: - Examining the issues log to see which issues were effectively
resolved and which were not - Assessing the change-control procedure for its effectiveness -
Reviewing the project plan to determine whether all the appropriate tasks were included -
Studying the estimated and actual task completion times on the project plan to determine
which tasks were underestimated and which were overestimated - Noting any problems with
the technology platform, such as problems with tools or their vendors, hardware, network,
and so on - Reviewing the budget to see if the actual expenditures came close to the
estimated ones - Assessing the effectiveness of the training sessions All of these items are
potential topics for discussion at the review. When to schedule the review: It is advisable to
wait for two months after going into production before holding a formal review of the BI
application. This will give the project team time to iron out all the glitches that are common
during the first few weeks after "going live." It will also give the project manager and the
business sponsor time to: - Review the project charter, project plan, project reports, project
activities, and budget - Collect information and metrics about the usage of the BI application,
9
the BI target databases, and the meta data repository - Organize the meeting Where to hold
the review: The review session should be held offsite. Pagers and cell phones should be used
for emergencies only; they should not ring during the session. The room should be set up as
a conference room supplied with: - Several flipcharts - An overhead or data projector -
Markers and masking tape - Two laptops, one for the facilitator and one for the scribe -
Coffee—lots of strong coffee How long the review should last: A well-organized, thorough
review usually lasts two full days, especially for the first release of a new BI application.
However, if time is in short supply, or if the release was small in scope and effort with no
significant hurdles, one full day could be scheduled with the option of a follow-up session
within two weeks if necessary. Who should attend the review: All team members from the
core team and the extended team should be invited to participate in the review. They must
be prepared to contribute. That means they must review the agenda and prepare to discuss
the topics listed on it. They must also review any documents sent to them ahead of time and
be prepared to discuss them. In short, every project team member should be an active
participant! What to discuss during the review: A preliminary agenda should be published
about four weeks before the scheduled review session. - The preliminary agenda should list
all topics, including introduction and wrap-up, with estimated time allocations for each topic.
- The time estimates must take into account the complexity of the topic and the number of
people participating. - Everyone who is invited should be given the opportunity to add to the
agenda and submit any pertinent documents to be reviewed. - About two weeks before the
review session, the fina
6. What are the backup strategies available to address the slow speed of data transfer between
server and backup device.
10
11
7. What are the roles involved in evaluation activities.
12
8. What are the application prototyping activities for BI
13
14
15
16
17