Introduction To Watson Ai
Introduction To Watson Ai
1.1.1.3 Pre-requisites
The course assumes you have a basic understanding of AI and are familiar
with its terminology.
We recommend that you complete the following course before starting this
one:
01 Sept 2020 (Anamika Agarwal): Replaced links to labs with links from SN Asset Library
2 SYLLABUS
Syllabus
Data
Vision
Empathy
Compliance
Quiz
3 GRADING SCHEME
3.1.1.1 GRADING SCHEME
This section contains information for those earning a certificate. Those
auditing the course can skip this section and click next.
1. The course contains 5 Graded Quizzes, 1 per each module and 1 for
the final assignment. Each Graded Quiz carries an equal weight of
20% of the total grade.
2. The minimum passing mark for the course is 70%.
3. Permitted attempts are per question:
o One attempt - For True/False questions
o Two attempts - For any question other than True/False
4. There are no penalties for incorrect attempts.
5. Clicking the "Final Check" button when it appears, means your sub-
mission is FINAL. You will NOT be able to resubmit your answer for
that question again.
6. Check your grades in the course at any time by clicking on the "Pro-
gress" tab.
4 MODULE INTRODUCTION
In this Module, you will learn how Watson AI works. You will understand the
many ways Watson AI is helping professionals and businesses reimagine
their workflows, learn more from less data, and protect their insights.
5 LEARNING OBJECTIVES
Describe how Watson AI works.
Describe ways in which Watson helps professionals.
Describe 3 ways in which Watson helps businesses.
Explain the difference between Consumer AI and Business AI.
Explain the 3 steps to getting started on your AI journey.
then analyzing and identifying the concepts and relations of those sen-
tences. Once it understands how everything fits together, it can work out
the context and intent of what's being conveyed. But your AI also needs to
understand the specific language and terminology of your industry. With
traditional AI models, this would require lots of additional data and comput-
ing power, taking weeks or months. With Watson however, it can be done
quickly and simply, thanks to a technique called Transfer Learning. Trans-
fer Learning is learning how to learn. It's what enables Watson to learn
more from less. so it doesn't need to be trained from scratch. It can be fed
prior knowledge to speed things up. Let's take the case of a home insur-
ance company, to demonstrate how Watson's Transfer Learning is a three-
layered AI model. The bottom layer is made up of out of the box general
knowledge, like Wikipedia for AI. This layer tells Watson what a house is, or
a tornado. The middle layer is pre-packaged with knowledge tailored to
specific industries. So for insurance, it's how Watson understands terms
like coverage or beneficiaries. The top layer is where the customer specific
learning takes place, personalizing Watson to the company's unique busi-
ness needs. Fed with their data and know-how, the model can understand
a company's specific risk attributes, and behavioral policy pricing models.
Transfer Learning is a key part of how Watson is already accelerating
claims processing by 25 percent, dramatically cutting operating costs.
Transfer Learning makes Watson the best AI for your enterprise. It allows it
to learn faster from smaller sets of data, while also protecting your data and
insights. Watson is designed to ensure data only flows from the bottom to
the top. So you can make the most of the shared knowledge in the bottom
two layers, while retaining ownership of your top layer. Most companies AI
systems use your data to build their general machine learning models, al-
lowing all their users to benefit from that collective knowledge. Watson's
three-layer model ensures your data, remains your data.
What if you could perform multiple audit quality checks in half the time and
with a higher degree of accuracy. Watson helps you deal with your data
and your business process in the context of compliance, whether it be with
industry or government regulations, or with company policies. Data privacy
professionals have a significant challenge on their hands. They must main-
tain an up to the minute understanding of the continually changing regula-
tions as well as dealing with different jurisdictions as they work across the
globe. Every year, three million lives worldwide are lost through work-re-
lated injury and illness. That's more than the population of Chicago or Hou-
ston. In the oil and gas industry, people's lives are at stake every day. To
solve this, Woodside, Australia's largest independent oil and gas company,
turned to Watson to help them identify two key pieces of information in their
incident reports, the cause of the incident and the corresponding mitigation
actions. Most systems will analyse that structured data at a summary level
and end up missing important unstructured information such as the details
available in the free text of an incident report. Watson finds that, exposes it,
and organizes the information to help the safety analyst find workplace
safety improvements. Other companies have put lots into work analysing
transactions for tax law compliance. With the tax law changes, legal teams
need to ensure that they are adhering to all compliances. Watson assists
professionals to process mounds of information, and augment their profes-
sional views and their professional experience to help them get compliance
right and speed it along. Watson also assists professionals and compli-
ance-oriented business processes in understanding contracts. Insufficient
contracting can cause firms up to 40 percent of the deals value. Watson
has been taught document structure and contract terminology so that Wat-
son can understand these contracts and statements of work. Financial insti-
tutions are spending more time and money than ever on regulatory compli-
ance. Regulations are changing and increasing rapidly. Regulations, oblig-
ations, policies, and controls are managed in disparate systems that have
little to no relationship to one another, and it's nearly impossible to confirm
regulatory and policy compliance coverage and operating controls suitabil-
ity to obligations. IBM Watson Regulatory Compliance is a standalone mod-
ule of open pages with Watson the industry's only AI driven GRC solution
and supported by the expertise of Promontory Financial Group. IBM Wat-
son Regulatory Compliance turns the manual time-consuming and expens-
ive process of complying with regulatory requirements into a streamlined
efficient process driven by consistent methodology. It combines software,
content, and expertise to provide a holistic, accurate, and timely view of the
obligation life-cycle that enables organizations to achieve trustworthy, effi-
cient, and sustainable compliance.
11MAKING DATA AND AI ACCESSIBLE TO ALL
Companies are looking to embrace AI within their own development envir-
onments. At IBM, we have created an end-to-end collaborative environ-
ment that provides a suite of capabilities to help AI professionals build,
train, and deploy their custom models with their data alongside Watson. In
its simplest form an API (Application program Interface) is a set of routines,
protocols, and tools that help applications work together. Cognitive APIs do
similar work, but they also serve as a messenger between data and the
cognitive computing power of Watson combining these in a coding platform
on the cloud. Cognitive APIs are based on an input output system.
Your input is data that the API feeds into Watson and the output is the de-
livery of the overall outcome based on that data. IBM has a huge list of cog-
nitive APIs that our clients used to make smarter business decisions. Most
cognitive solutions use several APIs together to build apps. Together these
APIs analyse massive amounts of data to reveal what's trending and why.
And since various cognitive APIs can be swapped out to change functional-
ity and outcomes, they are being used to power many cognitive applica-
tions in almost every industry across the globe. Companies can start with
an initial project and then expand from there and as they expand, they build
their roadmap to AI.
12 3 WAYS WATSON CAN HELP YOUR BUSINESS
AI is changing the way the world works, making business faster, smarter,
and more secure. At IBM, we're helping companies put AI to work at scale,
giving them an unparalleled business advantage. With Watson, businesses
are personalizing customer experiences, streamlining processes, minimiz-
ing risk, and sparking innovation. With Watson, engineers are keeping mil-
lions of elevators moving, predicting when they will break down, and pro-
actively fixing them. With Watson, banks are deploying virtual agents
trained on thousands of customer inquiries, helping them provide expert
service to millions of customers, 60 percent faster. With Watson, a range of
industries from healthcare, to automotive, to Telecom, to education are
working faster and transforming workflows. Businesses everywhere are
building their future with Watson. Watson helps your teams and business
work smarter. You can connect it to your data wherever it is, whether it's in-
side your enterprise or in the Cloud, from your CRM to online file storage,
simply and seamlessly with no disruption to your workflow. We'll protect
your data from cyber threats, comply with legislation old and new, and al-
ways maintain full transparency.As businesses start to rely more on AI,
they need transparency to confirm that the recommendations given can be
trusted. We're also committed to mitigating harmful bias. These features
are another part of why organizations everywhere are choosing Watson to
help their businesses run smoother and be more productive. You can use
our APIs and products or build models from scratch, reducing disruptions,
enriching customer interactions, making recommendations with confidence,
the possibilities are endless. Enterprises do not have the massive data that
you see in the consumer application, they need to be able to learn more
from less. Traditional AI models require massive data and computing
power. Watson uses a technique called transfer learning, that enables it to
learn more from less. So it doesn't need to be trained from scratch. It can
be fed prior knowledge to speed things up. Watson's three-layer transfer
learning model, ensures your data remains your data. The customers spe-
cific learning that personalizes Watson to the company's unique business
needs takes place in the top layer. Since Watson ensures that data only
flows from the bottom to the top, it allows the customer to retain complete
ownership of their top layer.
13 WHAT DIFFERENTIATES CONSUMER AND BUSINESS AI
SYSTEMS
Hello, I'm Laura Donaldson with the Watson team. Thanks so much for join-
ing us at this digital event where we're going to answer your AI questions.
Join me today, I have the CTO of Watson, Rob High, thanks so much for
joining me, and the VP of implementations, Toby Cappello. Hello. Gentle-
men, thank you so much, looking forward to this. Rob I know that a lot of us
when we're thinking about AI, we're thinking about consumer AI, so that AI
that's on our phones or in our homes, and devices. What's the difference
though between that consumer AI and business AI? Yeah. Actually, there
are some similarities as well which is largely stems from the experiences
that we gained when we're using our smartphones. So for those of us who
use smartphones in our daily life, or we've got these at home, we're creat-
ing service and expectations around the experiences that are useful to us
and meaningful to the way that we operate, those same properties or things
that we bring with us into work as well. So we do have an expectation
about the experiences that we're looking for when we're at work. But there
are some differences, and they start with recognizing that at work often-
times we're involved with business processes. These processes maybe the
ways in which we engage with our clients or may be ways in which we get
through the tasks and responsibilities that we have that we are accountable
for at work. They may have something to do with the way the business is
trying to move itself forward. So these business processes are really pretty
essential. It's also important that we integrate AI into those business pro-
cesses. Now of course, it's also important to understand that what AI is do-
ing, is opening us up to sources of information that classically have not
been integrated into these business processes in the past. So we really
shouldn't be thinking about AI that just plugs into business process but how
do you rethink the business process to take the advantage that AI brings to
the table. So almost an embedding it into their workflows, like putting it at
the fingertips of the employee or the individual? Well, putting it into that flow
in such way that it gains advantage. So if you think about AIs that are able
to read literature, read materials that today have to be read by human be-
ings. When you consider the number of articles that are out there, the num-
ber of papers, the number reports, the number of contracts, the number
documents that we all have to consume typically is far more than more
what we can as individuals possibly consume. If I can engage an AI in that
process of actually extracting from those articles the things that are impor-
tant to me in the context of the problem I'm trying to solve, now I've gotten
an advantage.If I can use AI to help me see through my own biases or to
perspectives that I may not have considered before, now I'm able to actu-
ally make better decisions because I can now consider those alternatives
within that decision process. But there's also an another element to AI for
businesses. As Rob was talking about this mass amounts of information
that an AI system can go through is fantastic if you have it, but what if you
don't? If you're building something for your business, for your business do-
main, for your data which is a key tenet for what we're doing with IBM, you
need to be able to have that AI system learn to be productive and provide
value for you with the minimal amount of information you can give it instead
of having to worry about the maximum amount of information. I think that's
another key as well. We've been spending a lot of time really focusing on
how do we train these systems with a minimum amount of training data,
knowing that it may not be available to you, you just simply may not have it.
Now, of course if you do have data, it's your data. We need to make sure
that you understand that at work, your data is your data. We protect your
responsibility and your rights to the data that you have, and really respect
that and by the way that we secure the data, the way that we avoid having
to train with other people's data, and allow you to protect your own data
when we do that, by simply making sure that we don't siphon that data off
for any other purpose. That's a top of mind, I think right now for a lot of peo-
ple is security and privacy of that data. So for IBM that seems to be a big
pillar really when you think about it, how did you say we are protecting it?
Yeah. How are we doing that? It's really core to our DNA, first of all be-
cause we have been an International Businesses Machine Company for so
long, we work with enterprise, we know the sensitivity, and we recognize
the need to be able to pick the data. So we do a lot of our work in the IBM
Cloud, the IBM Cloud has been built specifically to maintain the protection
and security of data, to maintain isolation between different institutions that
may be using our cloud or using our technology in the cloud, and we carry
that all the way through to everything that we do. So if I'm summing that
back up, it sounds like the three differences between consumer and busi-
ness AI really come back to like embedding into the workflows, putting AI at
the fingertips of the person or the employee when they need it, where they
need it so they can get the vast amount of information faster. It's learning
from less data so that you're really able to get started faster and work on
this training models, and then finally, the protection of that data so that it
stays with you and doesn't go anywhere else. That's right. Sounds right,
okay. Absolutely.
The use case through which they can prove that AI can benefit
their organization.
The governance frameworks, methodologies, best practices, and
anything else needed to adopt the proven use case across the or-
ganization.
15.1.1.4 To learn more about the topics in this module, read these art-
icles:
16 INTRODUCTION
In this Module, you will learn about some of the Watson AI services offered
on the IBM Cloud. You will understand how organizations can use Watson
AI services and the types of situations in which each service applies.
17LEARNING OBJECTIVES
o Describe Watson Assistant.
o Describe Watson Knowledge Services.
o Describe Watson Speech Services.
o Describe Watson Language Services.
I mentioned the Watson Assistant and the Watson Voice Agent, but there Is
also, for example, the Knowledge Studio. Now of course, Watson's very ex-
tensible, that's really the whole reason it's so useful. Not only is there the
powerful Natural Language Understanding service, but you can also take
that Natural Language Understanding service and modify it to your own
needs. You can find custom entities. You can find customer relationships.
You can do custom correlation detection or co-mention detection. All these
things are possible with the Watson Knowledge Studio. Apart from that,
there is also the Watson Studio, not to be confused with Watson Know-
ledge Studio. The Watson Studio used to be called the Data Science Ex-
perience, where you can actually have the deep learning as a service envir-
onment where you are actually as a programmer using Jupyter Notebooks
and the visual neural network model in order to create machine learning
applications directly on the Watson environment. So there are lots of differ-
ent services IBM provides, and within Watson, within the fields of vision,
within the fields of audio, within the fields of natural language, within the
fields of customizations. So much that IBM provides too much to cover in
one individual video, but then again these are just a few of them that I really
love working with.
20 INTELLIGENT CHATBOTS, VIRTUAL ASSISTANTS AND
IBM WATSON
You've talked a little bit about how people can use IBM technology in Watson to create intelligent
virtual assistants. IBM in Watson provides a lot of different APIs in order to create your own intelli-
gent virtual assistants. And the special part about Watson is that it's not just limited to virtual assist-
ance, there are lots of APIs in the market that enable you to create chatbots. Chatbots are not spe-
cial. But there are few things that Watson provides that other companies, other service providers
are simply unable to provide. For example, if you take a look at the roots of Watson where it's origin-
ally evolved from, Watson was originally a Jeopardy playing machine essentially. That's really what it
was specifically built and targeted to do. And because of that, it has amazing information retrieval
and understanding systems. These are unparalleled by practically any other company's offerings.
Even search engine companies are unable to provide the level of natural language understanding
that Watson provides. So the Watson Assistant and voice agent services, you're not only limited to,
for example, creating a chatbot that can understand user intents, you have a few extra features that
go the extra mile. So for example, if you take a look at Mercedes they created a system called Ask
Mercedes, where drivers and people who are looking to buy Mercedes cars can actually ask this
chatbot different questions about their car, and let's just say they've got complex question. This is
actually called the long tail of questions in chatbot terminology, which are the lots of questions that
are asked very, very little in terms of frequency, and of course there's also a shorthand which is the
few questions that are asked very, very many times. When it comes to this long and of questions,
this can be handled by, for example, the Watson Discovery Service. Now, this is we call the retrieving
rank service. The Watson Discovery Service now enables you to actually feed in entire corpora of
documents, and then from there be able to analyze natural language within those documents be
able to figure out what concepts they talk about, query them with natural language, find passages
from within those documents, and combining this with chatbots creates a very powerful experience.
Because chatbots by themselves, yes they're great, and Watson can do things like for example dy-
namically understanding entities within messages, which is another very unique feature. But now
being able to understand these depths of contents of the Watson Discovery Service and time that it
would Watson Assistant is something that really is a unique offering, and enables you to take your
chatbots to the next level of usefulness.
21 WATSON ASSISTANT
This is customer service, bad customer service, painful customer service, customer service with bots
who we've had to deal with. But what if a bot was actually smart? What if it not only helped your
customers but your agents too? Say hello to Watson Assistant. Watson Assistant is not another chat-
bot. Most chatbots try to mimic human interactions. Frustrating you when a misunderstanding hap-
pens. Watson Assistant gets it. It knows when to search for an answer from a knowledge base, when
to ask for clarity, and when to direct you to a human. Watson Assistant combines machine learning,
natural language understanding, and integrated dialogue tools to create conversation flows between
your apps and your users. You can use Watson Assistant to create natural language interfaces to
your applications. With it, you can build artificially intelligent agents that communicate with users
through natural language, making your applications accessible and is easy to use as holding a conver-
sation. Use Watson Assistant to quickly build and deploy chatbots and virtual agents across a variety
of channels including mobile devices, messaging platforms, and even robots. Watson Assistant un-
derstands the intent of what your users are saying. It can identify entities that users mention and
manage the flow of the conversation. You don't have to be a programmer to use Watson Assistant.
The tooling is written with business users in mind and no coding is required to set up a bot. Integ-
rated online help and examples can get your bots running within minutes. Watson Assistant requires
very little data to train an intent. With as few as five examples, you can have the Watson Assistant
understand an individual intent. Browse from a catalog of already configured customer service and
industry content packs to save time and start faster. Watson Assistant in action. Let's get started
with our self-service assistant for ABC Bank. To get started, I'll open up with "hello. "Now you can
see how Watson responds back. This is what we call basic chitchat. Watson comes with this package
that lets it respond to basic dialogue. There are also content packs for general customer service, re-
tail banking, energy and utilities, insurance, and telecommunications. These content packs can let
you focus on training your assistant on the specifics of your business rather than having to worry
about the general industry knowledge, like I lost my credit card or my power is out. Let's say that I
want to be able to know what the bank's hours are. Here you can see that Watson Assistant re-
sponds to this FAQ, otherwise known as the short-tail question. Now if I want to be able to provide a
rich customer experience, when someone asks something more complex, something that we call a
long-tail question, Watson Assistant Search Skill offers a unique ability to integrate with AI powered
search. It does this by pairing with another product called Watson Discovery. This helps answer
questions like, what are the foreign fees for my silver credit card? For this type of question, the sys-
tem would have to return relevant passages from associated PDFs from that business. Now a user
can quickly find accurate information to complex questions with ease, without having to search
through that website. There are instances where we want to be able to talk to a customer service
representative. So if I say something like talk to a live agent, Watson automatically routes to me to a
call center representative. Now we'll pull up the call center agent screen so that we could see what
that would look like. We're now demonstrating Watson Assistant's ability to help employees get that
information that they need to be able to provide superior customer service. While a digital channel
like online chat is one way to deploy Watson Assistant, it can also be used as a self-service agent on
the phone. We offer package called Customer Care Voice Agent, which combines Watson Assistant
with speech to text, text to speech, and IBM voice agent. These products can be easily integrated to
enable Watson as an IVR.
22 WATSON DISCOVERY
Watson Discovery Service is a new suite of APIs that enables you to ingest, normalize, enrich, index,
search, and explore, your data, both structured and unstructured. Here's what you should know:
Watson Discovery gives you the ability to, store, analyze, and understand your data at scale. First,
Watson ingests and standardizes all of your data, no matter the type. Just load it and go. Watson
then enriches your data using natural language understanding capabilities. Think sentiment and
emotion analysis, named entity extraction, and concept tagging. But that's just the beginning, an
easy-to-use query API gives you new ways to segment and search through your data. For example,
extracting sentiment from the past few months of your customers' chat history. This can be done in
seconds. You're not just getting Natural Language Processing with Discovery, you're getting a host of
out-of-the-box enrichment algorithms to find the signal and your data. You can plot time series, per-
form aggregations, correlate variables. With Watson, you're ready to roll. Ready to talk scale? No
problem. Watson Discovery has scale built into its DNA. You can load millions of datasets into Wat-
son.
With Discovery, developers can rapidly ingest and enrich data to build cognitive cloud-based applica-
tions that connect proprietary structured and unstructured data. Rest APIs make it straightforward
to add cognitive apps built with Discovery to any existing front-end solution. Watson Discovery Ser-
vice is available on the IBM Cloud, as well as other platforms. You can leverage Watson SDKs, Web-
based tooling, and Watson Discovery Service APIs to bring cognitive insights to your custom applica-
tions. Watson Discovery allows you to use pre-built collections, such as Watson Discovery News and
your previously built custom collections. Discovery allows you to interrogate your data in either a
natural language format or a query language that will search for both Boolean conditions and for
phrases. Once the data is found, Watson Discovery uses machine learning algorithms to order the
answers so that the most useful answers are listed first. Discovery gives you a head-start on analytics
by providing time sheets, graphs, and aggregations. Building new collections of data has never been
easier, and discovery service enables developers to rapidly build an automated data pipeline. IBM
respects your right to privacy. When using Watson Discovery Service, you maintain control and own-
ership of your data, and you decide what, if any, data you want to be made public.
23 HANDS-ON LAB: WATSON DISCOVERY
Objective for Exercise:
4. Scroll down and read the answers Watson discovery found from the collection,
you can also read the most relevant answer by looking at the confidence score.
Explanation on Traditional search and Discovery search:
Traditional enterprise search and search engines don’t provide employees and custom-
ers with exact answers. They can’t understand the nuances of phrases and acronyms in
your industry and accurately search through your complex documents in a timely man-
ner.
Watson Discovery solves these challenges. It is enterprise search that delivers specific an-
swers to your queries while also serving up the entire document and supporting links, al-
lowing your employees and customers to make informed decisions with confidence.
5. Now analyse the difference in the Discovery search and Traditional search.
6. Go and explore other given options for the Car manual collection:
7. Click on the answer to open the document and read the Discovery result detail
8. Explore Watson Discovery capabilities and read how Watson came up with these
results by clicking on Next Attribute
23.2 AUTHOR(S)
Srishti Srivastava
23.3 CHANGELOG
Ver- Changed
Date Change Description
sion by
You've probably heard the stats. 90% of the world's data was created in the past two years 80% of
which is unstructured. So what does this really mean. Think about the explosion of data social media
blogs research reports enterprise email. Imagine all the rich insights that can be gleaned if you could
ask the question. For example I just released the new products are people talking more positively
about my brand after the release. Traditionally if you wanted to use data like this to answer a busi-
ness question you had to load the data into a database and do something like count all the records
where people use positive words about my products and then group them by dates. In this example
the data that holds the answer is a big blob of text it's not in a database so the data sits there unus-
able and it cannot be mined. This is where you need Watson Natural Language Understanding. Wat-
son Natural Language Understanding offers a suite of features for text analysis. With Watson Natural
Language Understanding users can answer questions like how can I gather business intelligence to
create dashboards and reports. How can i monitor social media for trends and shifts in public opin-
ion. How can I recommend content that an audience will like. And how can I know what consumers
are saying about my brand The Watson Natural Language Understanding service allows users to un-
derstand the topics mentioned and text by analyzing keywords, concepts and categories. With entit-
ies they can extract the people places and organizations mentioned in text. Users can also under-
stand the sentiment people express including sentiment expressed towards a specific keyword entity
or phrase plus they can take the sentiment analysis one level deeper and detect distinct emotions
behind what people write when knowing if text is positive or negative isn't enough. Finally develop
custom models using IBM Watson Knowledge Studio and use them with Watson Natural Language
Understanding to tailor your solution by extracting domain-specific entities and relations. After
building these custom components you can publish your custom model and use it through Watson
Natural Language Understanding on the Watson developer cloud. Watson natural language under-
standing becomes even more powerful when paired with other services from the Watson developer
cloud use IBM Watson developer cloud vision services to add images and videos to your analysis or
use our speech services to pull insights out of transcribed data from audio files. Watson natural lan-
guage understanding is implemented as a sophisticated suite of API's that support a variety of lan-
guages in varying capacities. They are highly scalable and support large data sets. Data can be sent as
plain text or HTML or as URLs and the results are returned for the features that are specified. Ma-
chine learning or data science expertise is not required to use the API's. And the data is always main-
tained and controlled by the owner
25HANDS-ON LAB -WATSON NATURAL LANGUAGE
UNDERSTANDING
25.1
EXPLORING WATSON NATURAL LANGUAGE
UNDERSTANDING
Note:
The complete article can be read at: CBC News -‘Like Christmas every
day’: A billionaire’s pledge to erase this class’s college debts could echo for decades
Follow Rav Ahuja
25.2 AUTHOR(S)
Rav Ahuja
25.3 CHANGELOG
Ver- Changed
Date Change Description
sion by
It used to be impossible for anyone without a PhD in Machine Learning to teach a computer to un-
derstand specialized terminology. If you've embraced cognitive computing, you know the value of
gaining insights from your unstructured data. But for specialized areas, in order to pinpoint the in-
formation you need, a cognitive system needs to be taught the unique language used. For example,
you need to teach the system what is a virus, a crash, or a worm, for your industry or domain, and
what are the relationships between these entities? Traditional technologies have relied only on pro-
gramming or creating rules to customize natural language systems. Now, with IBM Watson Know-
ledge Studio, you can teach Watson about your specific interest area faster through examples
without writing any code. What used to be measured in years, now is measured in weeks. Instead of
requiring PhDs in artificial intelligence, experts in any field can train Watson. To accelerate training,
you can pre-annotate documents using Watson Natural Language Understanding, specify rules, or
import dictionaries. Then you can fine-tune results to meet your requirements. Knowledge Studio
creates a machine-learning model based on your training. Watson can then learn on its own and
identify entities and relationships that go beyond your training. You use this model to build Content
Analysis applications using Watson Discovery, Watson Natural Language Understanding, or Watson
Explore. Watson Knowledge Studio helps you build a machine learning annotator or to extract in-
formation specific to your business requirements. Watson Knowledge Studio has built-in collaborat-
ive workflow, which allows multiple subject matter experts to work together, contributing to better,
more accurate, and more quickly developed solutions. Watson Knowledge Studio is a single interface
that can be used for the end-to-end development cycle of a machine-learning annotator. It does not
require data science expertise or any programming. Today, Knowledge Studio users have trained
Watson to identify critical content to stop cybersecurity attacks before disaster strikes, and under-
stand software support requests, and track down information about rare diseases. Across financial,
legal, technical, and environmental industries, applications using Watson Knowledge Studio can
identify new opportunities, trends, and threats.
27HANDS-ON LAB - WATSON KNOWLEDGE STUDIO
27.1 EXPLORING WATSON KNOWLEDGE
STUDIO
Learn how Watson Knowledge Studio analyze pieces of text, first with the Domain
model, and then with the Untrained model.
Comparing the results for both models.
IBM provides an online demo of Watson Knowledge Studio at: Watson Knowledge Studio
Use the following steps to explore the demo:
27.3 CHANGELOG
Ver-
Date Changed by Change Description
sion
29.2 AUTHOR(S)
Rav Ahuja
29.3 CHANGELOG
Ver- Changed
Date Change Description
sion by
IBM Watson provides a portfolio services, tools, and APIs to enable businesses to
use and develop AI powered applications.
The Watson AI portfolio enables you to perform a wide range of tasks, including ac-
celerate research and discovery, enrich your customer interactions, scale expertise
and learning, and detect liabilities and mitigate risk.
Watson Assistant helps you to build chatbots and virtual assistants for a variety of
channels, including mobile devices, messaging platforms, and even robots.
Watson Discovery unlocks hidden value in data to find answers, monitor trends and
surface patterns with the world’s most advanced cloud-native insight engine.
Watson Natural Language Understanding offers a suite of features for text analysis
extracting entities, relationships, keywords, semantic roles in up to 13 languages.
Watson Knowledge Studio provides you with a way to teach Watson the language of
your domain with custom models that identify entities and relationships unique to
your industry.
Watson Speech to Text converts audio and voice into written text for quick under-
standing of content.
Watson Text to Speech converts written text into natural-sounding audio in a variety
of languages, dialects, and voices.
Watson Text to Speech enables you to construct very specific pronunciations for
terms, phrases, and words that may appear in your use case.
33.1.1.4 And about language services:
Watson Language Translator translates text from one language to another, enabling
you to communicate with your customers in their own language.
Watson Natural Language Classifier uses machine learning to analyze text, and la-
bels and organizes data into custom categories.
IBM Watson
Watson Assistant
Watson Discovery
34 INTRODUCTION
In this Module, you will learn about some of the Watson AI services offered
on the IBM Cloud. You will understand how organizations can use Watson
AI services and the types of situations in which each service applies.
35LEARNING OBJECTIVES
Describe Watson Data Services.
36 WATSON STUDIO
Every business wants to work smarter. And to do that, you need to tap into your
company's greatest resource, your data. But extracting the full value out of your
data isn't always an easy process. First, you end up juggling an incredibly large
and complex collection of tools that are used for finding and cleaning data, ana-
lyzing and generating visualizations of that data, and using the data to build and
deploy machine learning models. And to make matters worse, these tools are
often a time drain to individually manage and can be difficult to integrate into
your system, which can really slow down the workflow. But not anymore. Us-
ing Watson Studio, you can simplify your data projects with a streamlined pro-
cess that allows you to extract value and insights from your data to help your
business get smarter faster. It delivers an easy to use collaborative data science
and machine learning environment for building and training models, preparing
and analyzing data, and sharing insights, all in one place. Watson Studio's easy-
to-create visualizations and drag and drop code put the power of database de-
cision making into the hands of any member of your organization, with no need
for IT assistance. And if you need access to open source tools, the environment
offers some of the most popular and powerful ones available. Watson Studio's
single environment also creates a workflow that's incredibly efficient. So data
scientists can share assets and work to solve problems within the system rather
than starting from scratch every time a new issue arises. And developers can
use that efficiency to quickly dive into building machine learning and deep
learning algorithms. In fact, in the area of deep learning, Watson Studio sup-
ports some of the most popular frameworks and can deploy that deep learning
onto the latest GPUs to help accelerate modelling by making it easier to use.
The environment's built-in Neural Network Modeler also helps you build mod-
els with a simplified graphical interface even if you don't have the dedicated re-
sources to build a model from scratch. Watson Studio can help you get started
with modelling templates for areas such as visual recognition, language classi-
fication, and other tools from IBM Watson services. Because Watson Studio is
seamlessly integrated with the IBM Watson Knowledge Catalog and intelligent
asset discovery tool, you can transform data and models into trusted enterprise
resources, and collaborate with confidence without compromising compliance,
security, or access control. Watson Studio provides many benefits for organiza-
tions, helping to infuse AI into the business and drive innovation. You can train
Watson Studio with embedded AI services, including Watson Visual Recogni-
tion. You can customize your models and deploy them as APIs or Core ML by
using open-source tools like Jupyter, Notebooks, Anaconda, and RStudio. Wat-
son Studio supports most popular code libraries as well as no code visual mod-
elling with Neural Network Modeler. For designing neural architectures using
the most popular deep learning frameworks. In Watson Studio, you can inter-
actively discover, cleanse, and transform your data using Data Refinery. It helps
you understand the quality and distribution of your data with built-in charts and
statistics, and provides visualized results through interactive dashboards. Wat-
son Studio includes an intuitive drag and drop interface that enables a non-pro-
grammer to speed up the model building process by visually selecting, config-
uring, designing, and auto-coding neural networks. From development and
training to production and evaluation, Watson Studio tracks your models over
time to ensure you have the best performance for any given task, using the best
solutions across the entire life cycle of your machine learning models..
39 WATSON OPENSCALE
AI is shaping the future of business. From chatbots and text analysis, to smart re-
commendations. Organizations in every industry are taking the first steps towards
adopting it. But many still see AI as a black box that spits out mysterious answers.
And because it's constantly evolving, the teams that manage it don't have the
time or the resources to keep up, let alone scale it. Enter IBM Watson OpenScale,
an open platform that gives businesses a clear accurate view of their AI systems,
helping them monitor and fine tune performance across their lifecycle. Let's take
an insurance company that's using AI to process claims. The system suggests re-
jecting an applicant who seems to tick all the boxes. How can the claims process
understand why? An explain ability feature enables them to get detailed answers
in terms anyone can understand, should customers or regulators ask. Traceability
lets them retrace the process step-by-step right back to the documents and data
the AI drew from. If harmful bias has swayed an outcome, a bias feature pinpoints
how it occurred and automatically mitigates it. With companies struggling to
bridge the widening skills gap, Watson OpenScale automates key aspects of the AI
life-cycle. This makes creating, scaling, and evolving AI models much simpler.
Within Watson OpenScale, a revolutionary technology called NeuNetS short for
Neural Network Synthesis, can quickly and automatically build models from your
latest data while recommending new models to be applied across your business.
Since Watson OpenScale is designed to be open, you can easily connect new mod-
els no matter how or where your existing AI was built. IBM Watson OpenScale
puts businesses in complete control of their AI's full life-cycle, giving them the
confidence to scale it and make fast accurate decisions free from harmful bias, all
while being open and easily plugged in to existing processes.
40 COMPUTER VISION, ITS APPLICATIONS, AND IBM
WATSON
Can you talk about Computer Vision and how IBM can help in that space? Com-
puter Vision is, of course, one of the most exciting fields within machine learning.
In fact, it was one of the first machine learning fields all together to be advanced.
If you take a look at the ImageNet challenge, about six or seven years ago when
Geoffrey Hinton from Toronto, actually, created the very first AlexNet neural net-
work. And when he actually used back propagation with a convolutional neural
network for the very first time and blew every other contestant in the ImageNet
Challenge out of the water, that was really one of the first real applications of ma-
chine learning. It really has its roots in Computer Vision. And that's one of the
main fields of machine learning, as well, that people are interested in. So Watson
provides a lot of different services when it comes to visual recognition, these sorts
of applications. Of course, as I mentioned, there's the Watson Studio where you
can create your own neural network, but there's also the dedicated Watson visual
recognition service. It has a lot of different pre-trained models. Like for example,
it has models that can help you recognize different kinds of food. It has models
that can help you recognize different kinds of objects, in general, on the ImageNet
database. And the best part is, that it also provides custom training functionality.
So you're not just limited to what Watson thinks you need, you can now go ahead
and take whatever your data is, like for example, take a picture of this power line,
does it need maintenance or not? Use these images, train Watson, and use the
power of transfer learning on Watson's already amazing neural networks in order
to get your data set trained on a model with very high accuracy in very, very little
time, in a very, very cost-effective way. So, Computer Vision is another field that
Watson excels in, both with your custom models, your custom data, and with pre-
trained models that Watson provides. Can you talk a little bit about some of the
applications of Computer Vision? Sure, there are lots of different applications for
Computer Vision. And I'd like to share just two of my favourite applications that
I've had so far. Now one of the main applications for Computer Vision technology,
if you take a look at it, and one of the most glamorous, I'd say, applications for
machine learning in Computer Vision, would be self-driving cars. Now that's one
that people can see, they can recognize, and they can relate with practically in-
stantly. Because it's something that everyone does. If someone drives, they un-
derstand the experience of driving and how Computer Vision could play a role
here. So for example, if you take a look, Nvidia has been very, very powerful tech-
nology when it comes to Computer Vision. They've been working on their own
custom neural network architectures. And they've got very powerful neural net-
works that can even, in some cases, do unsupervised Computer Vision for self-
driving cars. And Watson has all these capabilities, and it even makes it easier for
programmers to implement these algorithms because of, for example, the Wat-
son Studio. And I sort alluded to this in the past, but another great example of
how Watson's being used is to, for example, reduce human effort in many differ-
ent scenarios, like checking for maintenance of power lines. Now, right now if you
can imagine, there are teams of electricians that would actually need to go and
drive all across a power line, checking if there's anything wrong, and if they miss
something, well, they're going to have to do it all over again. And the thing is, this
is not a very, very efficient system. This is not easy. This is not cost effective. This
takes way too much time. And it doesn't get power back in people's homes very
quickly. But with Watson, you can actually have a drone that's either manually pi-
loted or completely automatically piloted that automatically goes throughout that
whole power line. Automatically takes pictures of what's happening on the
ground, analyses them and returns back whether or not this certain section needs
maintenance. This is really powerful technology that can reduce the amount of
effort that it requires for humans in a certain field.
2. Once the demo is open, you should see the below screen:
You can use Google to download the images to test the model.
o Upload a Hot Dog image and analyze the result. Once uploaded the pre-
diction should be shown as below:
o Upload a Pizza image and checkout the model returns Not a hot dog
You may try uploading different images and check how good the pre trained model
works.
Note: You can check out more demos on CV Studio at the following link
42.2 AUTHOR(S)
Srishti Srivastava
42.3 CHANGELOG
Date Version Changed by Change Description
04-
06- 2.0 Srishti Created Lab
2021
46MODULE SUMMARY
46.1.1 In this module, you have learned about data services:
Watson Studio lets you build, train, deploy and manage AI mod-
els, and prepare and analyze data, in a single, integrated environ-
ment.
Watson Machine Learning enables you to use your own data to
create, train, and deploy machine learning and deep learning
models.
Watson Knowledge Catalog drives collaboration and transform
data and AI into a trusted enterprise asset through dynamic data
policies and enforcement.
Watson OpenScale provides insights into AI health, recommends
next steps to improve outcomes, and orchestrates tasks to re-
mediate issues around performance, accuracy, and fairness.
46.1.1.1 About vision services:
Watson Studio
Watson Machine Learning
Watson Knowledge Catalog
Watson OpenScale
Watson Personality Insights
Watson Tone Analyzer
Watson Compare and Comply
47 INTRODUCTION
In this Module, you will learn about common use cases for AI, and look at
some case studies involving Watson AI. You will also experience and
demonstrate AI in action yourself using Watson.
48 LEARNING OBJECTIVES
Describe some real-world applications of Watson.
Demonstrate Watson in action with a hands-on project.
49 WATSON AT WORK
In 2011 an IBM cognitive system won Jeopardy. Now cognitive systems are tack-
ling business challenges as varied as operations and healthcare. Let's see how IBM
Watson is helping elevator engineers. >> Hello my name is Watson, greetings
from the top of Q1 tower. You might be wondering how I got here, I did not climb
the 1331 stairs in this skyscraper. Instead, I took an elevator operated by Kone.
Everyday Kone helps to transport approximately one billion elevator and escalator
passengers throughout the world. And I am working with them to help ensure
smoothness with every ride. Elevators are being equipped with IOT sensors that
connect to the IBM cloud which I can analyses for wear and tear, bumpy rides and
the smallest misalignments. I can immediately alert maintenance crews of any is-
sues via their smartphones, provide probable causes and solutions and help them
run tests remotely. With this information along with data from structured and un-
structured sources, I can prioritize jobs and help technicians continue providing a
great passenger experience. With my help, engineers are fixing potential prob-
lems before they happen. Working together that can help Kone service techni-
cians speed up repairs and make rides smoother. This lowers your chances of
spending too much time in an elevator with a co- worker, I have heard that can be
awkward.
>> From the big city to a rural doctor's office, Watson can help.
>> So, you miss the big city?
>> I don't miss much, definitely not the traffic
. >> Excuse me, doctor, the genomic data came in.
>> Thank you. >> You can do that kind of analysis?
>> Yeah, Watson.
>> I can quickly analyse millions of clinical and scientific reports to help you tailor
treatment options for the patient's genomic profile.
>> You can do that, even way out here?
>> Yes, even way out here.
>> Watson and AI can be part of a wide range of business ventures, wherever you
are.
Bradesco
Bradesco is one of Brazil’s largest banks, with over 5,200 branches. Before
they partnered with IBM to create an AI system, branch employees had to
call a central office for answers to unresolved queries. As the employee
waited, customer also waited, and sometimes those waits were lengthy.
Not good for any company in a highly competitive industry. Being IBM’s first
customer in Brazil brought meant that Watson not only had to learn Bra-
desco’s products in detail, it had to learn it in Portuguese – including cul-
ture, regional accents, and regional variations in question structure.
COCA-COLA COMPANY
The Coca-Cola Company is interested in the possible in-field applica-
tions of Watson Services for Core ML, and is exploring visual recogni-
tion for problem identification, cognitive diagnosis and augmented
repair of their beverage dispensing machines.
With Watson Services for Core ML, Coca-Cola developed an app that
uses visual recognition and augmented reality to help the technician
on-site. Using the app, the technician can use their iPhone or iPad
camera to diagnose system problems via a virtual overlay and guided
instructions pulled from the cloud. Watson Visual Recognition on the
device helps the technician identify unfamiliar systems and parts.
54 WATSON AT ADNOC
Digital technology is now starting to come into the oil business. The com-
mon practice was that we utilize our expert geologists who are limited in
number to describe all the classification of rocks, and ultimately identify the
right locations for our wells to be drilled. They love to capture knowledge,
transfer that knowledge to a younger generation. Artificial intelligence is the
way to go to help us meeting these targets. The time has come for the di-
gital transformation to come into the oil business. When we started out,
there was a very important question, "Can artificial intelligence really be ap-
plied to such a technical domain such as geology? " ADNOC and IBM are
now having this joint project to apply technology which is used to recognize
flowers to be applied into rock classification. We use the high resolution
photos to populate the database in the IBM software. IBM Watson team
were translating this into the image recognition model of Watson to accur-
ately describe the same level of our geologists. When we started testing, I
started to see the outcome. It was eye-opening for both sides. With this
technology, we can go into thousands of analysis per day. So it's not only
rock data, but it will go also to seismic data, and more and more areas to
come. We've already announced our plan for five million barrels per day.
The only way we can achieve this ambitious project is through technology.
We have gained and retained our expert knowledge into machine and then
we can utilize it in anytime with our young generations on solving a new
challenges. Digital transformation is about understanding our industry and
understanding our business better. Also, it helps us to retain knowledge.
KONE uses Watson to help monitor the condition of equipment and predict
maintenance and upgrade requirements, to help the customer manage
their equipment over its entire lifecycle. This means less downtime, fewer
faults, and more detailed information for maintenance crews.
56 WATSON AT LIVEPERSON
Like nobody really wants to make a phone call. Typically, email is a little too much.
So you want to do it in the ways that you want to which is messaging, text mes-
saging, Facebook Messenger, through the brand's app. Right now, it's a mess. A
brand has 8 to 10 touch points with a consumer across different social networks,
email relationship, call enter. For the first time, messaging is a platform that can
reach every consumer. The biggest problem, the primary one is this terrible legacy
voice system. So it's absurd that you have to spend 20 minutes or 30 minutes on
hold with a large company that you're paying or do business with them. So it's
both terrible for consumers, they can't stand 800 numbers voice calls, the IVR,
hold music, all these things that make people have see red, they're angry. Every-
body here has made a customer service phone call and you walk away and you're
like this is horrible. But think about that life as an agent. They're getting that con-
stantly from the other side of all day long, almost no breaks. So there's heavy at-
trition in that industry, it's upwards of 40 percent in some cases which is a very,
very large attrition number. Working with the Watson team has been amazing,
fantastic. With Watson's a leading, the leading AI out there. There's almost
nobody that's even close at this point in time. So when we take our leading plat-
form and a leading AI such as Watson and we pulled them together, it elevates
the platform to a much bigger level. In our system, Watson is like an agent itself.
Watson sits alongside human agents. If Watson can't answer something, the sys-
tem passes it seamlessly to a human agent. We're cutting costs for brands, we're
increasing conversations. More conversations are coming through. We're giving
agents a better job. We're allowing them to up level their jobs, we're allowing
them to think about things in the right way, and really use their intelligence across
the board in a better way. I've seen certain situations, very specific situations in
certain departments where we're getting to 80 percent of conversations being re-
solved by the AI. That's a pretty fantastic number. Agents are judged on things like
CSAT, customer satisfaction. You can do the same thing with Watson, virtual
agents, digital agents. They can and they should be measured just like humans. I
think that brands are going to be putting messaging front and center. We're going
to move into a future that there's going to be less apps and less complex website,
these all going to be inside a conversation. The brands that make it the most
seamless for to reach them on messaging are going to win. You can bring the best
of the AI world and the human world into a single system, totally seamlessly and
make customers happy. To the first time in history, you've had 100 percent access
to people, 100 percent of the time. That as a premise changes the way that
brands and consumers will interact with each other.
WOODSIDE
Woodside is Australia’s largest independent oil and gas company.
It’s an industry requiring absolute accuracy, and previously Wood-
side has relied on historical context and procedural information to
ensure precision. The problem is, that historical context is being lost
as the older generation of workers retires. So, the question for Wood-
side is how to retain that information in a way that is accessible and
useful for the current workers.
58 WATSON AT HILTON
Hi, Connie. How may I help you? I am Hilton's newest concierge in training.
Thanks to a pilot project between Hilton and IBM. Hospitality is a really in-
teresting use case for Watson because inevitably, you have people who
need information. They need to find a restaurant, they need to find a park,
they need to get directions. We operate in a very crowded industry. So in-
novation is key. Innovation has to help solve problems operationally. Innov-
ation has to help our customers. It's an opportunity to do really delight cus-
tomers in ways that they don't expect. We're really excited about being able
to build out the cognitive learning capabilities with IBM and Watson. At the
same time, as we have Connie interacting with our guests. It's much more
natural. It's something that people can identify with as much more comfort-
able and something that allows them to have a more insightful interaction
actually. It allows us to really serve people, understand what they're looking
for, sense their emotions, sense their level of urgency. To be able to take
robotics and artificial intelligence and introduce it to the hotel business as a
way of helping us operate more efficiently, helping us to delight our custom-
ers, it's a big dream. What excites me about this partnership is the courage
of Hilton to try something new, the courage of wave laser to build on the
technology. So that courage is going to push us to continue to advance
Connie, and that's also going to allow the humans who work in those hotels
to go beyond that to help people even further by having Connie do the ba-
sic things. Goodbye. I hope to be able help you with Hilton Hotels again
soon.
59 MODULE SUMMARY
59.1.1 In this module, you have learned:
Please check the box and click on the "Open tool" button below to get a unique
Feature Code to activate your IBM Cloud trial account.
We have also provided you with the stepwise instructions on how to create an
IBM Cloud account for your reference.
NOTE: If you have already applied your IBM Cloud feature code in another course/
lab to create an IBM Cloud account, please skip this item, as the code can only be
used once.
CAUTION:
While signing up for an IBM Cloud account, or at a later stage, you may be promp-
ted to enter a credit card. Please note that access to paid services or a credit card
is NOT required to complete any mandatory labs/projects / or assignments in this
course. Instead, those enrolled in this course have access to a Feature Code, which
enables trial access to IBM Cloud for a limited duration. Therefore, we strongly re-
commend that you DO NOT enter a credit card to complete the required course
components.
If you still choose to enter your Credit Card to use IBM Cloud services, you will be
liable to pay any resulting charges billed to your credit card. The course team does
not take any responsibility for such charges.
In case you encounter issues while activating your account with a Feature Code, or
your trial has ended, and you have not yet completed the course, please contact the
course support team via the course discussions forums for assistance instead of
adding a credit card to your IBM Cloud account.