WWW - K2view - Com - What Is Retrieval Augmented Generation
WWW - K2view - Com - What Is Retrieval Augmented Generation
What is Retrieval
Augmented
Generation?
Updated May 5, 2024
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
on the user’s query, transforms it into an enriched, contextual
prompt, and invokes the LLM via its API. The LLM responds with
an accurate and coherent response to the user. This is LLM AI
learning in action.
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
Traditional text generation models, typically based on
encoder/decoder architectures, can translate languages, respond
in different styles, and answer simple questions. But because
these models rely on the statistical patterns found in their training
data, they sometimes provide incorrect or irrelevant information,
called hallucinations.
03
RAG architecture
The RAG architecture diagram below illustrates the retrieval-
augmented generation framework and data flow, from the user
prompt to response:
04
Retrieval-augmented
generation challenges
An organization usually stores its documentation of internal
processes, procedures, and operations in offline and online docs –
with its business data fragmented across dozens of enterprise
systems, like billing, CRM, and ERP.
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
So, instead of relying solely on its public, static, and dated
knowledge base, the enterprise LLM actively ingests relevant data
from a company’s own sources to generate better-informed and
relevant outputs.
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
According to the 2024 Gartner LLM report, Lessons from
Generative AI Early Adopters, "Organizations continue to invest
significantly in GenAI, but are challenged by obstacles related to
technical implementation, costs, and talent."
05
Retrieval-augmented generation
use cases
RAG AI use cases span multiple enterprise domains. Enterprises
use RAG for:
Departme
Objective Types of RAG data
nt
Product documentation
Product specs
Engage with
customers via a Customer profile and
chatbot or a sales demographics
Sales and consultant to
Customer preferences and
marketing describe products
purchase history
and offer
personalized Targeted personas and
recommendations. behaviors
Campaigns
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
Fraudulent activities and
related data, previously
detected by the company
Identify fraudulent
Risk
customer activity. Real-time customer
transaction and activity
data
06
Benefits of retrieval-augmented
generation
For generative AI, your data is your differentiator. Once you get
started with RAG, you'll benefit from:
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
07
Recommendations for
implementing RAG
In its 12/2023 report, “Emerging Tech Impact Radar:
Conversational Artificial Intelligence”, Gartner estimates that
widespread enterprise adoption of RAG will take a few years
because of the complexities involved in:
All of the above are challenging for enterprises due to skill set
gaps, data sprawl, ownership issues, and technical limitations.
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
In the Gartner RAG report of 1/2024, “Quick Answer: How to
Supplement Large Language Models with Internal Data”, Gartner
generative AI analysts advise enterprises preparing for RAG to:
08
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
An LLM is a foundational Machine Learning (ML) model that
employs deep learning algorithms used in natural language
processing. It’s trained on massive amounts of open source text
data to learn complex language patterns and relationships, and
perform related tasks, such as text generation, summarization,
translation, and, of course, the answering of questions.
1. Sourcing
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
identifying attributes), transactional data (e.g., service requests,
purchases, payments, and invoices), and interaction data (emails,
chats, phone call transcripts), must be integrated, unified, and
organized for real-time information retrieval.
Depending on the use case, you may need to arrange your data by
other business entities, such as employees, products, suppliers, or
anything else that’s relevant for your use case.
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
assigned role. For example, a customer service rep serving a
specific customer segment might be prevented from accessing
data about customers not in their segment; similarly, a marketing
analyst might not be given access to certain confidential financial
data.
For example, we can ask the LLM to reflect on the data it already
has and let us know what additional data is required, or why the
user terminated the conversation, etc.
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
09
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
Today’s enterprises store vast amounts of information – like
customer service guides, FAQs, HR documents, manuals, and
research reports – across a wide variety of databases. However,
keyword-based retrieval is challenging at scale, and may reduce
the quality of the generated responses.
10
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
A real-time 360° view of the relevant business entity is required, be
they customers, employees, suppliers, products, loans, etc. To
achieve this, you need to organize your enterprise data by
whichever business entities are relevant for your use case.
Finally, to give your LLM tools visibility into all your cross-system
data, an AI database schema generator should be part of any
enterprise RAG solution.
11
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
RAG chatbot: A natural starting
point
When customers need a quick answer to a question, a RAG
chatbot can be extremely helpful. The problem is that most bots
are trained on a limited number of intents (or question/answer
combinations) and they lack context, in the sense that they give
the same answer to different users. Therefore, their responses are
often ineffective – making their usefulness questionable.
But once RAG augments the airline’s LLM with that particular
user’s dataset, a much more contextual response could be
generated, such as, “Francis, you have 929,100 miles at your
disposal. For Flight EG17 from New York to Madrid, departing at 7
pm on November 5, 2024, you could upgrade to business class for
30,000 miles, or to first class for 90,000 miles. How would you like
to proceed?”
What a difference!
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
The Q&A nature of chat interactions make the RAG
chatbot an ideal pilot use case because
understanding the context of a question – and of the
user – leads to a more accurate, relevant, and
satisfying response.
In fact, chatbots that are used by service and sales agents are the
natural entry point for RAG-based generative AI apps.
12
In fact, new RAG generative AI use cases are emerging all over the
place, for example:
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
the last the payments is about to annual
quarter he made terminate premium
13
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
With GenAI Data Fusion, your data is:
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
360° views of any business entity
Fresh data all the time, in sync with underlying systems
Dynamic data masking, to protect sensitive AI data
Role-based access controls, to safeguard data privacy
Reduced TCO, via a small footprint and the use of commodity
hardware
An entity’s data can be queried by, and injected into, the RAG LLM
as a contextual prompt in milliseconds. Entity-based RAG
essentially assures AI data readiness.
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
marketing ions for call activity
campaigns center agents in a user
account
Retrieval-Augmented
Generation FAQs
1. What is Retrieval-Augmented
Generation (RAG)?
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
4. Can RAG provide sources for the
information it retrieves?
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
Platform Architecture Initiatives eBooks Company
Overview
Overview Data Fabric Architecture
Architecture Test Data Management
Management Test Data Management
Management About
Micro-Database
Micro-Database Data Mesh Architecture
Architecture Data Masking
Masking Data Masking
Masking Contact
Data Integration
Integration Data Hub Architecture
Architecture Synthetic Data
Synthetic Data Generation
Generation Data Anonymization
Anonymization Customers
Data Virtualization
Virtualization Enterprise Data
Enterprise Data RAG
RAG Synthetic Data
Synthetic Data Generation
Generation News
Industries
Data-as-a-ServiceAutomation
Data-as-a-Service Automation Data Tokenization
Tokenization Retrieval Augmented
Retrieval AugmentedGeneration
Generation Resources
Telco and
and Media
Media
Data Governance
Governance Customer Data Integration
Integration Customer 360
360 Partners
Partners
Financial Services
Financial Services
Data Product
Product Catalog
Catalog Data Migration
Migration Data Products
Products Academy
Healthcare
Healthcare
Data Orchestration
Orchestration Data Pipelining
Pipelining Data Fabric Careers
Operational Intelligence
Operational Intelligence iPaaS Support
Data Virtualization
Virtualization
PDFmyURL converts web pages and even full websites to PDF easily and quickly.
© COPYRIGHT 2024 K2VIEW Privacy Policy Security Terms Of Use Cookie Policy
PDFmyURL converts web pages and even full websites to PDF easily and quickly.