Text Analytics
Text Analytics
1
80% of Data is Unstructured
2
What is Text Analytics?
3
Types of Social Media Text
• Dynamic Text
• Static Text
4
Types of Social Media Text
• Dynamic Text
• Dynamic text is a real-time social media user-generated text or statement to
expresses an opinion about content or information posted over social media.
Examples:
• Tweet
• Comments
• Discussion
• Conversation
• Reviews
5
Types of Social Media Text
• Static Text
• Static social media text is usually large in length (e.g.,
several paragraphs) and is generated, updated, or deleted
less frequently.
Examples:
• wiki content
• a blog page
• Word documents
• Corporate reports
• electronic mail (e-
mail), and
• news transcripts.
Copyright © 2018 Gohar F. Khan 6
Text Industry
7
8
9
Applications for Text Analysis
10
Purpose of Text Analytics
Sentiment
Analysis
Perpose of Social
Concept Trends
Mining Media Text Mining
Analytics
Intention
Mining
• Intention Mining
• Intention or intent mining aims to discover users’ intention
(such as buy, sell, recommend, quit, desire, or wish) from
media text.
13
Purpose of Text Analytics
• Trends Mining
• Trends mining, also known as predictive analytics, is
used to predict future events.
• Concept Mining
• Concept mining aims to extract ideas and concepts from
documents.
15
Text analytics mechanism
Concept Maps
Text Attract
Attitudes
Clustering
Grow
Surveys Categoriza-
tion
Business UI
Operational Fraud
Systems
Attributes
Prediction
Customer Data Expert UI Business
Data Collection User
• IBM (Watson Analytics for SM; could based); IBM SPSS Text Analytics for
Surveys (on premise)
17
Social Media Text Analysis Tools
• Lexalytics: Lexalytics (http://www.lexalytics.com/) is a social media text and semantic analysis tool for social
media platforms, including Twitter, Facebook, blogs, etc.
• Twitonomy: Twitonomy (https://www.twitonomy.com/) is a Twitter analytics tool for getting detailed and
visual analytics on tweets, retweets, replies, mentions, hashtags, followers, etc.
18
Social Media Text Analysis Tools
• LIWC: Linguistic Inquiry and Word Count (LIWC) is a text analysis tool
for analyzing emotional, cognitive, structural, and process
components present in individuals’ verbal and written speech
samples: http://www.liwc.net/
19
Text analytics in action
• https://netlytic.org
20
Text Analytics Issues
21