We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
    Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
    23 Min Read
    Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
    From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
    12 Min Read
    Flat editorial illustration: The article contrasts passive follower totals with a behavioral path from attention and trust to cli
    Creator Analytics Beyond Follower Count: Seven Metrics That Measure Audience Behavior
    11 Min Read
    Flat editorial illustration: The article connects AI and marketing analytics with managerial judgment grounded in consumer behavi
    How an Online MBA in Marketing Connects AI and Data Analytics
    11 Min Read
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Never Stop Expecting More from Your Unstructured Data
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > Social Media Analytics > Never Stop Expecting More from Your Unstructured Data
Big DataBusiness IntelligenceSocial Media AnalyticsText AnalyticsUnstructured Data

Never Stop Expecting More from Your Unstructured Data

LScagliarini
LScagliarini
6 Min Read
Never Stop Expecting More from Your Unstructured Data
Illustration generated with Qwen Image.
SHARE

Where there is information, there is also software trying to make sense of it and traditionally, this software is based on keyword technologies. These technologies are so widely used that it is common to think that using keywords is an easy and effective way to access and analyze information. But in reality, this is not completely true. 

Keyword technologies use probabilistic algorithms that focus on matching and are not able to make sense of the exact meaning of each word in search. Today’s businesses are dealing not only with traditional structured data, but more and more with the unstructured data (text, email and documents and more) that fill our databanks, file sharing systems and CRMs. Analysts rightly wonder how they can effectively relate the structured with the ever growing volume of unstructured data for something meaningful.

Semantic technology is able to understand a text in a way that emulates human comprehension of information.  For example, it can identify that a text is about “education” and “sport” even if it doesn’t explicitly contain the two words, but concepts that are correlated to them (“education”: school,  tutoring, teacher, math, etc.; “sport”: game, team, score, football, quarterback, etc.).

More importantly, it also comprehends conversational language and all its ambiguities (slang, abbreviations, multi-language text) to arrive at an understanding of not just words, but the user’s intention. A good example of this at work can be seen in the recent analysis that the social research firm Sociometra conducted using over 30,000 comments made on social media of tourist destinations (museums, monuments, etc.) and general comments about the city of Rome, Italy.

More Read

How BI and Data Analytics Professionals Used Twitter in September
How BI and Data Analytics Professionals Used Twitter in September
Why the Best Accident Lawyers Are Using AI
The 4 Phases of a Decision
OLTP meets OLAP, BI Conferences, Sybase Who? And Other News
Some thoughts on advanced analytics

The analysis showcases the technology’s power for analyzing unstructured text and its strength in establishing connections between not just words, but more importantly, concepts. A majority of comments focused on the topics of flights, air travel, taxis, the subway, buses, which the system recognized as within the category of “transportation.” In this way, semantic technology was able to categorize comments based on their stated or implied subject matter and expose a hierarchy of the top concepts mentioned by commenters.

In the same way, it was able to differentiate among even ambiguous information to determine the proper context of the value judgment “cheap” which could be intended as good, frugal or indicating poor quality, disappointing. Without an ability to capture the overall context thanks to a correct linguistic analysis (morphology and grammar, syntax, lexicon), it is difficult to make a distinction between two or more meanings.

Here, it’s not about the guesswork of keywords, but the ability to distinguish one word with many meanings and many words that have or are correlated to the same meaning.

 In the business domain, there is a constant need for analysts to understand more and more information. And while there are plenty of good systems to analyze structured data, it requires the constant development (and anticipation of) new lists of keywords and information to train the system so that it is able to discover and share strategic links and patterns between unstructured information and data points within their large databases.

The problem is that most organizations do not have the time or resources to do the regular document training needed to fulfill their needs for deeper knowledge. It’s next to impossible to manually think about all the terms that could have the same meanings or the multiple ways to say something in English or any other language, not to mention all of the other insights or low-lying trends that have been underestimated or overlooked.

Is semantics the panacea for every analyst then? Of course not. Keywords can be useful but we are aware of their limitations. Integrating semantics with keyword technology through faceted search is a hybrid solution that helps further refine search along different paths according to a certain order or category and it could be a solution to start the migration to a full semantic search.

Companies expect more from their unstructured data. It’s not enough to be able to access it, but it can only add value if it is accurately processed.

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Flat editorial illustration: The article connects downstream report failures, data-quality gaps, and conflicting metric definitio
Signs Your Data Architecture Needs an Outside Review
Big Data Exclusive
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Big Data Exclusive
Flat editorial illustration: The article contrasts tools for gathering fresh interviews with tools for analyzing existing qualita
10 AI Market Research Tools That Turn Qualitative Data into Insights
Artificial Intelligence Big Data Exclusive
Flat editorial illustration: The article compares proxy MCP servers by what an AI agent can do through them: manage proxy account
Proxy MCP Servers: 7 Options and What Each Lets an AI Agent Do
Artificial Intelligence Big Data Data Collection

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

Big Data
Big DataRisk ManagementSecurity

5 Best Practice Tips To Secure Your Big Data

6 Min Read
Recap of the Government Big Data Forum of 26 Jan 2011
Data QualitySecurity

Recap of the Government Big Data Forum of 26 Jan 2011

4 Min Read
Data Lakes and Network Optimization: What’s Next for Telecommunications and Big Data
AnalyticsBig DataBusiness IntelligenceCloud ComputingData MiningData QualityData VisualizationData WarehousingHadoopHardwareITMapReduceOpen SourceSoftwareSQLUnstructured DataWorkforce Data

Data Lakes and Network Optimization: What’s Next for Telecommunications and Big Data

6 Min Read
Digital data explosion highlights need for new-age Database and Business Intelligence technologies
AnalyticsBusiness IntelligenceData WarehousingDecision ManagementKnowledge ManagementWeb Analytics

Digital data explosion highlights need for new-age Database and Business Intelligence technologies

6 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?