We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
    Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
    23 Min Read
    Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
    From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
    12 Min Read
    Flat editorial illustration: The article contrasts passive follower totals with a behavioral path from attention and trust to cli
    Creator Analytics Beyond Follower Count: Seven Metrics That Measure Audience Behavior
    11 Min Read
    Flat editorial illustration: The article connects AI and marketing analytics with managerial judgment grounded in consumer behavi
    How an Online MBA in Marketing Connects AI and Data Analytics
    11 Min Read
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Correlating Gas Prices with Social Media Sentiment
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > Sentiment Analytics > Correlating Gas Prices with Social Media Sentiment
AnalyticsSentiment Analytics

Correlating Gas Prices with Social Media Sentiment

AnniePettit
AnniePettit
2 Min Read
Correlating Gas Prices with Social Media Sentiment
Illustration generated with Qwen Image.
SHARE

Sentiment analysis isn’t perfect and anyone who has tried to do it with social media data will confirm that. The nuances of language, including sarcasm, emoticons, slang, spelling errors, grammar creativity, and more mean that 100% accuracy is simply unattainable. But in market research, we aren’t looking for 100% accuracy, not even 90% accuracy. We know those kinds of numbers are unrealistic. What we expect, however, is to see that social media data has some relationship with real world data. And that is what we investigated here.

This project began by simply finding a third party source of fuel prices and we turned to Gasbuddy to give us average monthly US gas prices. Given that we estimated data points by carefully eyeballing a chart on the screen, the Gasbuddy numbers aren’t accurate to the last decimal place. But if you compare our Gasbuddy chart with the official chart, you’ll see that the trend is accurate. This is our criterion dataset.

The second dataset came from Conversition’s Evolisten database. We collected hundreds of thousands of verbatims from thousands of websites all of which in some way referenced fuel or gas prices or costs. Twitter, Facebook YouTube, Flickr, any type of website where people felt like sharing their opinions about gas prices was our target. After cleaning out the spam, we measured the sentiment of the remainder of opinions. Then, we calculated the inverse of the sentiment score. For example, a score of 5 (very positive) was changed to 1 (very negative), and a score of 1 was changed to a 5.

What you see in this chart is a correlation of 0.65. In other words, as the price of gas increases, sentiment decreases.

It just makes me think… what if everyone tweeted and messaged that the price of gas was really low. Could we turn this correlation into causation? It’s worth a try!

conversition evolisten fuel prices sentiment

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

b2b payment data tells supplier about its customers
What B2B Payment Data Tells a Supplier About Its Customers
Business Intelligence
Flat editorial illustration: The article connects downstream report failures, data-quality gaps, and conflicting metric definitio
Signs Your Data Architecture Needs an Outside Review
Big Data Exclusive
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Big Data Exclusive
Flat editorial illustration: The article contrasts tools for gathering fresh interviews with tools for analyzing existing qualita
10 AI Market Research Tools That Turn Qualitative Data into Insights
Artificial Intelligence Big Data Exclusive

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

So Does Toyota Really Have a Quality Issue?-Lean Six Sigma Perspective
Big DataInside CompaniesMarket ResearchWorkforce Analytics

So Does Toyota Really Have a Quality Issue?-Lean Six Sigma Perspective

5 Min Read
Using Data Analysis to Improve and Verify the Customer Experience and Bad Reviews
Analytics

Using Data Analysis to Improve and Verify the Customer Experience and Bad Reviews

6 Min Read
A Revised "Promised Land" of BI
AnalyticsBusiness Intelligence

A Revised “Promised Land” of BI

4 Min Read
What to Consider When Choosing a Masters in Business Analytics
Analytics

What to Consider When Choosing a Masters in Business Analytics

15 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

From Bolts to Bots: How AI Is Fortifying the Automotive Industry
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence
AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?