By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData Collective
  • Analytics
    AnalyticsShow More
    predictive analytics in dropshipping
    Predictive Analytics Helps New Dropshipping Businesses Thrive
    12 Min Read
    data-driven approach in healthcare
    The Importance of Data-Driven Approaches to Improving Healthcare in Rural Areas
    6 Min Read
    analytics for tax compliance
    Analytics Changes the Calculus of Business Tax Compliance
    8 Min Read
    big data analytics in gaming
    The Role of Big Data Analytics in Gaming
    10 Min Read
    analyst,women,looking,at,kpi,data,on,computer,screen
    Promising Benefits of Predictive Analytics in Asset Management
    11 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Walmart Makes Big Data Part of Its DNA
Share
Notification Show More
Latest News
ai software development
Key Strategies to Develop AI Software Cost-Effectively
Artificial Intelligence
ai in omnichannel marketing
AI is Driving Huge Changes in Omnichannel Marketing
Artificial Intelligence
ai for small business tax planning
Maximize Tax Deductions as a Business Owner with AI
Artificial Intelligence
ai in marketing with 3D rendering
Marketers Use AI to Take Advantage of 3D Rendering
Artificial Intelligence
How Big Data Is Transforming the Maritime Industry
How Big Data Is Transforming the Maritime Industry
Big Data
Aa
SmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Data Management > Best Practices > Walmart Makes Big Data Part of Its DNA
Best PracticesBig DataBusiness IntelligenceCulture/LeadershipData ManagementHadoopInside CompaniesITMapReduceMarket ResearchMobilitySocial Data

Walmart Makes Big Data Part of Its DNA

Datafloq
Last updated: 2013/03/17 at 8:01 AM
Datafloq
6 Min Read
SHARE

Walmart started using big data even before the term big data became known in the industry and in 2012 they moved from an experiential 10-node Hadoop cluster to a 250-node Hadoop cluster. At the same time they developed new tools to migrate their existing data on Oracle, Netezza and Greenplum hardware to their own systems.

Walmart started using big data even before the term big data became known in the industry and in 2012 they moved from an experiential 10-node Hadoop cluster to a 250-node Hadoop cluster. At the same time they developed new tools to migrate their existing data on Oracle, Netezza and Greenplum hardware to their own systems. The objective was to consolidate 10 different websites into one website and store all incoming data in the new Hadoop cluster. Since then they have made big steps in integrating big data into the DNA of Walmart.

Social big data solutions

Many of the big data tools have been developed at the Walmart Labs, which was created after Walmart took over Kosmix in 2011. Some of the products that were developed at Walmart Labs are ‘Social Genome’, ‘ShoppyCat’ and Get on the Shelf.

More Read

use ai to get the most out of your social media strategy

Use AI to Get the Most Out of Your Social Media Marketing Strategy

Leveraging Social Analytics for Optimizing Your Marketing Strategy
4 Amazing Time Saving Analytics Tools For Social Media Marketing
How Data Science Is Revolutionising Our Social Visibility
How Businesses Are Using Big Data For Social Media Marketing?

The Social Genome product allows Walmart to reach customers, or friends of customers, who have mentioned something online to inform them about that exact product and include a discount. In order to do this they combine public data from the web, social data and proprietary data such as customer purchasing data and contact information. This has resulted in a vast, constantly changing, up-to-date knowledge base with hundreds of millions of entities and relationships. It helps Walmart to better understand the context of what their customers are saying online. An example mentioned by Walmart Labs shows a woman tweeting regularly about movies. When she tweets “I love Salt”, Walmart is able to understand that she is talking about the movie Salt and not the condiment.

Walmart came across several technical difficulties when developing the Social Genome, among others the quantity and velocity the data pours into their Hadoop clusters. As the regular Map-Reduce/Hadoop framework was not able to cope with the amount and speed the data was coming in, they have developed their own tool called Muppet. This, now open-source, tool processes the data in real-time over all clusters and can perform several analysis at the same time.

The Shoppycat product that was developed by Walmart is able to recommend suitable products to Facebook users based on the hobbies and interests of their friends. It uses the Social Genome technology among others to help customers with presents for their friends. An interesting aspect of this Facebook App is that Walmart will direct the Facebook users to a different store in case the product is sold out at a nearby Walmart store.

Get on the Shelf was a crowd-sourcing solution that gave anyone the chance to pitch his or her product in front of a large online audience. The best products would be sold at Walmart with the potential to suddenly reach millions of customers. Over a million votes were cast and in the end three products are now carried in the Walmart stock.

Mobile big data solutions

With over 200 million customers visiting a Walmart store every week, it is obvious that Walmart aims big at the mobile development. They have developed several iOS and Android Apps that use the latest technology to give their customers the best experience. They even created a few of their own tools and subsequently open-sourced them. These are Thorax and Lumbar. Thorax is framework to build large-scale web applications and Lumbar is a js-build tool that can generate modular platform specific applications.

But there is more of course. As can be expected from the largest retailer in the world, Walmart has an extensive big data ecosystem. This system processes multi-TB’s of new data and PB’s of historical data on a daily basis, covering millions of products and 100s of millions users from internal and external sources. They analyse over 100 million keywords to optimize the bidding of each keyword on a daily basis. The ecosystem is schematically shown in below visual:

Big Data at Walmart ecosystem

All the big data efforts of Walmart are a good example of the massive possibilities of what can be done if big data is truly incorporated in the DNA of the company. Already, Walmart is able to optimize the local assortment of Walmart stores based on what the customers in the neighbourhood are saying on social media. When Walmart combines all big data efforts with their mobile efforts truly exciting solutions can be created. They are also developing in-store mobile navigation using personal smartphones and with that they can steer their customers through aisles of products they have been talking about on social media and therefore are more willing to buy. Of course, resulting in more revenue for the already largest retailer in the world.

Copyright Big Data Startups 2013. You may share using our article tools. Please don’t cut articles from BigData-Startups.com and redistribute by email or post to the web. Image courtesy of Walmart Labs.

TAGGED: social media, walmart
Datafloq March 17, 2013
Share this Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

ai software development
Key Strategies to Develop AI Software Cost-Effectively
Artificial Intelligence
ai in omnichannel marketing
AI is Driving Huge Changes in Omnichannel Marketing
Artificial Intelligence
ai for small business tax planning
Maximize Tax Deductions as a Business Owner with AI
Artificial Intelligence
ai in marketing with 3D rendering
Marketers Use AI to Take Advantage of 3D Rendering
Artificial Intelligence

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

use ai to get the most out of your social media strategy
Social Media Analytics

Use AI to Get the Most Out of Your Social Media Marketing Strategy

6 Min Read
leveraging social data for ROI
Social Media Analytics

Leveraging Social Analytics for Optimizing Your Marketing Strategy

9 Min Read
social data analytics
Social Media Analytics

4 Amazing Time Saving Analytics Tools For Social Media Marketing

9 Min Read
revolutionising our social visibility
Artificial Intelligence

How Data Science Is Revolutionising Our Social Visibility

12 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

data-driven web design
5 Great Tips for Using Data Analytics for Website UX
Big Data
ai in ecommerce
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US

© 2008-23 SmartData Collective. All Rights Reserved.

Removed from reading list

Undo
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?