We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
    Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
    23 Min Read
    Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
    From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
    12 Min Read
    Flat editorial illustration: The article contrasts passive follower totals with a behavioral path from attention and trust to cli
    Creator Analytics Beyond Follower Count: Seven Metrics That Measure Audience Behavior
    11 Min Read
    Flat editorial illustration: The article connects AI and marketing analytics with managerial judgment grounded in consumer behavi
    How an Online MBA in Marketing Connects AI and Data Analytics
    11 Min Read
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Big Data moves up the stack
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Uncategorized > Big Data moves up the stack
Uncategorized

Big Data moves up the stack

TonyBain
TonyBain
3 Min Read
Big Data moves up the stack
Photo by Artem Podrez on Pexels (https://www.pexels.com/photo/man-in-white-polo-shirt-using-a-tablet-computer-5025643/)
SHARE
Data Management is an area that I work in and follow with a passion.  “Big Data” is really the bleeding edge of this, focusing on the cloud and the requirements for the high end of scale, performance and data volume. 

The Big Data field itself is rapidly evolving, maturing and broadening in focus.  It is still going through the process of finding itself, working out what it is supposed to be.  While 12 months ago Big Data was, to me at least, a categorization for the platforms that provided data scalability I think that is less so today.  Big Data is becoming more about the layers built on top of those platforms and the value added to the data in those layers.  This is not an unexpected move, it follows path in the direction of the data-as-a-service vision that I and others have shared for some time.

I see this shift being reflected in the companies that are finding success.  While true killer innovation will almost always find funding, killer innovation today often has to be more than just n+1 scalability.  Some companies I know that have built “faster transaction processing” or “more scalable analytics” have found getting a foothold difficult in a crowded market.  The “more scalable” mantra on its own is starting to not be enough to gain and keep attention.  So many platforms in both transaction processing and analytics (both SQL & NoSQL) are delivering high scalability today.  Many of these are open source, and on the closed source side of the fence it appears consolidation needs to happen for sustainability.  Some has happened already and I expect more will follow. 

Image by Délirante bestiole [Lumpen river] via Flickr

I think moving up the stack provides some clear air.  A unique point of difference based around the value added to the underlying data seems to me to offer a more clearly defined proposition.  A unique Big Data platform may be built in the process, but how that platform is applied to enrich information can be more interesting than the platform itself.

Don’t get me wrong.  Killer innovation in Big Data layers form the hardware to the user are important (flash, hadoop, MPP etc) and should continue to exist in their own right.  But a difficulty is launching a Big Data platform in a busy space means the platform may only get a small following.  And platforms with small followings, I think, are difficult to sustain.

TAGGED:data management
Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Flat editorial illustration: The article connects downstream report failures, data-quality gaps, and conflicting metric definitio
Signs Your Data Architecture Needs an Outside Review
Big Data Exclusive
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Big Data Exclusive
Flat editorial illustration: The article contrasts tools for gathering fresh interviews with tools for analyzing existing qualita
10 AI Market Research Tools That Turn Qualitative Data into Insights
Artificial Intelligence Big Data Exclusive
Flat editorial illustration: The article compares proxy MCP servers by what an AI agent can do through them: manage proxy account
Proxy MCP Servers: 7 Options and What Each Lets an AI Agent Do
Artificial Intelligence Big Data Data Collection

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

Big Data Strategies Hinge on Using Drop Tables in SQL Servers
SQL

Big Data Strategies Hinge on Using Drop Tables in SQL Servers

15 Min Read
How Data Enrichment Is A Force Multiplier In Analytics
AnalyticsBest PracticesBig DataData ManagementExclusive

How Data Enrichment Is A Force Multiplier In Analytics

5 Min Read
#3: Here's a thought...
Uncategorized

#3: Here’s a thought…

7 Min Read
Strategies for Ensuring Security in Hyperconverged Infrastructure
Security

Strategies for Ensuring Security in Hyperconverged Infrastructure

8 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai chatbot
How AI Website Chatbots Improve Customer Support and Lead Generation
Chatbots Exclusive
How To Get An Award Winning Giveaway Bot
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?