We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
    Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
    23 Min Read
    Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
    From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
    12 Min Read
    Flat editorial illustration: The article contrasts passive follower totals with a behavioral path from attention and trust to cli
    Creator Analytics Beyond Follower Count: Seven Metrics That Measure Audience Behavior
    11 Min Read
    Flat editorial illustration: The article connects AI and marketing analytics with managerial judgment grounded in consumer behavi
    How an Online MBA in Marketing Connects AI and Data Analytics
    11 Min Read
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: No Extract, Transform and Load? Really?
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Warehousing > No Extract, Transform and Load? Really?
Data ManagementData Warehousing

No Extract, Transform and Load? Really?

Raju Bodapati
Raju Bodapati
4 Min Read
No Extract, Transform and Load? Really?
Illustration generated with Qwen Image.
SHARE

There are some new data aqusition tools that help reduce Extract, Transform and Load (ETL) and related support costs drastically.

There are some new data aqusition tools that help reduce Extract, Transform and Load (ETL) and related support costs drastically. Kalido claims in their sales pitch, “Free Yourself From ETL,” that their information engine eliminates the need for ETL. I agree to some extent for specific business situations, but marketing these tools as if they would eliminate need for ETL is quite a stretch. I am a big advicate of auto generated code replacing custom coding in data integration. I am also a big advocate of building reusable objects and transformations with the ETL realm. These best practices help save costs and manage resources better. I do not beilve every single ETL challenge is solvable by tools.

I can understand why an average project sponsor gets enticed by claims like no ETL and small prototypes, I would like to highlight the following facts about the nature of data acqusition work in an enterprise setting:

  • The ETL developer needs solid skills in design, architecture, performance tuning, general programming abilities and writing complex SQLs. Even if the code is generated by the tools, the developer should be capable of understanding how to make the tool do the right things the right way. Given the role requirements, good ETL developers do not come cheep.
  • Quick and dirty work, to be replaced later hurts data programs the most. It’s quite costly to not do it right on the first pass.
  • Typically, the ETL engines need to accomodate the changes in any of the source systems or the target systems.
  • Enterprise governance standards related to reference and master data use, data integrity, data quality, information security are all enforced by the ETL engines.

Therefore, by eliminating ETL with a drag and drop tools without knowing the adverse impacts to enterprise data enablement can land the average project sponsors in to serious trouble.

More Read

How to Protect the Sensitive Data of Your Company with a Secure Web Gateway?
How to Protect the Sensitive Data of Your Company with a Secure Web Gateway?
How Microsoft is Protecting the Privacy of its Customers from the NSA
Little Data: The 25 KPIs Everyone Must Understand
6 Details That Make a Data Centre’s Server Room Easier to Scale
6 Reasons to Boost Data Security Plan in the Age of Big Data

In order to take the best advantage of the data acqusition tools that claim to eliminate or reduce ETL, make sure that the business situation where this can be experimented on. The following are some such business scenarios,

  • Temporary data acqusition work for semi-adhoc or adhoc needs of a few selected user champions. This may be throw-a-away work.
  • Explorative endeavors on a data source that is not yet clearly understood. Let us say the organization just acquired a new company and needs to bring in and integrate new company’s data with the old company’s data. In order to accomplish this task fast, one strategy may be to provide power users of both organizations an access to the relevant data of the other company. In scenarios such as this, tools can provide a first-cut access to the new enterprise data in a bit of a raw form.
  • There is only one source system to the data mart or enterprise dataware house or there is really no need to match up master data between different sources system. This is a low risk business scenatio to eliminate complex ETL processes.

In summary, while “No ETL” is a bit of stretch, there is some merit in considering tools like Kalido for some specific business scenarios to reap the benefits of low ETL costs as well as better speed of delivery.

image: data movement/shutterstock

Share This Article
Facebook Pinterest LinkedIn
Share
ByRaju Bodapati
Follow:
Data and AI Engineer with over two decades of experience in on premise, and cloud technologies

Follow us on Facebook

Latest News

Flat editorial illustration: The article connects downstream report failures, data-quality gaps, and conflicting metric definitio
Signs Your Data Architecture Needs an Outside Review
Big Data Exclusive
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Big Data Exclusive
Flat editorial illustration: The article contrasts tools for gathering fresh interviews with tools for analyzing existing qualita
10 AI Market Research Tools That Turn Qualitative Data into Insights
Artificial Intelligence Big Data Exclusive
Flat editorial illustration: The article compares proxy MCP servers by what an AI agent can do through them: manage proxy account
Proxy MCP Servers: 7 Options and What Each Lets an AI Agent Do
Artificial Intelligence Big Data Data Collection

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

Will Big Data Mark the End of the Market Research Industry?
Big DataBusiness IntelligenceCRMData ManagementData VisualizationInside CompaniesJobsMarket ResearchMarketingSocial Data

Will Big Data Mark the End of the Market Research Industry?

6 Min Read
Taking a Dimension-Free View of Data
AnalyticsBest PracticesBusiness IntelligenceData Visualization

Taking a Dimension-Free View of Data

4 Min Read
10 Helpful Ways To Ensure Data Centric Cybersecurity
Best PracticesData ManagementExclusiveITPrivacySecurity

10 Helpful Ways To Ensure Data Centric Cybersecurity

9 Min Read
A Taleo Tale: Oracle Reaches for Cloud Credibility
Cloud ComputingCommentaryData Warehousing

A Taleo Tale: Oracle Reaches for Cloud Credibility

9 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai chatbot
How AI Website Chatbots Improve Customer Support and Lead Generation
Chatbots Exclusive
The Art of Conversation: Enhancing Chatbots with Advanced AI Prompts
The Art of Conversation: Enhancing Chatbots with Advanced AI Prompts
Chatbots

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?