By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData Collective
  • Analytics
    AnalyticsShow More
    data analytics in sports industry
    Here’s How Data Analytics In Sports Is Changing The Game
    6 Min Read
    data analytics on nursing career
    Advances in Data Analytics Are Rapidly Transforming Nursing
    8 Min Read
    data analytics reveals the benefits of MBA
    Data Analytics Technology Proves Benefits of an MBA
    9 Min Read
    data-driven image seo
    Data Analytics Helps Marketers Substantially Boost Image SEO
    8 Min Read
    construction analytics
    5 Benefits of Analytics to Manage Commercial Construction
    5 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Addressing Slowly Changing Dimensions with Teradata v13
Share
Notification Show More
Latest News
data analytics in sports industry
Here’s How Data Analytics In Sports Is Changing The Game
Big Data
data analytics on nursing career
Advances in Data Analytics Are Rapidly Transforming Nursing
Analytics
data analytics reveals the benefits of MBA
Data Analytics Technology Proves Benefits of an MBA
Analytics
anti-spoofing tips
Anti-Spoofing is Crucial for Data-Driven Businesses
Security
ai in software development
3 AI-Based Strategies to Develop Software in Uncertain Times
Software
Aa
SmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Warehousing > Addressing Slowly Changing Dimensions with Teradata v13
Business IntelligenceData Warehousing

Addressing Slowly Changing Dimensions with Teradata v13

Raju Bodapati
Last updated: 2011/12/07 at 5:25 PM
Raju Bodapati
4 Min Read
SHARE

Earlier in my blog, Slowly Changing Dimensions – Special Attention Needed, I touched upon the need to pay special attention to slowly changing dimensions. Organizations have three variants of implementing solutions for slowly changing dimensions.

Earlier in my blog, Slowly Changing Dimensions – Special Attention Needed, I touched upon the need to pay special attention to slowly changing dimensions. Organizations have three variants of implementing solutions for slowly changing dimensions.

Type 1: in these implementations, the latest data is retained. This is implemented when there would be no need to do historic analysis. For example, an online transactional system that needs to display the latest list of values in the pull-down pick lists may use this type.

More Read

business intelligence tools

10 Best Practices For Business Intelligence Dashboards

9 Reasons To Consider Managed Cloud Hosting For Startups
First Look: Teradata Integrated Marketing Management
Business Intelligence Maturity Assessment: Data Visualization and Data Strategy Services
HIPAA in a HITECH World: HIPAA Violations on the Rise

Type 2: in these implementations the history or the validity period for the changes is persisted. Whenever the values are changed for the old values and the period they were valid for are stored along without deleting those records. The latest record may be marked as the only active instance or the validity end date is marked up into the future. This is the best way to address the slowly changing dimensions, but it comes with the overhead of needs to tag timelines for datasets.

Type 3: in these implementations, at the most two versions of data are stored. Data sets are marked current/previous or active/inactive.

One of the main new features added by Teradata version 13.10 to support temporal data addresses slowly changing dimensions. Teradata v13 introduced new PERIOD data type that implements the solutions to the slowly changing dimensions. Rob detailed the technical aspects of this in his post, Exploring Teradata 13’s PERIOD Data Type.  Ramakrishna explained ETL best practices to load the slowly changing dimensions in his post, Recognizing Change. Teradata calls ability to enable storing validity periods against data, as “making it temporal.”

However, migrating from Teradata v12 to v13 would not automatically make your Enterprise Data Warehouse (EDW) temporal. The data need to be inserted or migrated as temporal data.  The real challenge is dealing with and migrating non-temporal data and source systems when upgrading to the temporal EDW built of Teradata v13.

Tips and Suggestions

Here are few tips and suggestions for the journey from non-temporal to temporal EDW.

a) Identify and categorize the slowly changing dimensions by the three types of implementations described above.

b) Ask your business about validity period – it is important to make business subject matter experts temporal thinkers. While this may be an irritating question, it is always appropriate to ask validity period for each reference and master data users enter into the systems.

c) Address the data collection systems – the temporal aware organizations will start with upgrading the data collection source systems that are agnostic for validity periods.

d) Temporal alone cannot address all the design issues – even with temporal EDW, there are situations that change the structure or the nature of the dimensions over time. For example, a product promotion last years was based on selling a set of new brands last year, but this year it may be based on how much of those are getting returned. The promotion’s key and the attributes themselves change overtime. If a historic analysis is needed to compare sales performance overtime for the promotion, one needs to tag the underlying changes to the promotion definitions overtime. One good way to address this could be to implement a surrogate key with natural key for the table changing over the course of time.

TAGGED: best practices, teradata
Raju Bodapati December 7, 2011
Share this Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

data analytics in sports industry
Here’s How Data Analytics In Sports Is Changing The Game
Big Data
data analytics on nursing career
Advances in Data Analytics Are Rapidly Transforming Nursing
Analytics
data analytics reveals the benefits of MBA
Data Analytics Technology Proves Benefits of an MBA
Analytics
anti-spoofing tips
Anti-Spoofing is Crucial for Data-Driven Businesses
Security

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

business intelligence tools
Best PracticesBusiness IntelligenceExclusive

10 Best Practices For Business Intelligence Dashboards

9 Min Read
managed cloud hosting
Cloud ComputingExclusive

9 Reasons To Consider Managed Cloud Hosting For Startups

11 Min Read
teradata IMM solutions
Business IntelligenceData ManagementDecision ManagementInside CompaniesMarketing

First Look: Teradata Integrated Marketing Management

9 Min Read
business intelligence Technology
AnalyticsBusiness IntelligenceData ManagementData VisualizationData WarehousingModelingSQL

Business Intelligence Maturity Assessment: Data Visualization and Data Strategy Services

8 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots
ai in ecommerce
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US

© 2008-23 SmartData Collective. All Rights Reserved.

Removed from reading list

Undo
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?