How to use PipelineDB to automate the updating of a Slowly Changing Dimension Table?Changing a table into a continuous view - issue with dependent continuous viewsHow do I list all streams and continuous views in pipelinedb?Pipelinedb: How to group stream data by each N minutes in continuous viewHow to stream output from a continous view in pipelinedb?How to Update kafka extension in PipelinedbCan table be used as a stream in PipelineDBHow to Upgrade version pipelinedbHow to add a column to continuous transform in pipelinedb

How were concentration and extermination camp guards recruited?

Why does the Schrödinger equation work so well for the Hydrogen atom despite the relativistic boundary at the nucleus?

Who operates delivery flights for commercial airlines?

What makes linear regression with polynomial features curvy?

Do any instruments not produce overtones?

Function to extract float from different price patterns

Reading two lines in piano

What's the correct term for a waitress in the Middle Ages?

On the Twin Paradox Again

What happens to foam insulation board after you pour concrete slab?

What is the advantage of carrying a tripod and ND-filters when you could use image stacking instead?

Does the "6 seconds per round" rule apply to speaking/roleplaying during combat situations?

My coworkers think I had a long honeymoon. Actually I was diagnosed with cancer. How do I talk about it?

How is it possible that Gollum speaks Westron?

Are the AT-AT's from "Empire Strikes Back" a deliberate reference to Mecha?

Completing the square to find if quadratic form is positive definite.

What are the words for people who cause trouble believing they know better?

Why did Hela need Heimdal's sword?

Is there any word or phrase for negative bearing?

OOP demonstration in C++17 using a Pokémon

Why don't B747s start takeoffs with full throttle?

Sharing one invocation list between multiple events on the same object in C#

Can a 2nd-level sorcerer use sorcery points to create a 2nd-level spell slot?

What is the purpose of building foundations?



How to use PipelineDB to automate the updating of a Slowly Changing Dimension Table?


Changing a table into a continuous view - issue with dependent continuous viewsHow do I list all streams and continuous views in pipelinedb?Pipelinedb: How to group stream data by each N minutes in continuous viewHow to stream output from a continous view in pipelinedb?How to Update kafka extension in PipelinedbCan table be used as a stream in PipelineDBHow to Upgrade version pipelinedbHow to add a column to continuous transform in pipelinedb






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;








0















Can PipelineDB be used to automate the updating of a Slowly Changing Dimension table (type 2)?



Specific example:



Say I've got a table called ProductOfferHistory, which tracks product offers for a particular product/store/daterange combination. (i.e.: price, isAvail, storeId, productId, fromDt, toDt). If a new OfferEvent comes in (productId, StoreId, price, isAvail, dt) one of 2 things should happen:



1) price/isAvail is the same as the last recorded ProductOfferHistory-record for productId/storeId. In that case: skip



2) price/isAvail is different from the last recorded ProductOfferHistory-record for productId/storeId. In that case:



  • set the toDT of said last record to event.dt

  • create a new record: price/isAvail/storeId/productId/fromDt = event.dt

Would it be possible using PipelineDB to have OfferEvents come in as a stream, and update the ProductOfferHistory with above described logic?










share|improve this question






























    0















    Can PipelineDB be used to automate the updating of a Slowly Changing Dimension table (type 2)?



    Specific example:



    Say I've got a table called ProductOfferHistory, which tracks product offers for a particular product/store/daterange combination. (i.e.: price, isAvail, storeId, productId, fromDt, toDt). If a new OfferEvent comes in (productId, StoreId, price, isAvail, dt) one of 2 things should happen:



    1) price/isAvail is the same as the last recorded ProductOfferHistory-record for productId/storeId. In that case: skip



    2) price/isAvail is different from the last recorded ProductOfferHistory-record for productId/storeId. In that case:



    • set the toDT of said last record to event.dt

    • create a new record: price/isAvail/storeId/productId/fromDt = event.dt

    Would it be possible using PipelineDB to have OfferEvents come in as a stream, and update the ProductOfferHistory with above described logic?










    share|improve this question


























      0












      0








      0








      Can PipelineDB be used to automate the updating of a Slowly Changing Dimension table (type 2)?



      Specific example:



      Say I've got a table called ProductOfferHistory, which tracks product offers for a particular product/store/daterange combination. (i.e.: price, isAvail, storeId, productId, fromDt, toDt). If a new OfferEvent comes in (productId, StoreId, price, isAvail, dt) one of 2 things should happen:



      1) price/isAvail is the same as the last recorded ProductOfferHistory-record for productId/storeId. In that case: skip



      2) price/isAvail is different from the last recorded ProductOfferHistory-record for productId/storeId. In that case:



      • set the toDT of said last record to event.dt

      • create a new record: price/isAvail/storeId/productId/fromDt = event.dt

      Would it be possible using PipelineDB to have OfferEvents come in as a stream, and update the ProductOfferHistory with above described logic?










      share|improve this question
















      Can PipelineDB be used to automate the updating of a Slowly Changing Dimension table (type 2)?



      Specific example:



      Say I've got a table called ProductOfferHistory, which tracks product offers for a particular product/store/daterange combination. (i.e.: price, isAvail, storeId, productId, fromDt, toDt). If a new OfferEvent comes in (productId, StoreId, price, isAvail, dt) one of 2 things should happen:



      1) price/isAvail is the same as the last recorded ProductOfferHistory-record for productId/storeId. In that case: skip



      2) price/isAvail is different from the last recorded ProductOfferHistory-record for productId/storeId. In that case:



      • set the toDT of said last record to event.dt

      • create a new record: price/isAvail/storeId/productId/fromDt = event.dt

      Would it be possible using PipelineDB to have OfferEvents come in as a stream, and update the ProductOfferHistory with above described logic?







      pipelinedb






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Mar 24 at 15:06







      Geert-Jan

















      asked Mar 24 at 14:16









      Geert-JanGeert-Jan

      10.3k858110




      10.3k858110






















          0






          active

          oldest

          votes












          Your Answer






          StackExchange.ifUsing("editor", function ()
          StackExchange.using("externalEditor", function ()
          StackExchange.using("snippets", function ()
          StackExchange.snippets.init();
          );
          );
          , "code-snippets");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "1"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55324716%2fhow-to-use-pipelinedb-to-automate-the-updating-of-a-slowly-changing-dimension-ta%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55324716%2fhow-to-use-pipelinedb-to-automate-the-updating-of-a-slowly-changing-dimension-ta%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Kamusi Yaliyomo Aina za kamusi | Muundo wa kamusi | Faida za kamusi | Dhima ya picha katika kamusi | Marejeo | Tazama pia | Viungo vya nje | UrambazajiKuhusu kamusiGo-SwahiliWiki-KamusiKamusi ya Kiswahili na Kiingerezakuihariri na kuongeza habari

          Swift 4 - func physicsWorld not invoked on collision? The Next CEO of Stack OverflowHow to call Objective-C code from Swift#ifdef replacement in the Swift language@selector() in Swift?#pragma mark in Swift?Swift for loop: for index, element in array?dispatch_after - GCD in Swift?Swift Beta performance: sorting arraysSplit a String into an array in Swift?The use of Swift 3 @objc inference in Swift 4 mode is deprecated?How to optimize UITableViewCell, because my UITableView lags

          Access current req object everywhere in Node.js ExpressWhy are global variables considered bad practice? (node.js)Using req & res across functionsHow do I get the path to the current script with Node.js?What is Node.js' Connect, Express and “middleware”?Node.js w/ express error handling in callbackHow to access the GET parameters after “?” in Express?Modify Node.js req object parametersAccess “app” variable inside of ExpressJS/ConnectJS middleware?Node.js Express app - request objectAngular Http Module considered middleware?Session variables in ExpressJSAdd properties to the req object in expressjs with Typescript