How to use PipelineDB to automate the updating of a Slowly Changing Dimension Table?Changing a table into a continuous view - issue with dependent continuous viewsHow do I list all streams and continuous views in pipelinedb?Pipelinedb: How to group stream data by each N minutes in continuous viewHow to stream output from a continous view in pipelinedb?How to Update kafka extension in PipelinedbCan table be used as a stream in PipelineDBHow to Upgrade version pipelinedbHow to add a column to continuous transform in pipelinedb
How were concentration and extermination camp guards recruited?
Why does the Schrödinger equation work so well for the Hydrogen atom despite the relativistic boundary at the nucleus?
Who operates delivery flights for commercial airlines?
What makes linear regression with polynomial features curvy?
Do any instruments not produce overtones?
Function to extract float from different price patterns
Reading two lines in piano
What's the correct term for a waitress in the Middle Ages?
On the Twin Paradox Again
What happens to foam insulation board after you pour concrete slab?
What is the advantage of carrying a tripod and ND-filters when you could use image stacking instead?
Does the "6 seconds per round" rule apply to speaking/roleplaying during combat situations?
My coworkers think I had a long honeymoon. Actually I was diagnosed with cancer. How do I talk about it?
How is it possible that Gollum speaks Westron?
Are the AT-AT's from "Empire Strikes Back" a deliberate reference to Mecha?
Completing the square to find if quadratic form is positive definite.
What are the words for people who cause trouble believing they know better?
Why did Hela need Heimdal's sword?
Is there any word or phrase for negative bearing?
OOP demonstration in C++17 using a Pokémon
Why don't B747s start takeoffs with full throttle?
Sharing one invocation list between multiple events on the same object in C#
Can a 2nd-level sorcerer use sorcery points to create a 2nd-level spell slot?
What is the purpose of building foundations?
How to use PipelineDB to automate the updating of a Slowly Changing Dimension Table?
Changing a table into a continuous view - issue with dependent continuous viewsHow do I list all streams and continuous views in pipelinedb?Pipelinedb: How to group stream data by each N minutes in continuous viewHow to stream output from a continous view in pipelinedb?How to Update kafka extension in PipelinedbCan table be used as a stream in PipelineDBHow to Upgrade version pipelinedbHow to add a column to continuous transform in pipelinedb
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
Can PipelineDB be used to automate the updating of a Slowly Changing Dimension table (type 2)?
Specific example:
Say I've got a table called ProductOfferHistory, which tracks product offers for a particular product/store/daterange combination. (i.e.: price, isAvail, storeId, productId, fromDt, toDt). If a new OfferEvent comes in (productId, StoreId, price, isAvail, dt) one of 2 things should happen:
1) price/isAvail is the same as the last recorded ProductOfferHistory-record for productId/storeId. In that case: skip
2) price/isAvail is different from the last recorded ProductOfferHistory-record for productId/storeId. In that case:
- set the toDT of said last record to event.dt
- create a new record: price/isAvail/storeId/productId/fromDt = event.dt
Would it be possible using PipelineDB to have OfferEvents come in as a stream, and update the ProductOfferHistory with above described logic?
pipelinedb
add a comment |
Can PipelineDB be used to automate the updating of a Slowly Changing Dimension table (type 2)?
Specific example:
Say I've got a table called ProductOfferHistory, which tracks product offers for a particular product/store/daterange combination. (i.e.: price, isAvail, storeId, productId, fromDt, toDt). If a new OfferEvent comes in (productId, StoreId, price, isAvail, dt) one of 2 things should happen:
1) price/isAvail is the same as the last recorded ProductOfferHistory-record for productId/storeId. In that case: skip
2) price/isAvail is different from the last recorded ProductOfferHistory-record for productId/storeId. In that case:
- set the toDT of said last record to event.dt
- create a new record: price/isAvail/storeId/productId/fromDt = event.dt
Would it be possible using PipelineDB to have OfferEvents come in as a stream, and update the ProductOfferHistory with above described logic?
pipelinedb
add a comment |
Can PipelineDB be used to automate the updating of a Slowly Changing Dimension table (type 2)?
Specific example:
Say I've got a table called ProductOfferHistory, which tracks product offers for a particular product/store/daterange combination. (i.e.: price, isAvail, storeId, productId, fromDt, toDt). If a new OfferEvent comes in (productId, StoreId, price, isAvail, dt) one of 2 things should happen:
1) price/isAvail is the same as the last recorded ProductOfferHistory-record for productId/storeId. In that case: skip
2) price/isAvail is different from the last recorded ProductOfferHistory-record for productId/storeId. In that case:
- set the toDT of said last record to event.dt
- create a new record: price/isAvail/storeId/productId/fromDt = event.dt
Would it be possible using PipelineDB to have OfferEvents come in as a stream, and update the ProductOfferHistory with above described logic?
pipelinedb
Can PipelineDB be used to automate the updating of a Slowly Changing Dimension table (type 2)?
Specific example:
Say I've got a table called ProductOfferHistory, which tracks product offers for a particular product/store/daterange combination. (i.e.: price, isAvail, storeId, productId, fromDt, toDt). If a new OfferEvent comes in (productId, StoreId, price, isAvail, dt) one of 2 things should happen:
1) price/isAvail is the same as the last recorded ProductOfferHistory-record for productId/storeId. In that case: skip
2) price/isAvail is different from the last recorded ProductOfferHistory-record for productId/storeId. In that case:
- set the toDT of said last record to event.dt
- create a new record: price/isAvail/storeId/productId/fromDt = event.dt
Would it be possible using PipelineDB to have OfferEvents come in as a stream, and update the ProductOfferHistory with above described logic?
pipelinedb
pipelinedb
edited Mar 24 at 15:06
Geert-Jan
asked Mar 24 at 14:16
Geert-JanGeert-Jan
10.3k858110
10.3k858110
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55324716%2fhow-to-use-pipelinedb-to-automate-the-updating-of-a-slowly-changing-dimension-ta%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55324716%2fhow-to-use-pipelinedb-to-automate-the-updating-of-a-slowly-changing-dimension-ta%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown