several Azure DevOps project GITs vs single Azure Databricks repository Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern) Data science time! April 2019 and salary with experience The Ask Question Wizard is Live!Azure Integrate Source Control Multiple ProjectsAzure DevOps - What clone command to combine projects?How to permit customer to only read specific branch in VSTS/Azure DevOpsAzure DevOps projects vs Visual Studio projects (that are in a single solution)Preserve pull requests when moving repository between Azure DevOps projectsAzure DevOps — import a repo from one private org to my private org if I have permissions to bothGit Repositories missing from Team Explorer Everywhere when connecting to Azure DevOps 2019Azure DevOps CI/CD and Separating Connection Strings from Source ControlTF31002 error when cloning all history from Azure DevOps TFVC collection to Git with GIT-TFS toolAzure DevOps: 1 Solution Multiple Projects CI/CD
Putting Ant-Man on house arrest
How to break 信じようとしていただけかも知れない into separate parts?
Converting a text document with special format to Pandas DataFrame
/bin/ls sorts differently than just ls
How to charge percentage of transaction cost?
What were wait-states, and why was it only an issue for PCs?
Kepler's 3rd law: ratios don't fit data
"Destructive force" carried by a B-52?
How is an IPA symbol that lacks a name (e.g. ɲ) called?
Why does my GNOME settings mention "Moto C Plus"?
How to ask rejected full-time candidates to apply to teach individual courses?
Can the van der Waals coefficients be negative in the van der Waals equation for real gases?
Has a Nobel Peace laureate ever been accused of war crimes?
How can I introduce the names of fantasy creatures to the reader?
Can I take recommendation from someone I met at a conference?
Weaponising the Grasp-at-a-Distance spell
Does using the Inspiration rules for character defects encourage My Guy Syndrome?
Why not use the yoke to control yaw, as well as pitch and roll?
What is the definining line between a helicopter and a drone a person can ride in?
Are Flameskulls resistant to magical piercing damage?
What could prevent concentrated local exploration?
Why is ArcGIS Pro not symbolizing my entire range of values?
Meaning of "Not holding on that level of emuna/bitachon"
Unix AIX passing variable and arguments to expect and spawn
several Azure DevOps project GITs vs single Azure Databricks repository
Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern)
Data science time! April 2019 and salary with experience
The Ask Question Wizard is Live!Azure Integrate Source Control Multiple ProjectsAzure DevOps - What clone command to combine projects?How to permit customer to only read specific branch in VSTS/Azure DevOpsAzure DevOps projects vs Visual Studio projects (that are in a single solution)Preserve pull requests when moving repository between Azure DevOps projectsAzure DevOps — import a repo from one private org to my private org if I have permissions to bothGit Repositories missing from Team Explorer Everywhere when connecting to Azure DevOps 2019Azure DevOps CI/CD and Separating Connection Strings from Source ControlTF31002 error when cloning all history from Azure DevOps TFVC collection to Git with GIT-TFS toolAzure DevOps: 1 Solution Multiple Projects CI/CD
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
We have several projects running on Azure.
As they need some separation from each other, we need to establish an Azure Data Factory per each project (as ADF doesn’t have a ACL within itself).
Each project will have its own GIT repository via DevOps (each project has it’s own DevOps project, so separate GITs) , we end up with each project’s ADF being connected to their own GIT.
So we have:
Project1.ADF <-> Project1.DevOpsProject1.GIT
Project2.ADF <-> Project2.DevOpsProject2.GIT
We want to be able to connect to Azure Databricks from each ADF. We want to avoid multiplying Azure Databricks due to cost (plus databricks has ACL within that we can use). However, then the databricks workspace can only be connected to a single GIT repository. So if each project is to work on the same databricks then we need a databricks repository shared between the different projects.
Apart from the repository being in Project1.DevOps1.GIT and just that repository shared to Project2 (or vice versa), is there any better way?
azure 
azure-devops azure-data-factory azure-databricks asked Mar 22 at 13:58
JanKoJanKo
204
add a comment |
We have several projects running on Azure.
As they need some separation from each other, we need to establish an Azure Data Factory per each project (as ADF doesn’t have a ACL within itself).
Each project will have its own GIT repository via DevOps (each project has it’s own DevOps project, so separate GITs) , we end up with each project’s ADF being connected to their own GIT.
So we have:
Project1.ADF <-> Project1.DevOpsProject1.GIT
Project2.ADF <-> Project2.DevOpsProject2.GIT
We want to be able to connect to Azure Databricks from each ADF. We want to avoid multiplying Azure Databricks due to cost (plus databricks has ACL within that we can use). However, then the databricks workspace can only be connected to a single GIT repository. So if each project is to work on the same databricks then we need a databricks repository shared between the different projects.
Apart from the repository being in Project1.DevOps1.GIT and just that repository shared to Project2 (or vice versa), is there any better way?
azure azure-devops azure-data-factory azure-databricks asked Mar 22 at 13:58
JanKoJanKo
204
add a comment |
We have several projects running on Azure.
As they need some separation from each other, we need to establish an Azure Data Factory per each project (as ADF doesn’t have a ACL within itself).
Each project will have its own GIT repository via DevOps (each project has it’s own DevOps project, so separate GITs) , we end up with each project’s ADF being connected to their own GIT.
So we have:
Project1.ADF <-> Project1.DevOpsProject1.GIT
Project2.ADF <-> Project2.DevOpsProject2.GIT
We want to be able to connect to Azure Databricks from each ADF. We want to avoid multiplying Azure Databricks due to cost (plus databricks has ACL within that we can use). However, then the databricks workspace can only be connected to a single GIT repository. So if each project is to work on the same databricks then we need a databricks repository shared between the different projects.
Apart from the repository being in Project1.DevOps1.GIT and just that repository shared to Project2 (or vice versa), is there any better way?
azure azure-devops azure-data-factory azure-databricks asked Mar 22 at 13:58
JanKoJanKo
204
We have several projects running on Azure.
As they need some separation from each other, we need to establish an Azure Data Factory per each project (as ADF doesn’t have a ACL within itself).
Each project will have its own GIT repository via DevOps (each project has it’s own DevOps project, so separate GITs) , we end up with each project’s ADF being connected to their own GIT.
So we have:
Project1.ADF <-> Project1.DevOpsProject1.GIT
Project2.ADF <-> Project2.DevOpsProject2.GIT
We want to be able to connect to Azure Databricks from each ADF. We want to avoid multiplying Azure Databricks due to cost (plus databricks has ACL within that we can use). However, then the databricks workspace can only be connected to a single GIT repository. So if each project is to work on the same databricks then we need a databricks repository shared between the different projects.
Apart from the repository being in Project1.DevOps1.GIT and just that repository shared to Project2 (or vice versa), is there any better way?
azure azure-devops azure-data-factory azure-databricks azure azure-devops azure-data-factory azure-databricks asked Mar 22 at 13:58
JanKoJanKo
204
asked Mar 22 at 13:58
JanKoJanKo
204
asked Mar 22 at 13:58
JanKoJanKo
204
asked Mar 22 at 13:58
JanKoJanKo
204
asked Mar 22 at 13:58
JanKoJanKo
204
204
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
This was actually much simpler than I thought - you can specify on each notebook the GIT repository you want to connect to.
So we can still have
Project1.ADF <-> Project1.DevOpsProject1.GIT
Project1.Databricks <-> Project1.DevOpsProject1.GIT
Project2.ADF <-> Project2.DevOpsProject2.GIT
Project2.Databricks <-> Project2.DevOpsProject2.GIT
answered Mar 25 at 13:49
JanKoJanKo
204
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55301229%2fseveral-azure-devops-project-gits-vs-single-azure-databricks-repository%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
This was actually much simpler than I thought - you can specify on each notebook the GIT repository you want to connect to.
So we can still have
Project1.ADF <-> Project1.DevOpsProject1.GIT
Project1.Databricks <-> Project1.DevOpsProject1.GIT
Project2.ADF <-> Project2.DevOpsProject2.GIT
Project2.Databricks <-> Project2.DevOpsProject2.GIT
answered Mar 25 at 13:49
JanKoJanKo
204
add a comment |
This was actually much simpler than I thought - you can specify on each notebook the GIT repository you want to connect to.
So we can still have
Project1.ADF <-> Project1.DevOpsProject1.GIT
Project1.Databricks <-> Project1.DevOpsProject1.GIT
Project2.ADF <-> Project2.DevOpsProject2.GIT
Project2.Databricks <-> Project2.DevOpsProject2.GIT
answered Mar 25 at 13:49
JanKoJanKo
204
add a comment |
This was actually much simpler than I thought - you can specify on each notebook the GIT repository you want to connect to.
So we can still have
Project1.ADF <-> Project1.DevOpsProject1.GIT
Project1.Databricks <-> Project1.DevOpsProject1.GIT
Project2.ADF <-> Project2.DevOpsProject2.GIT
Project2.Databricks <-> Project2.DevOpsProject2.GIT
answered Mar 25 at 13:49
JanKoJanKo
204
This was actually much simpler than I thought - you can specify on each notebook the GIT repository you want to connect to.
So we can still have
Project1.ADF <-> Project1.DevOpsProject1.GIT
Project1.Databricks <-> Project1.DevOpsProject1.GIT
Project2.ADF <-> Project2.DevOpsProject2.GIT
Project2.Databricks <-> Project2.DevOpsProject2.GIT
answered Mar 25 at 13:49
JanKoJanKo
204
answered Mar 25 at 13:49
JanKoJanKo
204
answered Mar 25 at 13:49
JanKoJanKo
204
answered Mar 25 at 13:49
JanKoJanKo
204
204
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55301229%2fseveral-azure-devops-project-gits-vs-single-azure-databricks-repository%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
