Hi all, I get asked this question a lot. So I decided to do a full post on the subject based on my current thoughts and experience. When should I use multiple Azure Data Factory's? The consultants answer, it depends 😉 Ok, let's go deeper and explore why it depends! Also, to be clear, we … Continue reading When Should I Use Multiple Azure Data Factory’s?
While documenting a customers data platform solution I decided it would be far easier if we could summarise the contents of a fairly complex Data Factory using its ARM Template. So, this is what I've done using T-SQL to parse the ARM Template JSON and output of series of tables containing details about the factory … Continue reading Summarise An Azure Data Factory ARM Template Using T-SQL
Renewing my post from last year (here) I've gathered my thoughts and put together the following content that I'd like to deliver to our wonderful data platform community in 2020. 2019 has been a great year for me having delivered 30 talks, in 17 cities and 8 different countries. This brings my grand total to … Continue reading My Community Talks 2020
For my first appearance on the Altius Data Lounge show I talk about and demonstrate the 'out-of-the-box' capabilities within Azure Data Factory for Git integration and how to publish developed pipelines. In my demo you'll see what each of the developer UI toolbar functions means in the context of the code repository and what happens … Continue reading Deploying Azure Data Factory in a Single Service Environment (Option 1)
Continuous delivery of data services has always been a battle for us data analytics peeps. Things are getting better when we think about business intelligence and dev ops, however there are still gaps. This blog post is an account of one such issue I recently faced and how I worked around the problem. Problem While … Continue reading Inject into Azure Logic Apps ARM Templates with PowerShell