Using the PowerShell Module ‘azure.datafactory.tools’ to Deploy ADF.procfwk

From my YouTube channel: https://www.youtube.com/c/mrpaulandrew Special guest Kamil Nowinski talks about how you can use his PowerShell Module 'azure.datafactory.tools' to deploy Azure Data Factory with ease and in a highly flexible way. Kamil kindly helped me simplify the deployment steps needed for publishing my ADF.procfwk Data Factory pipelines via PowerShell and using his Azure DevOps … Continue reading Using the PowerShell Module ‘azure.datafactory.tools’ to Deploy ADF.procfwk

PowerShell Export Databricks Workspace Items – Recurse

Building on the excellent PowerShell Databricks module created by Gerhard Brueckl here, I've added another layer of code to recursively export all items in a given Databricks workspace using PowerShell. I accept this does need to be hardened as a PowerShell cmdlet on its own and added to a module. However, I wanted to share the … Continue reading PowerShell Export Databricks Workspace Items – Recurse

Azure Data Lake Store – Files Dashboard

A tool I've used in the past to query my local disk drives is WinDirStat. It's great for finding out where large files are hiding in your directories using a heat map visual. In this post I talk you through how I've created a similar tool for Azure Data Lake Store using PowerShell, SQL Server … Continue reading Azure Data Lake Store – Files Dashboard

Inject into Azure Logic Apps ARM Templates with PowerShell

Continuous delivery of data services has always been a battle for us data analytics peeps. Things are getting better when we think about business intelligence and dev ops, however there are still gaps. This blog post is an account of one such issue I recently faced and how I worked around the problem. Problem While … Continue reading Inject into Azure Logic Apps ARM Templates with PowerShell