When Should I Use Multiple Azure Data Factory’s?

Hi all, I get asked this question a lot. So I decided to do a full post on the subject based on my current thoughts and experience. When should I use multiple Azure Data Factory's? The consultants answer, it depends πŸ˜‰ Ok, let's go deeper and explore why it depends! Also, to be clear, we … Continue reading When Should I Use Multiple Azure Data Factory’s?

ADF.procfwk v1.6 – Error Details for Failed Activities Captured

Code Project Overview This open source code project delivers a simple metadata driven processing framework for Azure Data Factory (ADF). The framework is made possible by coupling ADF with an Azure SQL Database that houses execution stage and pipeline information that is later called using an Azure Functions App. The parent/child metadata structure firstly allows … Continue reading ADF.procfwk v1.6 – Error Details for Failed Activities Captured

A Complete Introduction to Azure Data Factory

Following a recent talk I did for the Europe - Data Platform Discovery Day, here is the YouTube recording for those that didn't get to see it live. https://www.youtube.com/watch?v=CtDTJPbXVpQ Slides available in GitHub here: https://github.com/mrpaulandrew/CommunityEvents/blob/master/DataPlatformDiscoveryDay-2020/Slides.pdf Thanks again to the event organisers. Please reach out if you'd like me to speak at your community event. A … Continue reading A Complete Introduction to Azure Data Factory

ADF.procfwk v1.5 – Power BI Dashboard for Framework Executions

Code Project Overview This open source code project delivers a simple metadata driven processing framework for Azure Data Factory (ADF). The framework is delivered by coupling ADF with an Azure SQL Database that houses execution stage and pipeline information that is later called using an Azure Functions App. The parent/child metadata structure firstly allows stages … Continue reading ADF.procfwk v1.5 – Power BI Dashboard for Framework Executions