In this four part blog series I want to share my approach to delivering a metadata driven processing framework in Azure Data Factory. This is very much version 1 of what is possible and where can we build on this to deliver a hardened solution for our platform orchestrator. For the agenda of this blog … Continue reading Creating a Simple Staged Metadata Driven Processing Framework for Azure Data Factory Pipelines – Part 1 of 4
Following on from a previous blog post that I wrote a few months ago where I got an Azure Data Factory Pipeline run status with an Azure Function (link below). I recently found the need to create something very similar to execute any pipeline from an Azure Function. https://mrpaulandrew.com/2019/11/21/get-any-azure-data-factory-pipeline-run-status-with-azure-functions/ Happily, this pipeline execution is basically … Continue reading Execute Any Azure Data Factory Pipeline with an Azure Function
Another year and another excellent SQLBits conference is in the events calendar. We were supposed to be back in London and at the massive ExCel exhibition centre. However, the event (like most others) is going virtual. For me, once again I'm very humbled to have been selected to speak, not once, but three times. Thank … Continue reading Preparing for SQLBits 2020 – My Azure Data Factory Sessions
Welcome to the Blog of Paul Andrew 