Azure Data Factory v2 Developer Interface Launched

Its finally here!! After being teased for nearly 4 months with all the great new functionality available in Azure Data Factory version 2 we finally have the tools to start developing it. Microsoft, it appears, have leap frogged my long standing request and feedback votes to support ADF templates in Visual Studio 2017 and gone … Continue reading Azure Data Factory v2 Developer Interface Launched

Azure Data Factory v1 & v2 Service Principal Authentication for Azure Data Lake

Sadly this post has been born out of frustration, so please accept my apologies from the outset if that comes across in the tone. That said, I imagine anyone reading it will empathise and will have come across the post while searching for an understanding of some inconsistencies when using service principals to authenticate against … Continue reading Azure Data Factory v1 & v2 Service Principal Authentication for Azure Data Lake

Using U-SQL Split to Handle Variable Width Datasets

Happy New Year folks and welcome back to work! I hope you had a nice break. 🙂 I decided to kick off the new year of blogging with something fairly simple following some support work I did helping out a friend in the community. The problem encountered was twofold when dealing with data in Azure … Continue reading Using U-SQL Split to Handle Variable Width Datasets

Controlling U-SQL Job AU’s with Azure Data Factory v2 Pipeline Parameters

This post came about really from me playing around with Azure Data Factory Version 2 (ADFv2) and trying to gain a better appreciation of why and how you can now use parameters and expressions in ADFv2 to control your pipelines. Below is the first thing I tested out and hopefully gives you a taster of … Continue reading Controlling U-SQL Job AU’s with Azure Data Factory v2 Pipeline Parameters