As we know Azure Data Factory (ADF) Version 2 now has the ability to use expressions, parameters and system variables in various components throughout the service. This is brilliant and the best thing about v2 allowing us to build some very dynamic parameter driven pipelines. However, the syntax isn't always that obvious when you use … Continue reading ADFv2 Variable String Interpolation – REST API Body
Tag: Azure Data Factory
Azure Data Factory v2 Developer Interface Launched
Its finally here!! After being teased for nearly 4 months with all the great new functionality available in Azure Data Factory version 2 we finally have the tools to start developing it. Microsoft, it appears, have leap frogged my long standing request and feedback votes to support ADF templates in Visual Studio 2017 and gone … Continue reading Azure Data Factory v2 Developer Interface Launched
Azure Data Factory v1 & v2 Service Principal Authentication for Azure Data Lake
Sadly this post has been born out of frustration, so please accept my apologies from the outset if that comes across in the tone. That said, I imagine anyone reading it will empathise and will have come across the post while searching for an understanding of some inconsistencies when using service principals to authenticate against … Continue reading Azure Data Factory v1 & v2 Service Principal Authentication for Azure Data Lake
Controlling U-SQL Job AU’s with Azure Data Factory v2 Pipeline Parameters
This post came about really from me playing around with Azure Data Factory Version 2 (ADFv2) and trying to gain a better appreciation of why and how you can now use parameters and expressions in ADFv2 to control your pipelines. Below is the first thing I tested out and hopefully gives you a taster of … Continue reading Controlling U-SQL Job AU’s with Azure Data Factory v2 Pipeline Parameters
