Welcome to the Blog & Website of Paul Andrew
Technical Leadership Centred Around the Microsoft Data Platform
Just a quick post friends. As you may already be aware, with my friend and now Avanade colleague Richard Swinbank (@RichardSwinbank), we are at it again. Following the success and enjoyment of collaborating on Richard's book 'Azure Data Factory by Example', previously blogged about here. We decided to engage with O'Reilly on a new project, … Continue reading Learning Azure Synapse Analytics – Early Release
SQLBits 2022 - Full Day of Training 9th March – Online or In Person at the London Excel https://sqlbits.com https://youtu.be/41eiT-Qp-bA In this full day training data session, we'll quickly cover the fundamentals of data integration pipelines before going much deeper into our Azure resources. Within a typical Azure data platform solution for any enterprise grade … Continue reading Azure Data Integration Pipelines – Advanced Design and Delivery
Having worked with Azure Data Factory and now Azure Synapse Analytics data integration pipelines ever since the resources first appeared in the Microsoft cloud platform, I've definitley earned (more than) my fair share of experience using the products. Both good and bad. As a data engineer and data archtiect. To help soften those bad experiences, … Continue reading Azure Data Integration Pipelines – A Deep Dive
Azure Data Factory & Azure Synapse Analytics Following a recent talk I did for the MeetUp 'Let's Talk - Data Engineering' , here is the recording on YouTube for those that didn't catch the live broadcast. I squeezed a lot of content into an hour for those that are new to Azure Data Factory and … Continue reading An Introduction to Azure Data Integration Pipelines
Scaling Azure Data Factory & Azure Synapse Analytics Pipelines Context Back in May 2020 I wrote a blog post about 'When You Should Use Multiple Azure Data Factory's'. Following on from this post with a full year+ now passed and having implemented many more data platform solutions for some crazy massive (technical term) enterprise customers … Continue reading Scaling Azure Data Integration Pipelines – Decoupling Data Extract And Transform
Background Building on a previous blog post where I explored what a possible Azure Synapse Analytics logical architecture might look like in terms of end-to-end data curation/enrichment, here: Thinking about an Azure Synapse Analytics Logical Architecture v1 Now, with the recently added Synapse 'Managed Virtual Network' I'm exploring the same architecture from a physical network connectivity … Continue reading Thinking About an Azure Synapse Analytics Physical Architecture v1
Hi folks, as some of you may be aware it was the Microsoft MVP Summit in March, for MVP's this is an exciting time where Microsoft product teams share plans for the coming year and talk about features on the roadmap. That said, I have the privilege of knowing what the future looks like for … Continue reading Thinking about an Azure Synapse Analytics Logical Architecture v1
A few weeks ago I delivered an introduction session on Azure Synapse Analytics as part of the Data Toboggan event. In my session I explored what Synapse is? And given the answer isn't that straight forward or obvious I thought it was probably worth re-sharing here as the recording is now available on YouTube. In … Continue reading What is Azure Synapse Analytics?
Last Updated - 28th may 2021 Following my previous (more detailed) blog post on 'Is Azure Synapse Analytics Ready for Production?' I was asked to summarize this understanding/opinion of Synapse into a simpler view. Updated: I've tweaked a couple of the traffic lights and narrative based on the annoucements this week from the Microsoft Build … Continue reading Azure Synapse Analytics – Feature Summary vs Status
It's now been well over a year since Microsoft announced Azure Synapse Analytics as an offering at the big U.S.A based conferences back in November 2019. While I completely share and actually like Microsoft's vision of an analytics resource... "that brings together data integration, enterprise data warehousing and big data analytics" https://azure.microsoft.com/en-gb/services/synapse-analytics/ ... the marketing, … Continue reading Is Azure Synapse Analytics Ready for Production?
Welcome to the Blog & Website of Paul Andrew 