Azure Data Analytics End to End Let's start with a story, not a 'once upon a time story', a story for your backlog 🙂 As a solution architect I need to design and build an Azure data analytics platform end to end to deliver data insights for my customer. In February 2021 I delivered a … Continue reading An Architects Guide to Delivering Data Insights Using the Microsoft Azure Data Platform
Microsoft Book of News – Ignite 2021
Microsoft Ignite 2021 Announcements Another Microsoft Book of News, this time from Ignite 2021. Thanks Microsoft, really handy having all the announcements in one place. Not loads of Data & AI things shared at this event. But still 55 pages of some impressive additions to the Microsoft products. My favourite bits as a Data Platform … Continue reading Microsoft Book of News – Ignite 2021
What is Azure Synapse Analytics?
A few weeks ago I delivered an introduction session on Azure Synapse Analytics as part of the Data Toboggan event. In my session I explored what Synapse is? And given the answer isn't that straight forward or obvious I thought it was probably worth re-sharing here as the recording is now available on YouTube. In … Continue reading What is Azure Synapse Analytics?
Azure Synapse Analytics – Feature Summary vs Status
Updated - 10th Feb 2021 Following my previous blog post Is Azure Synapse Analytics Ready for Production? I was asked to summarize this understanding/opinion of Synapse into a simpler view. This is what I did... As a PDF if you prefer here. Discuss 🙂 Thanks
Is Azure Synapse Analytics Ready for Production?
It's now been well over a year since Microsoft announced Azure Synapse Analytics as an offering at the big U.S.A based conferences back in November 2019. While I completely share and actually like Microsoft's vision of an analytics resource... "that brings together data integration, enterprise data warehousing and big data analytics" https://azure.microsoft.com/en-gb/services/synapse-analytics/ ... the marketing, … Continue reading Is Azure Synapse Analytics Ready for Production?
How Interchangeable Are Delta Tables Between Azure Databricks and Azure Synapse Analytics?
Databricks vs Synapse Analytics As an architect I often get challenged by customers on different approach's to a data transformation solutions, mainly because they are concerned about locking themselves into a particular technology, resource or vendor. One example of this is using a Delta Lake to deliver an Azure based warehousing/analytics platform. Given this context, … Continue reading How Interchangeable Are Delta Tables Between Azure Databricks and Azure Synapse Analytics?
Preparing My Community Talks for 2021
New & Updated Talks for the Community With 2020 in the rear view mirror its time to reflect on another year of experience gained as a consultant designing and delivering data platform solutions for my customers in this every changing world of technology. I've previously confessed that my job is my hobby, so its great … Continue reading Preparing My Community Talks for 2021
Pipelines – Understanding Internal vs External Activities
Azure Data Factory & Azure Synapse Analytics Integrate Pipelines In this post I want us to explore and understand the difference between an internal and external activity when using our favourite orchestration pipelines. I'll focus predominately on Azure Data Factory (ADF), but the same applies to Azure Synapse Analytics. *Warning: this is a fairly dry, … Continue reading Pipelines – Understanding Internal vs External Activities
Trying to Deploy Azure Synapse Analytics Using ARM Templates
Just last week we heard the announcement from Microsoft that Azure Synapse Analytics is now generally available (GA)... A full year on, plus a few weeks, since first seeing Synapse at the big USA conferences in November 2019. Today I've been attempting to use the resource with a view to implementing it for several customer … Continue reading Trying to Deploy Azure Synapse Analytics Using ARM Templates
Data Factory Activity Concurrency Limits – What Happens Next?
As a follow up to my blog about Data Factory resource limitations here. I decided to dig deeper and expose some of these limitations with a view to understanding what happens to your pipeline when/if you hit them. In this post I'm focusing on the Activity Concurrency limits, as a reminder: Resource Default limit Maximum … Continue reading Data Factory Activity Concurrency Limits – What Happens Next?
