This year at SQLBits I'm honoured to be presenting a full training day and two regular sessions throughout the week. It'll be my 6th time at SQLBits, my 3rd time delivering a full training day and my 6th/7th time delivering sessions, I think! Full agenda here: https://sqlbits.com/information/schedulegrid My Sessions Azure Data Integration Pipelines - Advanced … Continue reading SQLBits 2022 – My Sessions
Data Mesh vs Azure -Theory vs practice Use the tag Data Mesh vs Azure to follow this blog series. As a reminder, the four data mesh principals: domain-oriented decentralised data ownership and architecture.data as a product.self-serve data infrastructure as a platform.federated computational governance. Source reference: https://martinfowler.com/articles/data-mesh-principles.html In Part 1 and Part 2 of this blog … Continue reading Building a Data Mesh Architecture in Azure – Part 3
Data Mesh vs Azure -Theory vs practice Use the tag Data Mesh vs Azure to follow this blog series. As a reminder, the four data mesh principals: domain-oriented decentralised data ownership and architecture.data as a product.self-serve data infrastructure as a platform.federated computational governance. Source reference: https://martinfowler.com/articles/data-mesh-principles.html In Part 1 of this blog series we looked … Continue reading Building a Data Mesh Architecture in Azure – Part 2
Data Mesh vs Azure - Theory vs practice Use the tag Data Mesh vs Azure to follow this blog series. Context and Background The concepts and principals of a data mesh architecture have been around for a while now and I've yet to see anyone else apply/deliver such a solution in Azure. I'm wondering if … Continue reading Building a Data Mesh Architecture in Azure – Part 1
I've already got several events in the calendar for the first quater of 2022! Assuming travel plans are permitted I'm really looking forward to speaking and attending the following events. Hope to see you there or online: SQL Portugal Data MeetUp https://www.meetup.com/sqlport-data/ 6th Jan - An Introduction to Azure Data Integration Pipelines3rd Feb - Azure … Continue reading Training events and Speaking in 2022 – q1
A long time ago in a glaxy far far away... 🙂 ... Someone asked me what I thought 'good' Data Governance might look like for a given data platform - warehouse or analytics solution. This included all aspects of data governance is was a very broad question. To add some actual context, not related to … Continue reading Good Data Governance – My Thoughts
Recording from the Hybrid Virtual Group MeetUp Abstract Once upon a time, there was a data warehouse and it lived happily as a set of tables within our relational database management system (RDMS) called Microsoft SQL Server. The data warehouse had three children known as extract, transform, and load. One day a blue/azure coloured cloud … Continue reading An Introduction to Delta Lakes and Delta Lake-Houses
Having worked with Azure Data Factory and now Azure Synapse Analytics data integration pipelines ever since the resources first appeared in the Microsoft cloud platform, I've definitley earned (more than) my fair share of experience using the products. Both good and bad. As a data engineer and data archtiect. To help soften those bad experiences, … Continue reading Azure Data Integration Pipelines – A Deep Dive
Inspired by an earlier blog where we looked at 'How Interchangeable Delta Tables Are Between Databricks and Synapse' I decided to do a similar exercise, but this time with the integration pipeline components taking centre stage. As I said in my previous blog post, the question in the heading of this blog should be incredibly … Continue reading How Interchangeable Are Integration pipelines Between Azure Data factory and Azure Synapse Analytics?
Azure Data Factory & Azure Synapse Analytics Following a recent talk I did for the MeetUp 'Let's Talk - Data Engineering' , here is the recording on YouTube for those that didn't catch the live broadcast. I squeezed a lot of content into an hour for those that are new to Azure Data Factory and … Continue reading An Introduction to Azure Data Integration Pipelines
Welcome to the Community Blog of Paul Andrew 