Category: Azure

Data Integration, Architecture and Real-Time Analytics Full Training Days with Me 2024

Posted on by mrpaulandrew

SQL Bits, UK, go to >> SQL Day, Poland, go to >> Data Platform Next Steps, Denmark, go to >> Big Data Europe, Lithuania, go to >> SQLBits | March | Online & In Person Microsoft Data Integration Pipelines – The Fundamentals to Level 300 Event Link: https://sqlbits.com/attend/the-agenda/full-day-training/Microsoft_Data_Integration_Pipelines__The_Fundamentals_to_Level_300 Overview In this full day of training, … Continue reading Data Integration, Architecture and Real-Time Analytics Full Training Days with Me 2024 →

Is Azure Synapse Analytics Dead and Does It Really Matter?

Posted on by mrpaulandrew

The product vs the capabilities I think it’s fair to say that Azure Synapse Analytics has had a hard life. It was announced in public preview as a surprise to most of the community, including Microsoft cloud solution architects. Ultimately meaning that very little private preview testing and feedback on the product was done before … Continue reading Is Azure Synapse Analytics Dead and Does It Really Matter? →

procfwk is Getting An Upgrade to CF.Cumulus

Posted on by mrpaulandrew

CF.Cumulus.Control Early Release Running a company (Cloud Formations) is very much a balance between steering the ship, while building the ship! As a result, my open source metadata driven orchestration framework (procfwk.com) got neglected. To the point where the Azure Functions, the middleware, originally written in .Net 3.1 Core is no longer supported. Additionally, the … Continue reading procfwk is Getting An Upgrade to CF.Cumulus →

SQLBits 2024 – My Sessions

Posted on by mrpaulandrew

This year at SQLBits I'm once again honoured to be presenting a full training day, a 100 minute session and a regular session during the week. It'll be my 8th time at SQLBits and my 4th time delivering a full training day. Full agenda here: https://sqlbits.com/attend/the-agenda My Hat-Trick Of Sessions Microsoft Data Integration Pipelines – … Continue reading SQLBits 2024 – My Sessions →

Considering a Medallion Architecture vs Microsoft Fabric

Posted on by mrpaulandrew

Data Ingestion vs Data Serving Context It seems like the concept of a medallion architecture has stuck in the industry. ETL isn't cool anymore and decribing the layers of our data solution directly with names like raw, cleansed and modelled was (apparently) too obvious, or maybe too interchangable, meaning people couldn't agree. That's fine. I … Continue reading Considering a Medallion Architecture vs Microsoft Fabric →

What Is Microsoft Fabric? My Point of View

Posted on by mrpaulandrew

Bringing the Data Platform Workspace and the Power Platform workspace Together Over the last 18 months or so I've been watching and supporting the development of Microsoft's new Software as a Service (SaaS) offering that has now been named at MSBuild 2023 as Microsoft Fabric. As a Microsoft MVP I've be aware of this offering … Continue reading What Is Microsoft Fabric? My Point of View →

Creating a Data Sandbox

Posted on by mrpaulandrew

Data Product Infrastructure as a Service Another blog post inspired by a recent conversation with my lovely Norwegian colleagues where I was asked about the creation of a data sandbox to support a customer engagement. Having done this before it seemed like a good enough reason to share my knowledge and experience with the community … Continue reading Creating a Data Sandbox →

Building a Data Mesh Architecture in Azure – Part 16 – Dead or Alive?

Posted on by mrpaulandrew

Is the Data Mesh dead or have we been using it without realising? The Gartner Hype Cycle for Data Management 2022 curve (shown below) is now a well-known picture in certain circles of the data community. It seems the trolls love to point out the relatively low position that Data Mesh has on this curve … Continue reading Building a Data Mesh Architecture in Azure – Part 16 – Dead or Alive? →

Building a Data Mesh Architecture in Azure – Part 15 – Frequently Asked Questions

Posted on by mrpaulandrew

Addressing Hype, Problems Faced & Common Misconceptions As I continue my day job supporting customers in their journey towards a true data mesh architecture, I've started to see a series of common questions. Or a set of common problems that I get asked. Frequently asked questions (FAQ's) if you like 🙂 For clarity, I am … Continue reading Building a Data Mesh Architecture in Azure – Part 15 – Frequently Asked Questions →