How Interchangeable Are Integration pipelines Between Azure Data factory and Azure Synapse Analytics?

Inspired by an earlier blog where we looked at 'How Interchangeable Delta Tables Are Between Databricks and Synapse' I decided to do a similar exercise, but this time with the integration pipeline components taking centre stage. As I said in my previous blog post, the question in the heading of this blog should be incredibly … Continue reading How Interchangeable Are Integration pipelines Between Azure Data factory and Azure Synapse Analytics?

An Introduction to Azure Data Integration Pipelines

Azure Data Factory & Azure Synapse Analytics Following a recent talk I did for the MeetUp 'Let's Talk - Data Engineering' , here is the recording on YouTube for those that didn't catch the live broadcast. I squeezed a lot of content into an hour for those that are new to Azure Data Factory and … Continue reading An Introduction to Azure Data Integration Pipelines

A Spring Board into the Avanade Centre of Excellence (CoE)

A Great Outcome Following the Acquisition of Altius Once upon a time, a grumpy consultant was made even more grumpy (if that was possible) by the news that Altius Data Consulting Ltd was being/had been acquired by the much-much larger Avanade Inc orange machine, complete with Accenture and Microsoft parents, Mum & Dad. I must … Continue reading A Spring Board into the Avanade Centre of Excellence (CoE)

Scaling Azure Data Integration Pipelines – Decoupling Data Extract And Transform

Scaling Azure Data Factory & Azure Synapse Analytics Pipelines Context Back in May 2020 I wrote a blog post about 'When You Should Use Multiple Azure Data Factory's'. Following on from this post with a full year+ now passed and having implemented many more data platform solutions for some crazy massive (technical term) enterprise customers … Continue reading Scaling Azure Data Integration Pipelines – Decoupling Data Extract And Transform

Using Mermaid to Create a ProcFwk Pipeline Lineage Diagram

The other day Kamil (@NowinskiK) messaged me on Teams asking if I liked Mermaid's 🙂 I prepared myself for a conversation about which was better; the fish half being on top vs on the bottom. Ha! Of course not!! Kamil was actually referring to the... Javascript based diagramming and charting tool that renders Markdown-inspired text … Continue reading Using Mermaid to Create a ProcFwk Pipeline Lineage Diagram

The 5 Year Microsoft MVP Milestone

When logging into my MVP profile to update community activities etc I still have to do a double take when seeing the bookmark image (on the left). Specifically, the 'Number of MVP Awards' sub heading, reading 5. Five consecutive years I've been given this great award from Microsoft as a Most Valuable Professional. Smug face … Continue reading The 5 Year Microsoft MVP Milestone

Azure Data Factory by Example – A Review of My Technical Review

On 2nd June 2020 Apress reached out to me about the role of technical reviewer on a book about Azure Data Factory. The exact conversation may amuse you, so I've included it exactly as it happened 🙂 THE BEGINNING Paul,I know writing is out of the question, but do you have bandwidth to tech review … Continue reading Azure Data Factory by Example – A Review of My Technical Review

Becoming an Electricity Island Including Free Fuel for the Car – Part 2

MyEnergi - Zappi Setup with Solar Panels and Electric Car Charging Following on from part 1 of this blog series where I detailed the solar panel and battery storage setup for my house. In this post, I've included details on how I extended this eco-friendly eco-system with a fully electric car or electric vehicle (EV) … Continue reading Becoming an Electricity Island Including Free Fuel for the Car – Part 2

Becoming an Electricity Island Including Free Fuel for the Car – Part 1

Solar Edge PV Panel & Tesla Powerwall Battery Storage Install This isn't the sort of thing I would normally blog about. However, it seems like a geeky enough topic considering the gadgets and technology involved, so why not. Hopefully it will also encourage others to do something similar. In March of 2021 after many months … Continue reading Becoming an Electricity Island Including Free Fuel for the Car – Part 1