This year at SQLBits I’m once again honoured to be presenting a full training day, a 100 minute session and a regular session during the week. It’ll be my 8th time at SQLBits and my 4th time delivering a full training day.
Full agenda here: https://sqlbits.com/attend/the-agenda
My Hat-Trick Of Sessions
- Microsoft Data Integration Pipelines – The Fundamentals to Level 300
- An Engineers Guide To Realtime Data Handling And Analytics
- An Evolution of Data Architectures – Lambda, Kappa, Delta, Mesh & Fabric
Microsoft Data Integration Pipelines – The Fundamentals to Level 300
Full Day of Training | Tuesday 19th March 2024
Training Day Overview
In this full day of training, we will start with the very basics of data integration before building up the fundamental skills and artifacts needed to orchestrate your data platform end-to-end. We will do this using Azure Data Factory pipelines, not exclusively, but as the basis for our learning journey. The maturity of the Data Factory resource offers a set of good foundations to understand the technical capabilities needed for orchestration, before applying our knowledge to other tools such as Microsoft Fabric and Azure Synapse Analytics.
Through a blend of theory, demonstration, and practical labs we will explore the components needed to orchestration cloud-based data processing workloads from source system ingestion, through to data model delivery. Focusing on the control flow plane, with supplementary options for building out low code data flow packages available as part of our integration pipelines.
Start the day knowing nothing about data integration pipelines, or as an experienced SQL Server SSIS developer, and leave with the knowledge and resources to apply these skills to your role as a data professional working with Microsoft cloud native tools.
Register for the event here: https://sqlbits.com/attend/
An Engineers Guide To Realtime Data Handling And Analytics
100 Minute Session | Wednesday 20th March 2024
Session Overview
The velocity of data is getting faster across many industries, fuelled by the business demand to gain insights and value from sources in near real-time. This necessity is then allowing decision makers to pivot and ultimately stay ahead of the competition. Furthermore, the growth of the internet of things and ‘smart’ devices now means the volume of that high velocity data has exploded. Meeting this demand requires new concepts and new designs for data/solution architects, with high throughput ingestion endpoints and query stream tools that can perform aggregations ‘on the fly’.
In this course, we will address the above head on. Discussing and designing architectures that can scale and burst for high throughput events. Querying using both SQL and KQL to blend stream and batch data feeds for downstream reporting.
As a platform, we’ll use Azure Event Hub and Azure Stream Analytics to ingest and handle that initial data stream. Before applying the same patterns to other resources in Microsoft Fabric and Azure Data Explorer. Understanding the patterns to apply as an architect vs the tooling available for delivery.
Register for the event here: https://sqlbits.com/attend/
An Evolution of Data Architectures – Lambda, Kappa, Delta, Mesh & Fabric
50 Minute Session | Friday 22nd March 2024
Session Overview
How has advancements in highly scalable cloud technology influenced the design principles we apply when building data platform solutions? Are we designing for just speed and batch layers or do we what more from our platforms, and who says these patterns must be delivered exclusively?
Let’s disrupt the theory and consider the practical application of all things Microsoft now has to offer, where concepts and patterns meet technology. Can we now utilise cloud technology to build architectures that cater for lambda, kappa, and Delta Lake concepts in a complete stack of services? And should we be considering a solution that offers all these principals in a nirvana of data insight perfection? How does Data Fabric as a concept fit with Microsoft Fabric as a product?
In this session we’ll explore the answer to all these questions and more in a thought provoking, argument generating look at the challenges every data platform engineer/architect faces.
Register for the event here: https://sqlbits.com/attend/
Hope to see you there or online.
Many thanks
Welcome to the Blog of Paul Andrew 