Data Integration, Architecture and Real-Time Analytics Full Training Days with Me 2024

SQL Bits, UK, go to >>
SQL Day, Poland, go to >>
Data Platform Next Steps, Denmark, go to >>
Big Data Europe, Lithuania, go to >>

SQLBits | March | Online & In Person

Microsoft Data Integration Pipelines – The Fundamentals to Level 300

Event Link: https://sqlbits.com/attend/the-agenda/full-day-training/Microsoft_Data_Integration_Pipelines__The_Fundamentals_to_Level_300

Overview

In this full day of training, we will start with the very basics of data integration before building up the fundamental skills and artifacts needed to orchestrate your data platform end-to-end. We will do this using Azure Data Factory pipelines, not exclusively, but as the basis for our learning journey. The maturity of the Data Factory resource offers a set of good foundations to understand the technical capabilities needed for orchestration, before applying our knowledge to other tools such as Microsoft Fabric and Azure Synapse Analytics.

Through a blend of theory, demonstration, and practical labs we will explore the components needed to orchestration cloud-based data processing workloads from source system ingestion, through to data model delivery. Focusing on the control flow plane, with supplementary options for building out low code data flow packages available as part of our integration pipelines.

Start the day knowing nothing about data integration pipelines, or as an experienced SQL Server SSIS developer, and leave with the knowledge and resources to apply these skills to your role as a data professional working with Microsoft cloud native tools.

Modules

Pipeline Fundamentals
Integration Runtime Design Patterns
Data Transformation
Dynamic Pipelines
Pipeline Extensibility
Execution Parallelism
VNet Integration
Security
Monitoring & Alerting
Solution Testing
CI/CD
Final Thoughts

SQL Day | May | In Person

Deciphering Data Architectures with James Serra

Event Link: https://sqlday.pl/en/conference-2024 /

I’ll be co-presenting this one with James Serra as part of a collaboration and celebrating the launch of this book.

Overview

This pre-conference workshop will begin by defining ‘big data’ and clarifying various data architecture concepts to establish a solid foundation of understanding before delving into specific data architectures. Topics to be covered include relational data warehouses, data lakes, data marts, data virtualization, and the differences between ETL and ELT. James and Paul will then explore and compare the architectures of the Modern Data Warehouse, Data Fabric, Data Lakehouse, and Data Mesh in considerable detail, highlighting their advantages and disadvantages. While these concepts may seem appealing in theory, James and Paul will address potential concerns to consider before implementation. This workshop aims to demystify these complex topics, offering ample opportunity for questions. The content is derived from James’s book “Deciphering Data Architectures: Choosing Between a Modern Data Warehouse, Data Fabric, Data Lakehouse, and Data Mesh.

Data Platform Next Steps | June | In Person

Building a Real-time Analytics Solution Using Microsoft Fabric

Event Link: https://dataplatformnextstep.com/training-sessions/training-day-3/

Overview

The velocity of data is getting faster across many industries, fuelled by the business demand to gain insights and value from sources in near real-time. This necessity is then allowing decision makers to pivot and ultimately stay ahead of the competition. Furthermore, the growth of the internet of things and ‘smart’ devices now means the volume of that high velocity data has exploded. Meeting this demand requires new concepts and new designs for data/solution architects, with high throughput ingestion endpoints and query stream tools that can perform aggregations ‘on the fly’.
In this full day of training, we will address the above requirements head on. Discussing and designing architectures that can scale and burst for high throughput events. Querying using both SQL and KQL to blend stream and batch data feeds for downstream reporting. Our unified tool of choice to deliver these capabilities will be Microsoft Fabric. Working with Event Stream and Kusto items to deliver a real-time analytics solution.