Azure Data Integration Pipelines – Advanced Design and Delivery

SQLBits 2022 – Full Day of Training

9th March – Online or In Person at the London Excel

https://sqlbits.com


In this full day training data session, we’ll quickly cover the fundamentals of data integration pipelines before going much deeper into our Azure resources. Within a typical Azure data platform solution for any enterprise grade data analytics or data science workload an umbrella resource is needed to trigger, monitor, and handle the control flow for transforming datasets, with the goal being actionable data insight. Those requirements are met by deploying Azure Data Integration pipelines, delivered using Azure Synapse Analytics or Azure Data Factory. In this session, I’ll show you how to create rich dynamic data pipelines and apply these orchestration resources in production. Using scaled architecture design patterns, best practice, data mesh principals, and the latest metadata driven frameworks. We will take a deep dive into the services, considering how to build custom activities, complex pipelines and think about hierarchical design patterns for enterprise grade deployments. All this and more in a complete set of 12 modules (based on real world experience) we will take you through how to implement data integration pipelines in production and deliver advanced orchestration patterns.


• Module 1: Pipeline Fundamentals
• Module 2: Integration Runtime Design Patterns
• Module 3: Data Transformation
• Module 4: Dynamic Pipelines
• Module 5: Execution Parallelism
• Module 6: Pipeline Extensibility
• Module 7: VNet Integration
• Module 8: Security
• Module 9: Monitoring & Alerting
• Module 10: CI/CD
• Module 11: Solution Testing
• Module 12: Final Thoughts


Hope to see you there.

Many thanks

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.