Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 14 hours
Course Outline
Fundamentals of Azure Data Factory
- Comprehensive overview of the Azure Data Factory platform
- Core concepts and architectural components
- Practical use cases and strategic advantages of ADF
Configuring the ADF Workspace
- Provisioning and configuring an ADF instance
- Navigating the Azure Data Factory user interface
- Understanding the role of integration runtimes
Managing Datasets and Linked Services
- Defining datasets and establishing linked services
- Connecting to a variety of data sources
- Setting up authentication protocols and secure connectivity
Designing Data Pipelines
- Understanding pipeline structure and key components
- Building straightforward data pipelines using activities
- Constructing pipelines dedicated to data movement
Data Flows and Transformation Logic
- Introduction to the data flow feature
- Exploring various data transformation activities
- Designing and executing data flow transformations
Pipeline Scheduling and Automation
- Automating pipeline execution via triggers
- Utilizing tumbling window and event-based trigger mechanisms
- Monitoring pipeline activities and interpreting output logs
Troubleshooting and Resilience
- Debugging pipelines and data flow components
- Implementing robust error handling and retry strategies
- Enhancing existing pipelines with error management logic
Optimizing Performance
- Applying best practices for pipeline efficiency
- Configuring parallelism and partitioning for improved throughput
- Tuning pipeline performance for optimal results
Security Measures and Monitoring
- Enforcing access controls and permission management in ADF
- Implementing data encryption and secure transfer protocols
- Utilizing built-in tools and alerts for continuous pipeline monitoring
Advanced Integration Scenarios
- Connecting ADF with other Azure ecosystem services
- Addressing complex data integration challenges
- Developing a complete end-to-end data integration solution
Key Takeaways and Future Paths
Requirements
- Foundational understanding of cloud computing principles
- Working familiarity with data integration workflows and ETL processes
Target Audience
- Data engineers
- Data analysts
- ETL developers
- IT professionals
Testimonials (2)
All of the training was great. Especially liked the training documentation to reference. Looking forward to the Advanced Training, when we are ready.
Amy Gregg - Qualfon
Course - Boomi Integration Fundamentals
I've find out new interesting things about Lambda and Serverless