Get in Touch
 Duration 14 hours

Course Outline

Fundamentals of Azure Data Factory

  • Comprehensive overview of the Azure Data Factory platform
  • Core concepts and architectural components
  • Practical use cases and strategic advantages of ADF

Configuring the ADF Workspace

  • Provisioning and configuring an ADF instance
  • Navigating the Azure Data Factory user interface
  • Understanding the role of integration runtimes

Managing Datasets and Linked Services

  • Defining datasets and establishing linked services
  • Connecting to a variety of data sources
  • Setting up authentication protocols and secure connectivity

Designing Data Pipelines

  • Understanding pipeline structure and key components
  • Building straightforward data pipelines using activities
  • Constructing pipelines dedicated to data movement

Data Flows and Transformation Logic

  • Introduction to the data flow feature
  • Exploring various data transformation activities
  • Designing and executing data flow transformations

Pipeline Scheduling and Automation

  • Automating pipeline execution via triggers
  • Utilizing tumbling window and event-based trigger mechanisms
  • Monitoring pipeline activities and interpreting output logs

Troubleshooting and Resilience

  • Debugging pipelines and data flow components
  • Implementing robust error handling and retry strategies
  • Enhancing existing pipelines with error management logic

Optimizing Performance

  • Applying best practices for pipeline efficiency
  • Configuring parallelism and partitioning for improved throughput
  • Tuning pipeline performance for optimal results

Security Measures and Monitoring

  • Enforcing access controls and permission management in ADF
  • Implementing data encryption and secure transfer protocols
  • Utilizing built-in tools and alerts for continuous pipeline monitoring

Advanced Integration Scenarios

  • Connecting ADF with other Azure ecosystem services
  • Addressing complex data integration challenges
  • Developing a complete end-to-end data integration solution

Key Takeaways and Future Paths

Requirements

  • Foundational understanding of cloud computing principles
  • Working familiarity with data integration workflows and ETL processes

Target Audience

  • Data engineers
  • Data analysts
  • ETL developers
  • IT professionals

Number of participants


Price per participant (excl. VAT)

Testimonials (2)

Upcoming Courses

Related Categories