Azure Data Factory / Microsoft Fabric Pipelines (2 days or afternoon/evenings)

Introduction

Dive into Azure Data Factory / Microsoft Fabric Pipelines and elevate your data engineering capabilities to the next level! Discover advanced techniques and best practices essential for the modern data engineer.


Topics

Introduction

  • Architecture of Azure Data Factory / Pipelines
  • Integration runtime
  • Datasources / Linked Services: SQL Server, Azure, Blob Storage (CSV, XLSX), Web

ETL Pipelines

  • Copy data: Datasets, Source, Sink, Mapping
  • Transform data: Data flows, Power Query
  • SQL Activities: Stored Procedures, Lookup, Script
  • Parameters, Variables, ADF Expression language
  • Iteration & conditionals: Foreach / if / Switch
  • Web: Call Web API

Management

  • Schedule execution: Triggers
  • Monitoring / logging
  • Deployment
  • Debugging
  • OTAP


Target Audience

Data Engineers who want to delve into building and managing data integration solutions with Azure Data Factory and/or Microsoft Fabric Pipelines.

Prerequisites

Basic knowledge of ETL processes: Understanding of fundamental concepts like Extract, Transform, and Load.

Information

Interested in this training? Click here for more information.