Microsoft Azure Fabric and Data Engineering Training(Online)

By Pavan, Microsoft Certified Azure Fabric and Data Engineer!!! (*****)

Course Description

Our Azure Data Engineering course will help IT professionals become subject matter experts in integrating, transforming, and consolidating data from various structured and unstructured data systems into structures suitable for building analytics solutions.

Key topics covered include:
  • Azure Data Factory (ADF): Learn how to create, schedule, and orchestrate data pipelines to move and transform data at scale.
  • Azure Databricks: Gain expertise in using this powerful analytics platform to process big data and perform advanced analytics with Apache Spark.
  • Microsoft Fabric: Understand how to leverage this unified platform for data integration, data engineering, and data analytics.

Responsibilities for this role include helping stakeholders understand the data through exploration, building, and maintaining secure and compliant data processing pipelines by using different Azure tools and techniques.

An Azure Data Engineer also helps ensure that data pipelines and data stores are high-performing, efficient, organized, and reliable, given a specific set of business requirements and constraints. This professional deals with unanticipated issues swiftly and minimizes data loss. An Azure Data Engineer also designs, implements, monitors, and optimizes data platforms to meet the data pipeline needs.

This course prepares you for the Microsoft Certification DP-700 (Fabric Data Engineer Associate) & DP-600 (Fabric Analytics Engineer Associate). Students will also get Hands-on Labs plus over 250+ Practice questions for the exam.

For course details and registration, please get in touch with Daniel at +1 267 718 1533 (Mobile & Whatsapp). We are based in Philadelphia, USA, and host affordable and comprehensive SQL Server/Azure/AWS/DevOps training programs for students around the globe.

Student Demographic

Course Introduction Video

Pavan's Profile - Microsoft Certified Azure Data Engineer

Mr. Pavan, a Microsoft Certified Azure Data Engineer (DP 203) with five years of hands-on Microsoft Azure Data stack experience. His expertise is with Azure Data Platform includes Azure Databricks, Delta Lake, Data Factory, Synapse, HDInsight, Data Catalog, and Cosmos DB. Besides, he also has significant experience in Big Data infrastructure and Software development. He has a great passion for mentoring students, and he will take you deep into the Azure Data Platform domain.

Pavan's Certifications

Talk to Pavan

Live Training Videos

We believe in letting our prospective students to watch recorded videos of our live training classes and decide for themselves. If you would still like to attend a one-on-one live demo session, please give call Daniel @ 267 718 1533 and he can schedule one for you at your convenience.

Course Content

Module 1: Introduction to Azure Data factory

  • Understand Azure Data Factory components
  • Create linked services
  • Create datasets
  • Manage integration runtime

Module 2: Data Movement using Data Factory Control Flow

  • Understand data factory control flow activities
  • Develop the data factory pipelines using copy activity for data movement
  • Add parameters to data factory components
  • Debug data factory pipelines & data flows
  • Setup triggers & Alerts for pipelines

Module 3: Data transformation using Data Factory

  • Build Mapping Data Flow for data transformation
  • Add parameters to mapping data flows
  • Debug data flows from pipelines
  • Implement Slowly Changing Dimension using mapping data flows

Module 4: Introduction to Azure Databricks

  • Provision an Azure Databricks workspace
  • Ingest data using Azure Databricks.
  • Using the different data exploration tools in Azure Databricks.
  • Analyse data with Data Frame APIs.
  • Use Spark to process and analyse data stored in files.
  • Use Spark to visualize data

Module 5: : Manage data with Databricks Delta Lake

  • What is Databricks Delta Lake
  • How to manage ACID transactions using Delta Lake
  • How to use schema versioning and time travel in Delta Lake
  • How to maintain data integrity with Delta Lake

Module 6: SQL Warehouses in Azure Databricks

  • Create and configure SQL Warehouses in Azure Databricks
  • Create databases and tables
  • Create queries and dashboards

Module 7: Run Azure Databricks Notebooks with Azure Data Factory

  • Run Azure Databricks notebooks from ADF Pipelines.
  • Create an Azure Data Factory linked service for Azure Databricks.
  • Use a Notebook activity in a pipeline.
  • Pass parameters to a notebook.

Module 8: Introduction to Microsoft Fabric

  • Overview of Microsoft Fabric
  • Microsoft Fabric Terminology
  • Copilot in Microsoft Fabric
  • Microsoft Fabric settings
  • Working with Workspaces
  • Discovering data in OneLake catalog
  • Managing a Workspace with git

Module 9: Getting started with Data Engineering Experiences using Microsoft Fabric

  • Overview of Data Engineering in Microsoft Fabric
  • Working with Lakehouse
  • Data Factory in Microsoft Fabric
  • Working with Data Pipelines in Microsoft Fabric
  • Ingesting Data with Dataflows Gen2

Module 10: Data Engineering using Apache Spark, Delta Lakes and Notebooks

  • Introduction to Spark compute in Microsoft Fabric
  • Apache Spark job definition
  • Apache Spark monitoring in Microsoft Fabric
  • Delta Lake tables optimization and V-Order
  • Using Microsoft Fabric Notebooks

Module 11: Real-Time Intelligence in Microsoft Fabric

  • Work with Eventhouse
  • Get, process and route data in Eventstreams
  • Get data in KQL Database
  • Real-Time data processing using Event Processor
  • Query data from a KQL Queryset
  • Monitor and visualize your data
  • Drive alerts and actions from your data with Activator

Module 12: Implement Microsoft Fabric Data Warehousing

  • Create a Data Warehouse in Microsoft Fabric
  • Data ingestion options
  • Pipelines and Data flows
  • Mirror databases in Fabric
  • Open Mirroring & Clone tables
  • Dimensional modelling in Microsoft Fabric Warehouse
  • Query and monitor the Data Warehouse

Module 13: Power BI semantic models in Microsoft Fabric

  • Choose appropriate storage modes for your semantic model
  • Create relationships between tables in a semantic model
  • Design dynamic elements to extend calculations in a semantic model
  • Enable large semantic model storage format and incremental refresh
  • Optimize DirectQuery models with table level storage.
  • Restrict access to Power BI model data with RLS.
  • Restrict access to Power BI model objects with OLS.

Course Statistics

4

Years of Experience

2156

Gratified Students

26

Training Batches

6542

Training Hours

Gratified Student Feedback - From Year 2000

  • Trainer: Pavan Kumar

    The trainer was obviously a SME on the course topics and delivered training in a simple and understanding way that azure beginners like me found it easy to follow. Mr. Pavan is very resourceful and attentive to our questions and ensured that all questions have been answered. I liked the way he adhered to the curriculum topics and tried to avoid distractions in a polite way. I would definitely recommend EmpireDataSystems to others in the future. I thank the team for giving me the opportunity to learn Azure topics from a good training.
    Vasutha Ramachandran
    Carmel, US
  • Trainer: Pavan

    Thank you very much for conducting this class and sharing your knowledge with us and your valuable time. I certainly do benefit from your teachings and add to my existing knowledge. In the future , will reach out to you on any doubts and questions. Due to my family situation i was not able to attend all your classes, but the recorded videos will come in handy.
    Lakshmi Raghu
    Philadelphia, US
  • Trainer: Paven Kumar

    Was a great course, I came with no IT experience, came from medical background, but was a pleasure to attend.
    Tigist Gebrehiwot
    Denver, US
  • Trainer: Pavan Kumar

    It was great time, the trainer is knowledgeable and credible. I appreciate Pavan and Daniel for offering data engineering training.
    Berihanu Aenamo
    Atlanta, US
  • Trainer: Pavan kumar

    Pavan is a good trainer. Over all, a good Azure Data Engineering course.
    Sraven k manchikanti
    McKinney, US
  • Trainer: Pavan Kumar

    Good course.
    Meghana Arcot
    Hartford, US
  • Trainer: Pavan

    Pavan - Thank you for all your help; I have learned a lot during our sessions together and will continue to review the content on one drive to get more comfortable
    George A Tarpeh
    Stafford, US
  • Trainer: Pavan

    This course really helped me understand the data engineering concepts, how they work and how to use them. The instructor provided detailed explanations and real time use cases to help understand better.
    Aravindh kumaran
    Stratford, CA
  • Trainer: Mr. Paven

    Instructor Pavan was excellent and the course curriculum was also good.
    Wossen Tarkgne
    Baltimore, US
  • Trainer: Pavan

    Azure Data Engineering course was informative and Pavan did a great job with explaining the concepts and labs.
    Rajesh Gundavarapu
    Quincy, US
  • Trainer: Pavan

    Good class to build up excellent knowledge and background in Azure Data Engineering. Highly recommend for people to be a data engineer, scientist, and analyst.
    Tehetina Tessema
    Fairfax, US
  • Trainer: Pavan Kumar

    Pavan Kumar is a very good instructor, he not only teaches the class but patiently tries to answer everyone's questions and encourages to be active participant during the class. Absolutely helpful for someone new to Cloud and Cloud Data Engineer role or want to take certification. If you can manage your time and practice all that was discussed in class you should good sneak peak into Azure ETL development world. I wish I had more time during the day to go over class recording again and practice the class.
    Chandana Mukka
    Trenton, US
  • Trainer: Deeksha Sherma

    I got a great learning experience on ADLS, ADF,ADB,ASyA, and AStA in this training session.
    Ameha Habtu
    Los Angeles, US
  • Trainer: Deeksha Sharma

    It was nice and a great learning experience. Deeksha was a through professional with explaining in details on all the areas of DP203 Concepts and modules. Happy to be part of this training. Daniel AG a person with a great dedication and commitment with follow ups !!! Appreciate , A best place to Learn !!!
    Senthil Kumar M
    Austin, US
  • Trainer: Deeksha Gopal

    Great Azure Data Engineering training and great trainer too. !!! I am planning to take Microsoft certification exam DP 203 soon. Thank you.
    Tariku Geleta
    Charlotte, US
  • Trainer: Deeksha Sharma

    Azure data engineering course was really a good experience and did lot of hands on. Deeksha is an excellent trainer, This training is much valuable and detail, Thank you!!
    Fnu Nazira
    Roswell, US
  • Trainer: Deeksha sharma

    Its a great Azure Data Engineering course to understand different Azure services in great detail so you can use them as required. Deeksha is an excellent trainer.
    Sharma pandyaram
    Roswell, US
  • Trainer: deeksha sharma

    Excellent Trainer and Great course all together.
    sridhar urs
    Edison, US
  • Trainer: Deeksha

    Excellent trainer with good knowledge on all topics of Azure Data Engineer.
    Roopa
    Gainesville, US
  • Trainer: Deeksha Sharma

    Well organized Azure Data Engineering course
    Taevan Steele
    Atlanta, US
  • Trainer: Deeksha Sharma

    Deeksha had a wealth of Azure Data Engineering knowledge and conducted the entire sessions quite impressively.
    Sajeed Poudyal
    Germantown, US
  • Trainer: Deeksha Sharma

    Overall its a great course. Trainer Deeksha is knowledgeable and very hands on with Azure Data Engineering.
    Karthik Sivanadiyan
    Reston, US
  • Trainer: Deeksha

    Enjoyed the Data Engineering course. Thank you Deeksha.
    Bhavna
    Oakton, US
  • Trainer: Deeksha Sharma

    Good course. Thank you.
    RANJIT
    New York City, US
  • Trainer: Deeksha

    This Azure Data Engineering training exceeded my expectation!!! Trainer Deeksha is a subject matter expert, and she went extra mile to help me. I missed classes here and there, but the recorded class videos really help me to catch up. I strongly recommend you to join EmpireDataSystems because they are well organized beside that Daniel really understand his students. By the way, thank you for all those free Azure Lab Vouchers. I am looking forward to take Exam DP 203. Thanks Again!!
    Krishna Reddy
    Downingtown, US

Empire Data Systems

Social Links