Empire Data Systems

Microsoft Azure Fabric and Data Engineering Training(Online)

By Pavan, Microsoft Certified Azure Fabric and Data Engineer!!! (*****)

Course Description

Our Azure Data Engineering course will help IT professionals become subject matter experts in integrating, transforming, and consolidating data from various structured and unstructured data systems into structures suitable for building analytics solutions.

Key topics covered include:
  • Azure Data Factory (ADF): Learn how to create, schedule, and orchestrate data pipelines to move and transform data at scale.
  • Azure Databricks: Gain expertise in using this powerful analytics platform to process big data and perform advanced analytics with Apache Spark.
  • Microsoft Fabric: Understand how to leverage this unified platform for data integration, data engineering, and data analytics.

Responsibilities for this role include helping stakeholders understand the data through exploration, building, and maintaining secure and compliant data processing pipelines by using different Azure tools and techniques.

An Azure Data Engineer also helps ensure that data pipelines and data stores are high-performing, efficient, organized, and reliable, given a specific set of business requirements and constraints. This professional deals with unanticipated issues swiftly and minimizes data loss. An Azure Data Engineer also designs, implements, monitors, and optimizes data platforms to meet the data pipeline needs.

This course prepares you for the Microsoft Certification DP-700 (Fabric Data Engineer Associate) & DP-600 (Fabric Analytics Engineer Associate). Students will also get Hands-on Labs plus over 250+ Practice questions for the exam.

For course details and registration, please get in touch with Daniel at +1 267 718 1533 (Mobile & Whatsapp). We are based in Philadelphia, USA, and host affordable and comprehensive SQL Server/Azure/AWS/DevOps training programs for students around the globe.

Student Demographic

Course Introduction Video

Course Information

Pavan's Profile - Microsoft Certified Azure Data Engineer

Mr. Pavan, a Microsoft Certified Azure Data Engineer (DP 203) with five years of hands-on Microsoft Azure Data stack experience. His expertise is with Azure Data Platform includes Azure Databricks, Delta Lake, Data Factory, Synapse, HDInsight, Data Catalog, and Cosmos DB. Besides, he also has significant experience in Big Data infrastructure and Software development. He has a great passion for mentoring students, and he will take you deep into the Azure Data Platform domain.

Pavan's Certifications

Talk to Pavan

Live Training Videos

We believe in letting our prospective students to watch recorded videos of our live training classes and decide for themselves. If you would still like to attend a one-on-one live demo session, please give call Daniel @ 267 718 1533 and he can schedule one for you at your convenience.

Course Content

Module 1: Introduction to Azure Data factory

  • Understand Azure Data Factory components
  • Create linked services
  • Create datasets
  • Manage integration runtime

Module 2: Data Movement using Data Factory Control Flow

  • Understand data factory control flow activities
  • Develop the data factory pipelines using copy activity for data movement
  • Add parameters to data factory components
  • Debug data factory pipelines & data flows
  • Setup triggers & Alerts for pipelines

Module 3: Data transformation using Data Factory

  • Build Mapping Data Flow for data transformation
  • Add parameters to mapping data flows
  • Debug data flows from pipelines
  • Implement Slowly Changing Dimension using mapping data flows

Module 4: Introduction to Azure Databricks

  • Provision an Azure Databricks workspace
  • Ingest data using Azure Databricks.
  • Using the different data exploration tools in Azure Databricks.
  • Analyse data with Data Frame APIs.
  • Use Spark to process and analyse data stored in files.
  • Use Spark to visualize data

Module 5: : Manage data with Databricks Delta Lake

  • What is Databricks Delta Lake
  • How to manage ACID transactions using Delta Lake
  • How to use schema versioning and time travel in Delta Lake
  • How to maintain data integrity with Delta Lake

Module 6: SQL Warehouses in Azure Databricks

  • Create and configure SQL Warehouses in Azure Databricks
  • Create databases and tables
  • Create queries and dashboards

Module 7: Run Azure Databricks Notebooks with Azure Data Factory

  • Run Azure Databricks notebooks from ADF Pipelines.
  • Create an Azure Data Factory linked service for Azure Databricks.
  • Use a Notebook activity in a pipeline.
  • Pass parameters to a notebook.

Module 8: Introduction to Microsoft Fabric

  • Overview of Microsoft Fabric
  • Microsoft Fabric Terminology
  • Copilot in Microsoft Fabric
  • Microsoft Fabric settings
  • Working with Workspaces
  • Discovering data in OneLake catalog
  • Managing a Workspace with git

Module 9: Getting started with Data Engineering Experiences using Microsoft Fabric

  • Overview of Data Engineering in Microsoft Fabric
  • Working with Lakehouse
  • Data Factory in Microsoft Fabric
  • Working with Data Pipelines in Microsoft Fabric
  • Ingesting Data with Dataflows Gen2

Module 10: Data Engineering using Apache Spark, Delta Lakes and Notebooks

  • Introduction to Spark compute in Microsoft Fabric
  • Apache Spark job definition
  • Apache Spark monitoring in Microsoft Fabric
  • Delta Lake tables optimization and V-Order
  • Using Microsoft Fabric Notebooks

Module 11: Real-Time Intelligence in Microsoft Fabric

  • Work with Eventhouse
  • Get, process and route data in Eventstreams
  • Get data in KQL Database
  • Real-Time data processing using Event Processor
  • Query data from a KQL Queryset
  • Monitor and visualize your data
  • Drive alerts and actions from your data with Activator

Module 12: Implement Microsoft Fabric Data Warehousing

  • Create a Data Warehouse in Microsoft Fabric
  • Data ingestion options
  • Pipelines and Data flows
  • Mirror databases in Fabric
  • Open Mirroring & Clone tables
  • Dimensional modelling in Microsoft Fabric Warehouse
  • Query and monitor the Data Warehouse

Module 13: Power BI semantic models in Microsoft Fabric

  • Choose appropriate storage modes for your semantic model
  • Create relationships between tables in a semantic model
  • Design dynamic elements to extend calculations in a semantic model
  • Enable large semantic model storage format and incremental refresh
  • Optimize DirectQuery models with table level storage.
  • Restrict access to Power BI model data with RLS.
  • Restrict access to Power BI model objects with OLS.

Course Statistics

4

Years of Experience

2156

Gratified Students

26

Training Batches

6542

Training Hours

Gratified Student Feedback - From Year 2000

  • Trainer: Vivek

    Azure data engineering class was great and covered a lot of topics.
    Rajesh Gundavarapu
    Boston, US

  • Trainer: Vivk

    The course was good and motivating for further learning. Thank you, Vivek and Daniel, for organizing this affordable Azure data engineering course.
    Yosef H
    Rosemount, US

  • Trainer: Vivek

    I attended Daniels Azure data engineering training. The course was very good, and the Trainer (Vivek) did all the follow-ups during and after the session. As per the request, he covered an additional topic: Azure Data Fabric. The class is highly interactive, and the recorded class video was also very helpful. Overall. it's worth the time and money. Thank you.
    Ranjani
    Shrewsbury, US

  • Trainer: Vivek

    It was a well-taught course on data engineering. Vivek covered all the topics of Data Bricks, Delta Lake, Data Factory, Synapse Analytics, Azure Data Fabric, etc, in detail.
    Mausami
    Piscataway, US

  • Trainer: Vivek

    Lovely presentation and discussion. I enjoyed the Azure data engineering training. Thank you.
    Tekezeshewa Betemariam
    Des Moines, US

  • Trainer: Vivek R

    Vivek was an excellent instructor for the Azure Data Engineering course, though it was his first time teaching the course.
    Vijay Sirivore
    Carrollton, US

  • Trainer: Vivek

    Excellent Training. Thank you.
    Rajesh Narayanaswamy
    Surrey, CA

  • Trainer: Vivek

    The Azure data engineering course I attended is a good one. Vivek is a subject matter expert and a great trainer, too. The course is well worth the money.
    Arpita Mehta
    Troy, US

  • Trainer: Vivek R

    It was a great class. The Trainer was expressive and calm. I understood the topics covered - Data Bricks, Delta Lake, Data Factory, Synapse Analytics, and Azure Data Fabric. Thank You
    Babafunmi Opeyemi
    North Laurel, US

  • Trainer: Vivek

    Excellent course and for sure the best training who would like to know about Azure platform. All the topics that were taught were really useful and with the recorded videos we can review the topics again. Vivek is an amazing trainer and did his best job.
    Saritha Rokkam
    Robertsville, US

  • Trainer: Pavan Kumar

    The Azure data engineering class was very helpful! The course is very well organized by Daniel and Pavan is an excellent trainer.
    Poojitha Pallay
    Pineville, US

  • Trainer: Pavan

    Great Azure Data Engineering course. Pavan is a very knowledgeable trainer.
    Divine Mutanga
    Las Vegas, US

  • Trainer: Pavan K

    Amazing class. Learned a lot in Azure data engineering, and Pavan was a great instructor.
    Godwin Zigah
    Calgary, CA

  • Trainer: Pavan

    It was a well-planned Azure data engineering class with, a detailed teaching style, and responds to student's questions in and outside of class. Planning on taking additional courses available.
    Firehiwot Abera
    Downingtown, US

  • Trainer: Pavan

    Pavan’s knowledge of Azure and Azure Data Engineering was very good. He explained the topical very clearly. Overall the class was excellent! Thank you
    Mamta Kumari
    Miami, US

  • Trainer: Pavan

    Thank you very much Pavan! I really enjoyed your data engineering classes. Thank you for sharing the material as well; I will watch some of the videos again so I can pause and follow the steps.
    Nigus Tafere
    Downingtown, US

  • Trainer: Pavan Kumar

    Thank you Pavan for this great Azure Data Engineering training.
    Arati Rajbhandari
    Rosenberg, US

  • Trainer: Pavan

    The training was very detailed and well structured, focusing on Microsoft Azure DP-203 certification. Pavan, an experienced trainer, maintained a nice flow from beginning to end. He answered all the questions raised by the participants and explained in detail, showing the relevant scenario in the lab. Overall, it was a great learning experience toward the goal.
    Rajavardhan Reddy Nagolu
    Charlotte, US

  • Trainer: Pavan

    Great course . Pavan covered all Azure Data Engineering topics in detail.
    Ravi Pinnamneni
    Fishers, US

  • Trainer: Pavan Kumar

    The course was very informative and Pavan was very clear and helpful throughout the course.
    Edgar J Ogutu
    Irving, US

  • Trainer: Pavan

    I am very happy that I trusted Daniel and Attended this class. I have experience teaching, and I can understand how a trainer should be. Pavan is an excellent trainer, and he is knowledgeable and credible. He teaches honestly and always tries to teach students everything he knows. It was a great time; I appreciate Pavan and Daniel offering data engineering training.
    Mahjube Jamiul Ahmadi
    San Diego, US

  • Trainer: Pavan

    The class was great! A lot of real-time environment demos were taught in class. Pavan was great in providing all the required materials for understanding the concepts well. Finally, it was a great learning opportunity, and I would like to thank Daniel for being very supportive and for good organizing this training session.
    Nihal Komirelli
    Boston, US

  • Trainer: Pavan Kumar

    Pavan - It's an excellent course, and thank you for being a great teacher... you are a very knowledgeable person and willing to share. I came new to the data world, and I am proud to say that I feel confident to continue the journey... all because of hands holding from you. It was a pleasure interacting with you, and God bless you !! Daniel - I have attended many online courses in the past from another institute, but I find you run it professionally and set the bar very high. Very happy and impressed with the higher level of professionalism. Good luck. Nice knowing the two of you.... Cheers.
    Sripathi Sankaranarayanan
    Montréal, CA

  • Trainer: Pavan Kumar

    Throughout the entire course, it was a really wonderful experience. Pavan is a fantastic teacher who is extremely knowledgeable about everything a data engineer should know. He properly examined every topic and provided relevant examples. When I had questions, I could easily email him, and he always responded right away. We appreciate you sharing your expertise with us. I wish you luck in the future.
    Anshul Sahu
    Atlanta, US

  • Trainer: Pavan

    Trainer has good knowledge of Azure and Data Engineering. He also has excellent teaching skills.
    Lakshmi Venkatesh
    Middlesbrough, GB

Empire Data Systems

Social Links