Azure Databricks platform to run large data engineering workloads in the cloud

What you will learn

You will learn how to build a real world data project using Azure Databricks and Spark Core.

You will learn how to transform and analyse data using Spark SQL in Azure Databricks

You will learn how to create Azure Data Factory pipelines to execute Databricks notebooks

You will acquire professional level data engineering skills in Azure Databricks, Delta Lake, Spark Core, Azure Data Lake Gen2 and Azure Data Factory (ADF)

Description

In this course, you will learn how to harness the power of Apache Spark and powerful clusters running on the Azure Databricks platform to run large data engineering workloads in the cloud.

You will discover the capabilities of Azure Databricks and the Apache Spark notebook for processing huge files. You will come to understand the Azure Databricks platform and identify the types of tasks well-suited for Apache Spark. You will also be introduced to the architecture of an Azure Databricks Spark Cluster and Spark Jobs. You will work with large amounts of data from multiple sources in different raw formats. you will learn how Azure Databricks supports day-to-day data-handling functions, such as reads, writes, and queries. This course is part of a Specialization intended for Data engineers and developers who want to demonstrate their expertise in designing and implementing data solutions that use Microsoft Azure data services for anyone interested in preparing for the Exam DP-203: Data Engineering on Microsoft Azure . You will take a practice exam that covers key skills measured by the certification exam. This is the eighth course in a program of 10 courses to help prepare you to take the exam so that you can have expertise in designing and implementing data solutions that use Microsoft Azure data services. The Data Engineering on Microsoft Azure exam is an opportunity to prove knowledge expertise in integrating, transforming, and consolidating data from various structured and unstructured data systems into structures that are suitable for building analytics solutions that use Microsoft Azure data services. Each course teaches you the concepts and skills that are measured by the exam.

Intended Audience

  • IT professionals who want to become Azure Data Engineer

Requirements


Get Instant Notification of New Courses on our Telegram channel.


  • All the code and step-by-step instructions are provided, but the skills below will greatly benefit your journey
  • Knowledge of cloud fundamentals will be beneficial, but not necessary
  • Azure subscription will be required, If you don’t have one we will create a free account in the course

Intended Audience

  • IT professionals who want to become Azure Data Engineer
  • IT professionals preparing for Microsoft’s DP-203 exam

Prerequisites

General knowledge of IT architecture

If you are confused somewhere or need expert guidance then Do Not Worry Our Experienced Mentors are just a call away.

English
language

Content

Module-1 Azure Databricks

Introduction of the course
Understanding Azure Databricks
Spark Basics
Azure databricks workspace
Running notebooks with spark transformation
Accessing BLOB data in ADB notebooks
Sample notebooks
6 Integrating ADF with ADB notebooks using job clusters