Learn various tool for big data analysis on cloud
What you will learn
You could create a Crawler using AWS Glue for creating a dataset and find its schema
You could perform data analysis on a dataset by running SQL queries in AWS Athena
In this course we would explore various Big Data Analytics services available on Microsoft Azure cloud.
You would learn HDInsight, and Streaming Analysis on Microsoft Azure
Description
In this course you will learn about various cloud services on AWS and Microsoft Azure that can be used for simple Data Analytics and Big Data Analytics. You can choose a combination of cloud resources and methods that can be integrated together to build a solution and various use cases. This course begins with lessons on Amazon Glue that is widely used by developers to build a crawler that can span through a variety of data sources and fetch some useful data from them and store those information in Amazon Athena as datasets. Later on, we can perform various types of operations and run SQL queries on Athena just any other database for finding useful insights from dataset. Moreover, you can also prepare a dataset by transforming it using SQL.
On AWS, you will learn about-
- Create a S3 bucket and add dataset
- Create a Crawler using AWS Glue
- Configuring output database name for crawler
- Customize Schema, find table details in Glue and Log groups in Cloud
- Run SQL Queries on Athena and store output in S3 bucket
- Create and Save Custom Query in AWS Athena
After covering AWS Glue, S3 and Athena, you would learn about various Data Analysis services on Microsoft Azure. You will learn with hands-on practical lessons first on Azure HDInsight followed by Streaming Analysis.
On Microsoft Azure, you will learn about-
- Stream Analytics
- HDInsight
Content