Implementing Azure big data analytics requires managing the Data Factory, loading and transforming data. This course covers monitoring the Azure Data Factory and troubleshooting problems as well as loading and transforming data.
Learning Objectives
Managing a Data Factory
- start the course
- launch and navigate the Monitoring and Management app
- navigate the Resource Explorer tab
- create alerts to get notified of errors
- rerun selected activities and pause or resume multiple pipelines
- navigate the Diagram View
Troubleshooting Problems
- identify potential errors and solutions with Data Factory
- recognize common problems with installation and registration and possible solutions
- recognize common problems with limited functionality and possible solutions
- recognize other possible problems and solutions
Data Activities and Procedures
- use Azure Data Factory Copy Wizard
- recognize steps to load big data from Azure Blob Storage into Azure SQL Data Warehouse
- recognize steps to copy data from on-premise to a cloud storage and from one cloud storage to another
- recognize methods for data transformation and prerequisites
- transform data with a pipeline using Visual Studio
- use Hive Activity to transform data
- use Pig Activity to transform data
- use MapReduce Activity
- recognize how to use stored procedure activities
- recognize how to create custom activities
Practice: Monitor and Troubleshoot
- monitor and identify common problems and recognize their solutions