StationX
Start free

Browse › Azure Data Storage Monitor and Optimize

Can You Optimize a Batch Processing Solution by Using Azure Data Factory and Azure Data Lake?

Expert

Part of Azure Data Storage Monitor and Optimize Topic: Azure

Access

StationX Infrastructure Labs — 3 attempts per lab

🔒 Add StationX Infrastructure Labs — $149 / year · 3 attempts per lab

Already have access? Sign in.

New to this? Try a free practice lab — a scripted hacking challenge in your browser, no account needed.

What you'll do

In this challenge, you will optimize a batch processing solution by using Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.

  1. Create a storage account that uses a Data Lake Storage hierarchical namespace
  2. Design a batch processing solution
  3. Run a performance benchmark to optimize and ingest data for a data lake by using the AzCopy utility
  4. Deploy an Azure data factory that contains a data pipeline to transform data into a blob data file
  5. Create a data pipeline in Azure Synapse Studio to populate a new, dedicated SQL pool
  6. Create a data pipeline to run a performance benchmark by using a data factory

Note: Once you begin the lab, you will not be able to pause, save, or return to your lab. Please ensure that you have set aside enough time to complete the lab before you start.

  • ⏱ About 60 minutes