Programming Study日本語

Disclosure: We earn a commission from Udemy when you buy a course through links on this page.

DP-750: Implementing Data Engineering using Azure Databricks

DP-750: Implementing Data Engineering using Azure Databricks

Udemy · English

About this course

Language
English
Category
Provider
Udemy
Data updated

The Exam DP-750: Implementing Data Engineering Solutions Using Azure Databricks study guide is designed to help data engineers develop the knowledge and practical skills required to design, implement, secure, deploy, monitor, and optimize data engineering solutions using Azure Databricks. The guide aligns with the skills measured in the Microsoft DP-750 exam and focuses on the technologies, capabilities, and implementation decisions required when working with production data engineering workloads. The study guide begins with setting up and configuring an Azure Databricks environment, including selecting and configuring appropriate compute resources such as job compute, serverless compute, warehouses, classic compute, and shared compute. It also covers compute performance, Photon acceleration, Azure Databricks Runtime and Apache Spark versions, libraries, permissions, and the creation and organization of Unity Catalog objects such as catalogs, schemas, volumes, tables, views, materialized views, and foreign catalogs. The guide then addresses securing and governing Unity Catalog objects, including privileges for users, service principals, and groups, table and column-level access control, row-level security, Azure Key Vault secrets, managed identities, service principals, attribute-based access control (ABAC), row filters and column masks, data retention, data lineage, audit logging and secure Delta Sharing strategies.A substantial portion focuses on preparing and processing data. Learners explore data modeling, ingestion strategies, batch and streaming workloads, table formats such as Delta, Parquet, CSV, JSON, and Iceberg, partitioning, slowly changing dimensions, temporal tables, managed and external tables, and clustering strategies such as liquid clustering and Z-ordering. The guide also covers ingestion through Lakeflow Connect, notebooks, SQL, change data capture (CDC), Spark Structured Streaming, Azure Event Hubs, and Lakeflow Spark Declarative Pipelines with Auto Loader. Data cleansin…

Courses in the same category