DP-203: DP-203 Data Engineering on Microsoft Azure

DP-203 Data Engineering on Microsoft Azure. 

Das Training DP-203 Data Engineering auf Microsoft Azure über ein spezielles Zertifizierungspaket. 1 Jahr Zugriff auf revolutionäres E-Learning, um die Prüfung einfach zu bestehen. Holen Sie sich eine Einführung in das Lernen über 1 Lernportal (LMS) mit zertifizierten Lehrern. Exklusiver 24/7-Online-Mentor und herausfordernde Kurstests sowie alle Tipps und Tricks hinter den Kulissen.

Sobald Sie Daten gespeichert haben, müssen Sie über einen Mechanismus verfügen, um die Daten in ein verwendbares Format zu konvertieren. Azure Data Factory ist ein Datenintegrationsdienst zum Erstellen automatisierter Datenpipelines, die zum Kopieren und Transformieren von Daten verwendet werden können. In diesem Kurs lernen Sie die Azure Data Factory und die Integration Runtime kennen. Sie werden die Funktionen der Azure Data Factory erkunden, z. B. verknüpfte Dienste und Datasets, Pipelines und Aktivitäten sowie Trigger. Schließlich erfahren Sie, wie Sie eine Azure Data Factory mithilfe des Azure-Portals erstellen, Azure Data Factory-verknüpfte Dienste und Datasets erstellen, Azure Data Factory-Pipelines und -Aktivitäten erstellen und die Pipeline manuell oder durch Planung aktivieren. Dieser Kurs gehört zu einer Sammlung, die Studenten auf die Prüfung „Microsoft Data Engineering on Microsoft Azure (DP-203)“ vorbereitet.

Kursinhalt

DP-203 - Data Engineering on Microsoft Azure: Storage Accounts

Course: 1 Hour, 12 Minutes

• Course Overview
• Azure Blob Storage
• Blob Storage Performance and Scalability
• Azure Storage Geo-redundancy
• Storage Account Disaster Recovery
• Azure Data Lake Storage Gen
• Big Data Processing with Data Lake
• Planning a Data Lake
• Data Lake Storage Best Practices
• Creating a Data Lake Gen2 Account
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Designing Data Storage Structures

Course: 1 Hour, 9 Minutes

• Course Overview
• Designing a Data Lake
• Big Data File Type Planning
• Big Data File Formats
• Designing Table Storage for Querying
• Dynamic Data Pruning
• Designing a Folder Structure
• Data Lake Zones
• Storage Archiving Tier
• Data Archiving, Rehydrating, and Life Cycle Management
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Data Partitioning

Course: 1 Hour, 3 Minutes

• Course Overview
• Partitioning Data
• Data Partitioning Strategies
• Transactional and Analytical Workloads
• File Partition Strategies
• Partitioning Strategies for Table Storage
• Designing for Efficiency and Performance
• Partitioning Azure Synapse Analytics Dedicated Pools
• Partitioning Data Lakes
• Data Sharding for Scaling
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Designing the Serving Layer

Course: 1 Hour, 13 Minutes

• Course Overview
• Dimensional Modeling
• Dimensional Hierarchies
• Slowly Changing Dimensions
• Temporal Design
• Star and Snowflake Schemas
• Designing a Star Schema
• Implementing Incremental Data Loading
• Choosing an Analytical Data Store
• Metastore Design
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Physical Data Storage Structures

Course: 1 Hour, 5 Minutes

• Course Overview
• Data Compression
• Partitioning Data
• Sharding Data
• Designing Tables
• Ensuring Database Data Redundancy
• File and Blob Data Redundancy
• Implementing Distribution Schemes
• Implementing Data Archiving
• Configuring Database Long-term Retention
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Logical Data Structures

Course: 1 Hour, 32 Minutes

• Course Overview
• Data Lake Maturity
• Temporal Database Tables
• Managing Temporal Tables
• Slowly Changing Dimensions
• Building a Slowly Changing Dimension Type
• Building a Slowly Changing Dimension Type
• Folder Structures
• Using External Tables
• Accelerating Queries
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: The Serving Layer

Course: 1 Hour, 5 Minutes

• Course Overview
• Relational and Star Schemas
• Designing a Star Schema Database
• Parquet Files
• Dimensional Hierarchies
• Deploying Azure Synapse Analytics
• Deploying Azure Synapse Analytics Dedicated SQL Pools
• Deploying Azure Synapse Analytics Apache Spark Clusters
• Shared Metadata Tables
• Implementing Shared Metadata Tables
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Data Policies & Standards

Course: 1 Hour, 7 Minutes

• Course Overview
• Azure Key Vault
• Private and Service Endpoints
• Using Managed Virtual Networks and Private Endpoints
• Azure Managed Identities
• Managing Access Control Lists
• Using Azure Role-based Access Control
• Azure Databricks Token-based Authentication
• Implement Azure Databricks Token Authentication
• Managing Temporal Table Retention Policies
• Auditing on an Azure SQL Database
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Securing Data Access

Course: 1 Hour, 7 Minutes

• Course Overview
• Azure Key Vault
• Private and Service Endpoints
• Using Managed Virtual Networks and Private Endpoints
• Azure Managed Identities
• Managing Access Control Lists
• Using Azure Role-based Access Control
• Azure Databricks Token-based Authentication
• Implement Azure Databricks Token Authentication
• Managing Temporal Table Retention Policies
• Auditing on an Azure SQL Database
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Securing Data

Course: 1 Hour, 22 Minutes

• Course Overview
• Azure Data Encryption
• Managing Transparent Data Encryption
• Database Encryption
• Implementing Always Encrypted
• Encrypting Database Columns
• Applying Row-level Security
• Working with DataFrames
• Securing Azure Database Data
• Utilizing Immutable Blobs
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Data Lake Storage

Course: 1 Hour, 48 Minutes

• Course Overview
• Azure Data Lake Storage Gen
• Creating a Data Lake Storage Gen2 Storage Account
• Managing Azure Data Lake Storage Gen
• Extracting Data from Azure Data Lake Storage Gen
• Transforming Data Using Apache Spark
• Transforming Data Using Data Factory
• Transforming Azure Synapse Pipelines
• Streaming Data to Azure Databricks
• Transforming Data with Databricks
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Data Flow Transformations

Course: 1 Hour, 24 Minutes

• Course Overview
• Azure Data Flow Transformations
• Using Azure Data Mapping Data Flows
• Performing an Azure Data Flow Conditional Split
• Using Azure Data Flow Conditional Flatten
• Azure Data Flow Expression Functions
• Configuring Azure Data Flow Error Handling
• Transforming Azure Data Flow Derived Columns
• Transforming Data Using Azure Spark and Scala
• Handling Duplicate Data in Azure Data Flows
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Data Factory

Course: 2 Hours, 24 Minutes

• Course Overview
• Azure Data Factory Triggers
• Creating an Azure Data Factory
• Handling Schema Drift in Data Flow
• Creating Data Factory Pipelines
• Creating Data Factory Triggers
• Optimizing Pipelines in the Data Factory Pipeline
• Utilizing Upsert with Azure SQL
• Troubleshooting in Azure Stream Analytics
• Designing and Implementing Incremental Data Loads
• Designing and Developing Slowly Changing Dimensions
• Securing Data in Azure Data Factory
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Databricks

Course: 1 Hour, 3 Minutes

• Course Overview
• Partitioning Data
• Data Partitioning Strategies
• Transactional and Analytical Workloads
• File Partition Strategies
• Partitioning Strategies for Table Storage
• Designing for Efficiency and Performance
• Partitioning Azure Synapse Analytics Dedicated Pools
• Partitioning Data Lakes
• Data Sharding for Scaling
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Databrick Processing

Course: 1 Hour, 50 Minutes

• Course Overview
• Azure Databricks Processing
• Creating an Azure Databricks Workspace
• Running Azure Databricks Workspace Jobs
• Querying SQL Server
• Failed Batch Loads
• Implementing Cosmos DB Endpoints
• Extracting, Transforming, and Loading Data
• Performing Sentiment Analysis
• Debugging Spark Job
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Stream Analytics

Course: 1 Hour, 12 Minutes

• Course Overview
• Azure Stream Analytics
• Azure Stream Analytics Inputs
• Azure Stream Analytics Outputs
• Azure Stream Analytics User-defined Functions
• Processing Data by Using Spark Structured Streaming
• Stream Analytics Windowing Functions
• Setting Up and Processing Time Series Data
• Creating a Stream Analytics Job
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Synapse Analytics

Course: 46 Minutes

• Course Overview
• Azure Synapse Analytics
• Integrating With Pipelines
• Visualizing Data Using Power BI
• Monitoring a Synapse Workspace
• Exploring the Synapse Knowledge Center
• Azure Synapse Analytics and PolyBase
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Data Storage Monitoring

Course: 58 Minutes

• Course Overview
• Azure Data Storage Monitoring
• Monitoring Azure Blob Storage
• Monitoring Data Lake Storage Gen
• Monitoring Azure Synapse Analytics
• Monitoring Cosmos DB
• Configuring Azure Monitoring Alerts
• Azure Log Analytics
• Configuring Azure Log Analytics
• Monitoring Azure Stream Analytics
• Azure Cosmos DB Indexing
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Data Process Monitoring

Course: 1 Hour, 31 Minutes

• Course Overview
• Azure Monitor
• Creating Azure Monitor Metrics
• Analyzing Azure Resource Logs
• Querying Azure Monitor Logs
• Creating Log Analytics Dashboards
• Azure HDInsight
• Monitoring Data Factory Pipelines
• Monitoring and Tuning Query Performance
• Monitoring Azure Log Analytics
• Azure Data Factory Version Control
• Azure Monitor Cluster Monitoring
• Azure Monitor Custom Logging
• Azure Monitor Logic App
• Course Summary

DP-203 - Data Engineering on Microsoft Azure: Data Solution Optimization

Course: 58 Minutes

• Course Overview
• Azure Data Solution Optimization
• Azure Stream Analytics Optimization
• Data Partitioning Strategies
• Azure Data Lake Storage Gen2 Optimization
• Azure Synapse Analytics Optimization
• Azure Cosmos DB Optimization
• Azure Databricks Monitoring
• Azure Databricks Optimization
• Azure Data Troubleshooting
• Course Summary