Tag: Microsoft Fabric

DP-700, Microsoft Certification, Microsoft Fabric June 3, 2026

Configure OneLake workspace settings (DP-700 Exam Prep)

This post is a part of the DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric Exam Prep Hub.
This topic falls under these sections:
Implement and manage an analytics solution (30–35%)
   --> Configure Microsoft Fabric workspace settings
      --> Configure OneLake workspace settings

Note that there are 10 practice questions (with answers) at the end of each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available from the hub's main page below the exam topics section.

Introduction

OneLake is one of the foundational components of Microsoft Fabric and is frequently tested on the DP-700 exam. Understanding how OneLake workspace settings are configured and managed is important for Data Engineers because these settings affect data accessibility, governance, security, data sharing, and storage management across Fabric workloads.

Microsoft Fabric was designed around the concept of a single, unified data lake for the entire organization. Rather than having separate storage accounts for different services, OneLake provides a centralized storage layer that serves all Fabric workloads, including:

Data Engineering
Data Factory
Data Warehouse
Data Science
Real-Time Intelligence
Power BI

For the DP-700 exam, you should understand how OneLake workspace settings influence data access, shortcuts, security, governance, and workspace-level administration.

What Is OneLake?

OneLake is Microsoft’s unified, logical data lake for Fabric.

It provides:

A single storage layer for all Fabric workloads
Centralized data management
Open storage formats
Elimination of data silos
Simplified data sharing

Every Fabric tenant automatically receives OneLake.

Every Fabric workspace automatically uses OneLake storage.

Unlike traditional Azure architectures where multiple storage accounts may exist, OneLake presents a unified storage experience across the organization.

OneLake Architecture

A useful way to think about OneLake is:

			
Tenant
│
├── OneLake
│
├── Workspace A
│   ├── Lakehouse
│   ├── Warehouse
│   └── Data Pipelines
│
├── Workspace B
│   ├── Lakehouse
│   ├── Notebooks
│   └── Reports
│
└── Workspace C
    ├── Warehouse
    └── Real-Time Analytics

		

All data ultimately resides within OneLake.

Workspaces act as organizational containers for Fabric assets.

OneLake Workspace Settings Overview

Workspace administrators can configure several OneLake-related settings.

Common configuration areas include:

OneLake Data Access
Shortcut Management
External Data Connections
Data Sharing
Security and Permissions
Workspace Storage Organization

These settings help control how data is stored, accessed, and shared.

OneLake Security Model

OneLake follows Fabric’s security model.

Security is primarily governed through:

Workspace roles
Item-level permissions
Fabric security groups
Microsoft Entra ID authentication

OneLake does not introduce a separate security model.

Instead, users access data through Fabric permissions.

For example:

Role	Access Level
Admin	Full control
Member	Create and modify content
Contributor	Create and edit content
Viewer	Read-only access

DP-700 Exam Tip

Remember:

OneLake inherits Fabric security.

You do not configure separate OneLake user accounts.

OneLake Shortcuts

One of the most important OneLake workspace settings involves Shortcuts.

Shortcuts allow users to reference data without physically copying it.

Supported sources include:

Another OneLake location
Azure Data Lake Storage Gen2
Amazon S3
Dataverse
External cloud storage platforms

Why Shortcuts Matter

Traditional approach:

			
Source Data
     ↓
Copy
     ↓
Fabric Storage

		

OneLake Shortcut approach:

			
Source Data
     ↓
Shortcut
     ↓
Fabric Access

		

Benefits:

No data duplication
Reduced storage costs
Faster implementation
Single source of truth

This is one of the most heavily tested OneLake topics on the DP-700 exam.

Managing Shortcut Settings

Workspace administrators may configure:

Who can create shortcuts
Which data sources can be referenced
Governance policies for shortcut usage

Proper shortcut management helps prevent:

Uncontrolled data sprawl
Duplicate data sources
Governance violations

OneLake Data Hub Integration

OneLake works closely with the Data Hub.

The Data Hub allows users to discover:

Lakehouses
Warehouses
Semantic models
Shared datasets
Data products

Workspace settings help determine what content becomes discoverable within the organization.

Benefits include:

Improved discoverability
Increased data reuse
Better governance

External Data Access

OneLake can connect to external storage systems.

Common scenarios include:

Azure Data Lake Storage Gen2

Organizations often maintain existing ADLS environments.

OneLake shortcuts allow Fabric to access those files without migration.

Benefits:

Reduced migration effort
Faster Fabric adoption
Single source of truth

Amazon S3

Organizations with multi-cloud environments can create shortcuts to S3 storage.

Benefits:

Avoid duplicate storage
Support hybrid cloud architectures
Simplify analytics workloads

Dataverse

Shortcuts can also reference Dataverse data, making operational business data available within Fabric analytics solutions.

OneLake Data Sharing

OneLake supports organizational data sharing.

Users can share:

Lakehouses
Warehouses
Data products
Semantic models

Workspace administrators control sharing capabilities through workspace permissions.

Benefits include:

Increased collaboration
Improved data reuse
Reduced duplication

OneLake and Lakehouses

OneLake is particularly important when working with Lakehouses.

Each Lakehouse stores:

Tables
Files
Delta tables

within OneLake storage.

Example:

			
Workspace
│
└── Lakehouse
    ├── Tables
    └── Files

		

Physical storage resides in OneLake while Fabric provides the management layer.

OneLake and Data Warehouses

Fabric Warehouses also store their data in OneLake.

Benefits include:

Unified storage architecture
Shared governance
Consistent security

Unlike traditional architectures, lakehouse and warehouse data coexist within the same underlying storage platform.

OneLake File Explorer

Organizations can enable OneLake File Explorer for Windows.

This allows users to:

Browse OneLake folders
Access files
Upload content
Work with familiar file system interfaces

OneLake File Explorer uses organizational authentication and honors Fabric security settings.

While configuration is generally performed at the tenant level, understanding its relationship to OneLake is useful for the exam.

OneLake Governance Considerations

Good governance practices include:

Minimize Data Duplication

Use shortcuts whenever possible instead of copying data.

Implement Clear Workspace Ownership

Each workspace should have:

Administrators
Data Owners
Data Stewards

Standardize Naming Conventions

Consistent naming improves discoverability and governance.

Control Shortcut Creation

Allowing unrestricted shortcut creation can create governance challenges.

Organizations should establish policies regarding:

Approved data sources
Ownership requirements
Data quality standards

OneLake Workspace Best Practices

Use Shortcuts Instead of Copies

Prefer shortcuts whenever source systems can remain accessible.

Align Workspaces with Business Domains

Organize workspaces around:

Finance
Sales
Operations
Human Resources

Apply Least-Privilege Access

Grant only the permissions required for users to perform their work.

Promote Reusable Data Assets

Encourage sharing of trusted data products.

Monitor External Data Dependencies

Document all shortcut sources to avoid broken dependencies.

DP-700 Exam Focus Areas

You should be comfortable with:

✓ OneLake architecture

✓ OneLake security model

✓ Workspace-level data access

✓ OneLake shortcuts

✓ External storage integration

✓ Data sharing

✓ Lakehouse storage in OneLake

✓ Warehouse storage in OneLake

✓ Data Hub integration

✓ Governance best practices

Common Exam Scenario

A company stores sales data in Azure Data Lake Storage Gen2 and wants Fabric users to analyze the data without copying it into OneLake.

What should they do?

Answer: Create a OneLake Shortcut to the ADLS Gen2 data.

This scenario appears frequently because Microsoft emphasizes eliminating unnecessary data movement.

10 DP-700 Practice Questions

Question 1

What is the primary purpose of OneLake in Microsoft Fabric?

A. Host Power BI reports

B. Execute Spark workloads

C. Manage workspace permissions

D. Provide a unified storage layer for Fabric workloads

Answer: D

Explanation

OneLake serves as the unified data lake for all Fabric workloads and is the foundational storage layer of the platform.

Incorrect Answers:

B: Spark workloads run on Spark compute resources.
C: Permissions are managed through Fabric security roles.
D: Reports are stored as Fabric items, not hosted by OneLake itself.

Question 2

Which OneLake feature allows access to external data without copying it into Fabric?

A. Lakehouse Replication

B. Delta Synchronization

C. Shortcut

D. Eventstream

Answer: C

Explanation

Shortcuts create references to external data sources while avoiding physical data duplication.

Question 3

A company wants to access Azure Data Lake Storage Gen2 data from Fabric while maintaining a single source of truth.

Which solution should be implemented?

A. Copy the data nightly

B. Create a OneLake Shortcut

C. Export the data to CSV

D. Load the data into a Warehouse

Answer: B

Explanation

A shortcut provides direct access to ADLS Gen2 data without creating duplicate copies.

Question 4

Which security model does OneLake use?

A. Separate OneLake user accounts

B. Local storage permissions

C. SQL authentication

D. Fabric workspace permissions and Microsoft Entra ID

Answer: D

Explanation

OneLake inherits the Fabric security model and uses Microsoft Entra ID for authentication.

Question 5

Which Fabric item stores its underlying data in OneLake?

A. Notebook

B. Dashboard

C. Lakehouse

D. Capacity

Answer: C

Explanation

Lakehouse data is physically stored within OneLake.

Question 6

What is a major benefit of using OneLake Shortcuts?

A. Increased data duplication

B. Reduced storage requirements

C. Automatic data encryption changes

D. Faster Spark startup times

Answer: B

Explanation

Shortcuts reduce storage consumption because data is referenced rather than copied.

Question 7

Which external data source can be accessed through OneLake Shortcuts?

A. Azure Data Lake Storage Gen2

B. Amazon S3

C. Dataverse

D. All of the above

Answer: D

Explanation

OneLake supports shortcuts to multiple external data sources, including ADLS Gen2, S3, and Dataverse.

Question 8

Which Fabric feature improves discoverability of OneLake data assets across the organization?

A. Spark Pools

B. Data Hub

C. Eventhouse

D. Notebook Scheduler

Answer: B

Explanation

The Data Hub enables users to discover and reuse organizational data assets stored in OneLake.

Question 9

A Fabric administrator wants to follow Microsoft-recommended governance practices.

Which approach is preferred?

A. Copy all source data into every workspace

B. Create duplicate Lakehouses

C. Use shortcuts when possible

D. Disable data sharing

Answer: C

Explanation

Microsoft promotes shortcuts as a way to minimize duplication and maintain a single source of truth.

Question 10

Which statement about OneLake and Fabric Warehouses is correct?

A. Warehouses use separate storage outside OneLake.

B. Warehouses cannot share data with Lakehouses.

C. Warehouses require Azure SQL Database storage.

D. Warehouse data is stored in OneLake.

Answer: D

Explanation

Fabric Warehouses use OneLake as their underlying storage layer, providing a unified architecture alongside Lakehouses.

Exam Tip

For the DP-700 exam, the most important OneLake workspace concepts are Shortcuts, unified storage architecture, governance, and security inheritance. If you encounter a scenario that involves accessing data without moving or duplicating it, the correct solution is often a OneLake Shortcut, making it one of the highest-value concepts to master in this objective area.

Go to the DP-700 Exam Prep Hub main page.

DP-700, Microsoft Certification, Microsoft Fabric June 3, 2026

Configure Dataflows Gen2 workspace settings (DP-700 Exam Prep)

This post is a part of the DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric Exam Prep Hub.
This topic falls under these sections:
Implement and manage an analytics solution (30–35%)
   --> Configure Microsoft Fabric workspace settings
      --> Configure Dataflows Gen2 workspace settings

Note that there are 10 practice questions (with answers) at the end of each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available from the hub's main page below the exam topics section.

Introduction

Dataflows Gen2 are a core component of Microsoft Fabric’s data ingestion and transformation capabilities. They provide a low-code/no-code method for extracting, transforming, and loading (ETL) data into Fabric destinations such as Lakehouses, Warehouses, and other analytics assets.

For the DP-700 exam, it is important to understand not only how to create Dataflows Gen2, but also how workspace settings affect their operation, governance, security, performance, and administration.

Workspace-level settings help administrators establish standards and controls for how Dataflows Gen2 are used within a Fabric environment. Understanding these settings enables data engineers to create scalable, maintainable, and governed data integration solutions.

What Are Dataflows Gen2?

Dataflows Gen2 are cloud-based data transformation solutions built on Power Query technology.

They allow users to:

Connect to data sources
Clean and transform data
Combine multiple datasets
Perform data quality operations
Load data into Fabric destinations

Unlike notebooks or Spark jobs that require coding skills, Dataflows Gen2 provide a graphical interface for data preparation.

Common use cases include:

Data ingestion
Data cleansing
Dimension table creation
Data enrichment
ETL and ELT workflows
Self-service data preparation

Dataflows Gen2 Architecture

A typical Dataflow Gen2 process consists of:

			
Data Source
     ↓
Power Query Transformations
     ↓
Dataflow Gen2
     ↓
Destination

		

Possible destinations include:

Lakehouse Tables
Warehouse Tables
Azure SQL Database
Other supported Fabric destinations

Why Workspace Settings Matter

In small environments, Dataflows Gen2 can be managed individually.

However, in enterprise environments, administrators need centralized control over:

Dataflow creation
Dataflow execution
Compute usage
Security
Data destinations
Governance

Workspace settings help establish consistent behavior across all Dataflows Gen2 within a workspace.

Dataflows Gen2 Workspace Administration

Workspace administrators control who can:

Create Dataflows Gen2
Modify Dataflows Gen2
Schedule refreshes
Access source data
Access destinations

These permissions are governed through Fabric workspace roles.

Workspace Role	Dataflow Capability
Admin	Full control
Member	Create and manage
Contributor	Create and edit
Viewer	Read-only

DP-700 Exam Tip

Remember that Dataflows Gen2 do not have a separate security model.

They inherit Fabric workspace permissions.

Configure Dataflow Creation Permissions

Organizations often restrict who can create Dataflows Gen2.

Reasons include:

Governance requirements
Cost management
Data quality controls
Standardization

A common enterprise pattern is:

Contributors create Dataflows
Members manage Dataflows
Admins govern Dataflows

This prevents uncontrolled proliferation of ETL processes.

Configure Data Destinations

One of the most important Dataflows Gen2 settings involves destination configuration.

Supported destinations include:

Lakehouse

The most common destination.

Benefits:

Delta table storage
Integration with Spark
Medallion architecture support

Common usage:

Bronze layer ingestion
Silver layer transformation

Warehouse

Dataflows can load directly into Fabric Warehouses.

Benefits:

Structured analytics
SQL querying
Dimensional modeling support

Multiple Destinations

Dataflows Gen2 support loading data into multiple destinations from a single transformation pipeline.

Benefits include:

Reduced duplication of transformation logic
Improved maintainability
Consistent outputs

Configure Refresh Settings

Refresh configuration is one of the most frequently tested Dataflow topics.

Refresh settings determine:

When Dataflows execute
How often they run
How data is updated

Options include:

Manual Refresh

Execution occurs only when initiated by a user.

Best for:

Testing
Development
Small workloads

Scheduled Refresh

Execution occurs automatically based on a defined schedule.

Examples:

Hourly
Daily
Weekly

Most production Dataflows use scheduled refresh.

Pipeline-Orchestrated Refresh

Dataflows can be executed through Fabric Data Factory pipelines.

Benefits:

End-to-end orchestration
Dependency management
Complex workflow support

This is commonly used in enterprise ETL solutions.

Refresh Failure Notifications

Administrators can configure monitoring and notifications for refresh failures.

Benefits:

Faster troubleshooting
Improved reliability
Reduced downtime

Monitoring is particularly important when Dataflows support business-critical reporting systems.

Configure Data Source Credentials

Dataflows require access credentials for source systems.

Supported authentication methods vary by connector and may include:

Organizational account
OAuth
Basic authentication
Service principals
API keys

Workspace administrators often establish governance policies around credential management.

Best Practice

Use service accounts or service principals whenever possible for production workloads.

This avoids refresh failures caused by employee account changes.

Configure Gateway Usage

Some data sources reside inside private corporate networks.

Examples:

On-premises SQL Server
Oracle databases
File shares

In these scenarios, Dataflows Gen2 may require an On-Premises Data Gateway.

Gateway settings determine:

Connectivity
Authentication
Data access paths

A common DP-700 scenario involves selecting a gateway for on-premises data access.

Dataflow Compute and Performance Considerations

Dataflows Gen2 execute within Fabric-managed infrastructure.

Administrators should understand factors that impact performance:

Data Volume

Larger datasets increase:

Refresh duration
Resource consumption

Transformation Complexity

Operations such as:

Merges
Joins
Group By
Aggregations

increase processing requirements.

Number of Refreshes

Frequent refresh schedules can consume additional capacity resources.

Administrators should balance:

Data freshness
Capacity utilization

Dataflow Lineage and Impact Analysis

Fabric automatically captures lineage information.

Administrators can view:

			
Source
 ↓
Dataflow Gen2
 ↓
Lakehouse
 ↓
Semantic Model
 ↓
Report

		

Benefits include:

Impact analysis
Dependency tracking
Governance visibility

Lineage is an important governance feature frequently associated with Dataflows.

Dataflow Monitoring

Workspace administrators can monitor:

Refresh history
Success rates
Failure messages
Duration metrics

Monitoring tools include:

Refresh history
Monitoring Hub
Fabric capacity metrics

Common Troubleshooting Areas

Credential failures
Gateway connectivity issues
Schema changes
Destination write failures
Capacity limitations

Dataflow Governance Best Practices

Standardize Naming Conventions

Example:

			
DF_Bronze_Customer_Ingestion
DF_Silver_Sales_Transform
DF_Gold_Product_Aggregation

Consistent naming improves maintainability.

Use Scheduled Refresh Sparingly

Avoid unnecessary refresh frequency.

Example:

Do not refresh every 15 minutes if daily updates are sufficient.

Implement Service Principals

Reduce dependency on individual user accounts.

Leverage Lineage Views

Monitor downstream dependencies before making changes.

Align with Medallion Architecture

Use Dataflows strategically within:

Bronze Layer
Silver Layer
Gold Layer

Common DP-700 Exam Scenarios

Scenario 1

A Dataflow must load data from an on-premises SQL Server.

Solution:

Configure an On-Premises Data Gateway.

Scenario 2

A Dataflow should execute only after a source ingestion process completes.

Solution:

Use a Data Factory pipeline to orchestrate execution.

Scenario 3

A Dataflow should load transformed data into a Lakehouse for downstream Spark processing.

Solution:

Configure the Lakehouse as the destination.

DP-700 Exam Focus Areas

You should understand:

✓ Dataflows Gen2 architecture

✓ Workspace permissions

✓ Dataflow creation governance

✓ Data destinations

✓ Refresh scheduling

✓ Pipeline orchestration

✓ Credential management

✓ Gateway configuration

✓ Monitoring and troubleshooting

✓ Lineage and impact analysis

✓ Performance considerations

10 Practice Exam Questions

Question 1

Which technology provides the transformation engine used by Dataflows Gen2?

A. Power Query

B. Apache Spark

C. Kusto Query Language (KQL)

D. T-SQL

Answer: A

Explanation

Dataflows Gen2 use Power Query as their transformation engine, providing a low-code interface for data preparation.

Question 2

A Dataflow Gen2 needs to access an on-premises SQL Server database.

What must be configured?

A. Eventstream

B. Data Activator

C. On-Premises Data Gateway

D. OneLake Shortcut

Answer: C

Explanation

An On-Premises Data Gateway enables Fabric services to securely access data sources located inside private networks.

Question 3

Which destination is most commonly used for storing Dataflow Gen2 outputs within a medallion architecture?

A. Semantic Model

B. Dashboard

C. Notebook

D. Lakehouse

Answer: D

Explanation

Lakehouses are commonly used as Bronze, Silver, and Gold layers within Fabric medallion architectures.

Question 4

What is the primary advantage of scheduled refresh?

A. Eliminates authentication requirements

B. Automatically updates data without manual intervention

C. Increases storage capacity

D. Creates backup copies of source systems

Answer: B

Explanation

Scheduled refresh ensures that data remains current without requiring users to manually run the Dataflow.

Question 5

Which Fabric feature can orchestrate Dataflow Gen2 execution as part of a larger workflow?

A. Data Factory Pipeline

B. Lakehouse Explorer

C. Monitoring Hub

D. OneLake File Explorer

Answer: A

Explanation

Data Factory pipelines provide orchestration, dependency management, and scheduling capabilities.

Question 6

What information can lineage views provide?

A. Network bandwidth consumption

B. Spark executor utilization

C. Upstream and downstream dependencies

D. Gateway installation logs

Answer: C

Explanation

Lineage views show how data moves between sources, Dataflows, Lakehouses, semantic models, and reports.

Question 7

Which workspace role has full administrative control over Dataflows Gen2?

A. Viewer

B. Contributor

C. Member

D. Admin

Answer: D

Explanation

Workspace Admins have complete control over all workspace items, including Dataflows Gen2.

Question 8

A company wants to minimize production refresh failures caused by employee account changes.

What is the recommended approach?

A. Increase refresh frequency

B. Use service principals or service accounts

C. Disable scheduled refresh

D. Use Viewer permissions

Answer: B

Explanation

Service principals provide stable authentication that is not tied to individual users.

Question 9

Which factor is most likely to increase Dataflow refresh duration?

A. Smaller datasets

B. Reduced transformations

C. Complex joins and aggregations

D. Fewer destination tables

Answer: C

Explanation

Complex transformation logic increases processing requirements and refresh times.

Question 10

What is the primary purpose of Dataflow monitoring?

A. Create semantic models

B. Manage workspace domains

C. Configure Spark runtimes

D. Identify refresh failures and performance issues

Answer: D

Explanation

Monitoring helps administrators detect failures, troubleshoot issues, and optimize performance.

Final Exam Tip

For DP-700, Dataflows Gen2 questions typically focus on data ingestion, destinations, refresh management, gateways, orchestration, and governance. When evaluating exam scenarios, remember that Dataflows Gen2 are designed to provide a low-code ETL experience using Power Query, while Fabric Pipelines provide orchestration and Lakehouses commonly serve as the destination within modern medallion architectures.

Go to the DP-700 Exam Prep Hub main page.

DP-700, Microsoft Certification, Microsoft Fabric June 3, 2026

Configure domain workspace settings (DP-700 Exam Prep)

This post is a part of the DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric Exam Prep Hub. 
This topic falls under these sections:
Implement and manage an analytics solution (30–35%)
   --> Configure Microsoft Fabric workspace settings
      --> Configure domain workspace settings

Note that there are 10 practice questions (with answers) at the end of each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available from the hub's main page below the exam topics section.

Introduction

As Microsoft Fabric deployments grow, organizations often need a way to organize workspaces, data products, users, and governance policies across departments, business units, or functional areas. Microsoft Fabric addresses this challenge through Domains.

For the DP-700 exam, you should understand how domains are used to organize Fabric environments and how domain workspace settings help administrators manage governance, ownership, discoverability, and collaboration across multiple workspaces.

While domain administration is often associated with governance and data management, it is also relevant to Data Engineers because domain settings influence workspace organization, ownership, data sharing, and the overall analytics architecture.

What Are Domains in Microsoft Fabric?

A Domain is a logical organizational structure within Microsoft Fabric that groups related workspaces together.

Domains allow organizations to organize Fabric assets according to business functions such as:

Finance
Human Resources
Sales
Marketing
Manufacturing
Data Engineering
Data Science

Rather than managing hundreds of workspaces individually, administrators can organize them into domains and apply governance structures more effectively.

For example:

			
Corporate Domain
│
├── Finance Workspace
├── Budgeting Workspace
├── Forecasting Workspace
│
Sales Domain
│
├── CRM Workspace
├── Sales Analytics Workspace
├── Territory Planning Workspace

		

Domains improve discoverability and help users locate relevant data products and workspaces more efficiently.

Why Domains Matter

Large organizations often encounter challenges such as:

Too many workspaces
Duplicate datasets
Inconsistent governance
Difficulty locating data assets
Poor ownership visibility

Domains help address these issues by:

Creating organizational structure
Establishing ownership boundaries
Improving data discovery
Supporting data governance initiatives
Promoting reuse of trusted data products

For the DP-700 exam, understand that domains are primarily a governance and organizational feature rather than a security feature.

Domain Roles and Responsibilities

Several administrative roles interact with domains.

Fabric Administrator

Fabric Administrators can:

Create domains
Configure domain settings
Assign domain administrators
Manage tenant-wide domain governance

Fabric Administrators have the highest level of control over domain management.

Domain Administrator

Domain Administrators manage specific domains.

Responsibilities include:

Managing domain settings
Assigning workspaces
Managing subdomains
Maintaining governance standards
Curating domain content

A Domain Administrator’s authority is limited to the domain they manage.

Workspace Administrators

Workspace Administrators continue to manage individual workspaces but may be subject to governance standards established within the domain.

Workspace Administrators do not automatically become Domain Administrators.

Domain Workspace Assignment

One of the most important domain settings is workspace assignment.

Administrators can assign workspaces to:

Domains
Subdomains

Examples:

Workspace	Domain
Sales Analytics	Sales
CRM Reporting	Sales
HR Workforce Planning	Human Resources
Payroll Analytics	Human Resources

This allows related analytics assets to be grouped logically.

Subdomains

Domains can contain subdomains.

For example:

			
Sales Domain
│
├── North America Sales
├── Europe Sales
├── Asia Pacific Sales

		

Benefits include:

Better scalability
Improved organization
Delegated administration
Granular governance

Subdomains are particularly useful in large enterprises.

Domain Workspace Settings

Domain workspace settings control how workspaces interact with the domain structure.

Key configuration areas include:

Workspace Association

Administrators determine:

Which workspaces belong to a domain
Whether workspaces can be moved
Who can assign workspaces

Proper workspace association ensures that content remains organized.

Workspace Inheritance

Certain governance policies can be inherited from the domain level.

Examples include:

Organizational standards
Data governance requirements
Certification processes

This helps ensure consistency across multiple workspaces.

Ownership and Stewardship

Domain settings help establish:

Business ownership
Data ownership
Stewardship responsibilities

Users can quickly identify:

Who owns a data product
Who maintains it
Who to contact regarding issues

This improves accountability and trust.

Domain-Level Discoverability

One major purpose of domains is improving discoverability.

Users can browse content by domain and find:

Reports
Semantic models
Lakehouses
Warehouses
Notebooks
Pipelines
Data products

Without domains, locating the correct assets becomes difficult in large environments.

For exam purposes, remember:

Domains improve discoverability and organization.

Domain Certification and Endorsement

Domains work closely with Fabric’s data governance capabilities.

Organizations can promote trusted content through:

Certified Content

Certified content has undergone formal review and approval.

Examples:

Certified semantic models
Certified reports
Certified data products

Users can have greater confidence in certified assets.

Promoted Content

Promoted content is recommended for organizational use but may not have completed formal certification.

Promoted content serves as an intermediate trust level.

Delegated Governance

One major benefit of domains is delegated governance.

Without domains:

Central administrators manage everything.

With domains:

Governance responsibilities can be distributed.
Business units can manage their own content.
Ownership becomes more scalable.

Example:

Finance can manage Finance assets.

Sales can manage Sales assets.

HR can manage HR assets.

This reduces administrative bottlenecks.

Domain Data Mesh Alignment

Microsoft Fabric domains align closely with Data Mesh principles.

Data Mesh encourages:

Domain-oriented ownership
Self-service analytics
Distributed governance
Data as a product

Fabric domains provide the organizational structure needed to support these concepts.

For DP-700, you should recognize that domains are frequently used in Data Mesh architectures.

Domain Workspace Governance Best Practices

Use Domains Based on Business Functions

Good examples:

Finance
Marketing
Operations
Human Resources

Avoid:

Random workspace groupings
Temporary project structures

Assign Clear Ownership

Every domain should have:

Domain Administrators
Data Owners
Data Stewards

Clear ownership improves governance.

Use Subdomains Carefully

Subdomains should be used when:

Organizational complexity requires them
Multiple business units exist

Avoid excessive nesting.

Promote Discoverability

Use:

Endorsements
Certification
Consistent naming conventions

This makes domain content easier to find.

Align Domains with Governance Policies

Domains should support:

Data quality initiatives
Compliance requirements
Security standards
Organizational ownership

DP-700 Exam Focus Areas

You should be comfortable with:

✓ Purpose of domains

✓ Domain Administrators

✓ Workspace assignment to domains

✓ Subdomains

✓ Content discoverability

✓ Domain ownership

✓ Governance delegation

✓ Certification and endorsement

✓ Data Mesh alignment

✓ Domain-based organization strategies

Common Exam Scenario

A company has 300 Fabric workspaces spread across:

Finance
Sales
Human Resources
Operations

Users complain that they cannot easily find trusted datasets and reports.

Management wants each department to manage its own analytics assets while maintaining governance.

The best solution would be to:

Create domains for each department.
Assign workspaces to appropriate domains.
Designate Domain Administrators.
Use certification and endorsement for trusted assets.

10 DP-700 Practice Questions

Question 1

What is the primary purpose of a Microsoft Fabric domain?

A. Increase Spark performance

B. Organize related workspaces and assets

C. Create backup copies of data

D. Encrypt workspace content

Answer: B

Explanation

Domains are used to logically organize workspaces and assets according to business functions or organizational structures.

Why not the others?

A: Domains do not affect Spark performance.
C: Domains are not backup mechanisms.
D: Domains do not provide encryption services.

Question 2

Who can create and manage domains across a Fabric tenant?

A. Workspace Contributor

B. Workspace Viewer

C. Fabric Administrator

D. Data Analyst

Answer: C

Explanation

Fabric Administrators have tenant-wide authority to create domains and assign Domain Administrators.

Why not the others?

A and B: Workspace roles cannot create domains.
D: Analyst roles do not include administrative privileges.

Question 3

What is a subdomain?

A. A secondary capacity

B. A child organizational structure within a domain

C. A backup workspace

D. A separate tenant

Answer: B

Explanation

Subdomains allow further organization beneath a parent domain, supporting scalability and delegated governance.

Question 4

A company wants Sales and Finance departments to independently manage their own analytics assets.

Which Fabric feature best supports this requirement?

A. Spark Pools

B. Eventstreams

C. Warehouses

D. Domains

Answer: D

Explanation

Domains enable delegated governance and ownership, allowing departments to manage their own content.

Question 5

Which benefit is most directly associated with domains?

A. Improved data discoverability

B. Faster notebook execution

C. Reduced storage costs

D. Automatic backup creation

Answer: A

Explanation

Domains help users locate trusted analytics assets more efficiently by organizing content logically.

Question 6

What can be assigned to a domain?

A. Only reports

B. Only semantic models

C. Workspaces

D. Only Lakehouses

Answer: C

Explanation

Domains organize workspaces, and those workspaces contain reports, semantic models, lakehouses, warehouses, and other Fabric items.

Question 7

Which concept is most closely aligned with Microsoft Fabric domains?

A. Row-level security

B. Dynamic executor allocation

C. Data Mesh

D. Delta Lake

Answer: C

Explanation

Domains support Data Mesh principles by enabling domain-oriented ownership and distributed governance.

Question 8

A Fabric administrator wants users to identify trusted organizational datasets.

Which capability should be used alongside domains?

A. Spark Runtime Configuration

B. Workspace Capacity Scaling

C. Autoscale

D. Certification and Endorsement

Answer: D

Explanation

Certification and endorsement help users identify trusted and approved data assets within domains.

Question 9

Which statement about Domain Administrators is correct?

A. They manage all Fabric tenants.

B. They manage a specific domain and its settings.

C. They automatically become Workspace Administrators.

D. They manage capacity SKUs.

Answer: B

Explanation

Domain Administrators manage domain-specific governance, settings, and organization but do not control the entire tenant.

Question 10

A company has hundreds of Fabric workspaces and wants to improve governance without centralizing all administration.

What should they implement?

A. Domains with delegated administration

B. Additional Spark pools

C. More capacities

D. Larger warehouses

Answer: A

Explanation

Domains allow governance responsibilities to be distributed while maintaining organizational standards and discoverability.

Exam Tip

For DP-700, remember that domains are an organizational and governance feature, not a performance or security feature. Most exam questions focus on how domains help structure workspaces, improve discoverability, support Data Mesh architectures, and enable delegated governance across large Microsoft Fabric environments.

Go to the DP-700 Exam Prep Hub main page.

DP-700, Python, SQL June 3, 2026

Transform data by using PySpark, SQL, and KQL (DP-700 Exam Prep)

This post is a part of the DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric Exam Prep Hub.
This topic falls under these sections:
Ingest and transform data (30–35%)
   --> Ingest and transform batch data
      --> Transform data by using PySpark, SQL, and KQL

Note that there are 10 practice questions (with answers) at the end of each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available from the hub's main page below the exam topics section.

Introduction

One of the most important skills for the DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric certification exam is knowing how to transform data using the appropriate technology. Microsoft Fabric provides multiple transformation engines, each optimized for specific workloads:

PySpark for large-scale distributed data engineering and advanced transformations
SQL for relational data manipulation, warehousing, and analytics
KQL (Kusto Query Language) for high-volume log, telemetry, event, and time-series data analysis

A successful Fabric Data Engineer must understand not only how each technology works, but also when to choose one over another.

Understanding the Transformation Options in Microsoft Fabric

Microsoft Fabric supports several data processing experiences:

Technology	Primary Use Case	Common Fabric Components
PySpark	Big data processing and engineering	Lakehouse, Notebooks
SQL	Relational transformations and analytics	Warehouse, SQL Endpoint
KQL	Streaming, telemetry, logs, event analytics	Eventhouse, Real-Time Intelligence

While all three can transform data, they are designed for different scenarios.

Transforming Data with PySpark

What is PySpark?

PySpark is the Python API for Apache Spark.

Spark is a distributed processing engine that allows data engineers to process extremely large datasets across multiple nodes simultaneously.

Within Microsoft Fabric, PySpark is typically used in:

Notebooks
Lakehouses
Spark Job Definitions

When to Use PySpark

PySpark is ideal when:

Working with large-scale datasets
Performing complex transformations
Processing semi-structured data
Building data engineering pipelines
Performing machine learning preparation
Handling Delta Lake tables

Examples include:

Cleaning raw data
Parsing JSON files
Aggregating billions of records
Creating dimensional model tables
Performing data quality checks

Reading Data with PySpark

Example:

df = spark.read.format("delta").load("Tables/Sales")

Filtering Data

filtered_df = df.filter(df.Amount > 1000)

Creating New Columns

			
from pyspark.sql.functions import col
new_df = df.withColumn(
    "TaxAmount",
    col("Amount") * 0.07
)

		

Aggregating Data

			
from pyspark.sql.functions import sum
summary_df = (
    df.groupBy("Region")
      .agg(sum("Amount").alias("TotalSales"))
)

		

Writing Results

summary_df.write.mode("overwrite").saveAsTable("SalesSummary")

PySpark Advantages

Scalability

Handles terabytes and petabytes of data.

Distributed Processing

Automatically parallelizes workloads.

Flexibility

Supports:

Structured data
Semi-structured data
Unstructured data

Data Engineering Focus

Excellent for ETL and ELT processes.

PySpark Limitations

More complex than SQL
Requires programming skills
Less familiar to business analysts
Higher resource consumption for small workloads

Transforming Data with SQL

What is SQL in Fabric?

SQL remains one of the most commonly used languages in Fabric.

You can use SQL within:

Fabric Data Warehouse
Lakehouse SQL Endpoint
SQL Query Editor
Stored Procedures
Data Pipelines

When to Use SQL

SQL is ideal for:

Relational transformations
Data warehouse development
Reporting datasets
Aggregations
Joins
Dimensional modeling

Examples:

Creating fact tables
Loading dimensions
Building reporting views
Data validation

Filtering Records

			
SELECT *
FROM Sales
WHERE Amount > 1000;

Aggregations

			
SELECT
    Region,
    SUM(Amount) AS TotalSales
FROM Sales
GROUP BY Region;

		

Joining Tables

			
SELECT
    s.SaleID,
    c.CustomerName
FROM Sales s
INNER JOIN Customer c
    ON s.CustomerID = c.CustomerID;

		

Creating Transformation Tables

			
CREATE TABLE SalesSummary AS
SELECT
    Region,
    SUM(Amount) AS TotalSales
FROM Sales
GROUP BY Region;

		

SQL Advantages

Familiarity

Most data professionals know SQL.

Readability

Easy to understand and maintain.

Relational Optimization

Optimized for joins and aggregations.

Warehousing Support

Ideal for star schemas and dimensional models.

SQL Limitations

Less effective for complex data engineering workflows
Not ideal for large-scale semi-structured data processing
Limited flexibility compared to PySpark

Transforming Data with KQL

What is KQL?

Kusto Query Language (KQL) is a read-optimized query language designed for:

Telemetry
Log analytics
Event processing
Streaming data
Time-series analysis

KQL is commonly used in:

Eventhouse
Real-Time Intelligence
KQL Databases

When to Use KQL

Use KQL when working with:

Sensor data
IoT events
Application logs
Security monitoring
Streaming datasets
Time-series analytics

Examples:

Monitoring manufacturing equipment
Detecting anomalies
Security event analysis
Operational dashboards

Filtering Data

			
Events
| where Temperature > 100

Summarization

			
Events
| summarize AvgTemp = avg(Temperature)
    by DeviceID

Time-Series Analysis

			
Events
| summarize Count=count()
    by bin(Timestamp, 1h)

Detecting Trends

			
Events
| make-series AvgTemp=avg(Temperature)
    on Timestamp
    step 1h

KQL Advantages

High Performance

Optimized for large event datasets.

Time-Series Analytics

Excellent for temporal analysis.

Streaming Support

Designed for real-time workloads.

Fast Query Execution

Ideal for operational dashboards.

KQL Limitations

Not intended for traditional data warehousing
Less suitable for dimensional modeling
Not commonly used for batch ETL

Comparing PySpark, SQL, and KQL

Requirement	Best Choice
Large-scale ETL	PySpark
Data warehouse transformations	SQL
Star schema creation	SQL
Streaming analytics	KQL
Time-series analysis	KQL
Semi-structured JSON processing	PySpark
Machine learning preparation	PySpark
Business reporting datasets	SQL
Eventhouse analytics	KQL
Massive Delta Lake processing	PySpark

Choosing the Right Transformation Tool

Choose PySpark When

Processing very large datasets
Working with Data Lake data
Building engineering pipelines
Handling JSON or Parquet files
Performing advanced transformations

Choose SQL When

Building warehouses
Creating dimensional models
Developing reporting datasets
Performing relational transformations
Creating views and stored procedures

Choose KQL When

Working with event streams
Analyzing telemetry
Investigating logs
Performing time-series analysis
Monitoring operational systems

Exam Tips

Know the Primary Use Cases

A common DP-700 exam question asks which technology is most appropriate for a scenario.

Remember:

PySpark = Big Data Engineering
SQL = Relational Analytics and Warehousing
KQL = Real-Time and Time-Series Analytics

Understand Fabric Components

Know where each technology is primarily used:

Technology	Fabric Experience
PySpark	Lakehouse, Notebook
SQL	Warehouse, SQL Endpoint
KQL	Eventhouse

Focus on Scenario-Based Questions

The exam frequently describes a business requirement and asks which technology should be used.

For example:

IoT sensors → KQL
Warehouse dimension tables → SQL
Processing billions of JSON records → PySpark

Practice Exam Questions

Question 1

A data engineer must transform 20 TB of semi-structured JSON data stored in OneLake. Which technology is the best choice?

A. SQL

B. PySpark

C. KQL

D. Power Query

Answer: B

Explanation: PySpark is designed for distributed processing of massive datasets and handles semi-structured formats such as JSON efficiently.

Question 2

A Fabric solution requires creation of a star schema consisting of fact and dimension tables. Which technology is most appropriate?

A. SQL

B. KQL

C. Power BI DAX

D. Data Activator

Answer: A

Explanation: SQL is optimized for relational transformations and dimensional modeling commonly used in data warehouses.

Question 3

A company wants to analyze millions of IoT events arriving continuously from factory equipment. Which technology should be used?

A. KQL

B. Power Query

C. SQL

D. Excel

Answer: A

Explanation: KQL is designed specifically for high-volume event, telemetry, and time-series analysis workloads.

Question 4

Which Fabric component is most closely associated with KQL transformations?

A. Warehouse

B. Notebook

C. SQL Endpoint

D. Eventhouse

Answer: D

Explanation: Eventhouse is the primary Fabric experience for KQL-based analytics and real-time intelligence workloads.

Question 5

A data engineer needs to process Delta Lake tables using distributed compute. Which technology should be selected?

A. KQL

B. SQL

C. PySpark

D. Power BI

Answer: C

Explanation: PySpark integrates directly with Delta Lake and supports scalable distributed processing.

Question 6

Which language is specifically optimized for time-series analysis?

A. SQL

B. KQL

C. Python

D. DAX

Answer: B

Explanation: KQL includes built-in capabilities for temporal aggregation, anomaly detection, and time-series analytics.

Question 7

A Fabric Warehouse team needs to build a reusable transformation layer consisting of joins, aggregations, and views. Which technology should they use?

A. SQL

B. KQL

C. Dataflows Gen2

D. Spark ML

Answer: A

Explanation: SQL is the preferred language for relational transformations and warehouse development.

Question 8

Which technology is generally the best choice for preparing large datasets for machine learning?

A. KQL

B. SQL

C. DAX

D. PySpark

Answer: D

Explanation: PySpark provides scalable data preparation capabilities and integrates well with machine learning workflows.

Question 9

An engineer needs to summarize application log events by hour and identify usage trends. Which technology is most appropriate?

A. PySpark

B. Power Query

C. KQL

D. SQL

Answer: C

Explanation: KQL excels at log analytics, event monitoring, and time-based aggregations.

Question 10

A team needs a transformation language that is familiar to most database developers and optimized for relational joins. Which should they choose?

A. PySpark

B. KQL

C. Power Query

D. SQL

Answer: D

Explanation: SQL remains the standard language for relational querying, joins, aggregations, and warehouse transformations.

Go to the DP-700 Exam Prep Hub main page.

DP-700, Microsoft Certification, Microsoft Fabric June 3, 2026

Ingest data by using pipelines (DP-700 Exam Prep)

This post is a part of the DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric Exam Prep Hub.
This topic falls under these sections:
Ingest and transform data (30–35%)
   --> Ingest and transform batch data
      --> Ingest data by using pipelines

Note that there are 10 practice questions (with answers) at the end of each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available from the hub's main page below the exam topics section.

Introduction

Microsoft Fabric Data Pipelines are one of the primary tools used by data engineers to ingest, move, and orchestrate data across various sources and destinations. Pipelines provide a low-code orchestration framework that allows organizations to build scalable, repeatable, and maintainable data ingestion solutions.

For the DP-700 exam, it is important to understand:

What pipelines are
Pipeline architecture and components
Common ingestion patterns
Copy Data activity
Data source and destination connectivity
Pipeline orchestration
Parameters and dynamic content
Scheduling and triggering
Monitoring and troubleshooting
Best practices for pipeline-based ingestion

What Is a Microsoft Fabric Data Pipeline?

A Data Pipeline is a workflow orchestration service within Microsoft Fabric that enables data engineers to:

Move data between systems
Schedule data ingestion
Execute transformation activities
Coordinate multiple processes
Automate data workflows

Pipelines are derived from the same core concepts used in Azure Data Factory and Azure Synapse Analytics, making them familiar to many data professionals.

A pipeline is essentially a container that holds one or more activities that execute in a defined sequence.

Why Use Pipelines for Data Ingestion?

Organizations often need to ingest data from:

SQL Server
Azure SQL Database
Azure Blob Storage
Amazon S3
REST APIs
CSV files
Excel files
On-premises systems
Data warehouses
SaaS applications

Pipelines provide a centralized and scalable way to move this data into Fabric.

Benefits include:

Automation

No manual intervention required once configured.

Scalability

Handles large volumes of data efficiently.

Reusability

Pipelines can be reused across multiple ingestion scenarios.

Monitoring

Built-in execution tracking and logging.

Integration

Works with many Fabric workloads and external systems.

Pipeline Architecture

A pipeline consists of several components:

Pipeline

The overall workflow container.

Activities

Tasks performed within the pipeline.

Examples:

Copy Data
Notebook execution
Stored procedure execution
Dataflow execution
Variable assignment

Datasets

Represent source or destination data structures.

Connections

Define how the pipeline connects to external systems.

Parameters

Provide runtime flexibility.

Triggers

Determine when pipelines execute.

Common Pipeline Activities

For DP-700, understanding activities is essential.

Copy Data Activity

The most commonly used ingestion activity.

Used to:

Copy files
Move tables
Transfer structured data
Load data into Fabric destinations

Examples:

SQL Server → Lakehouse
Azure SQL → Warehouse
CSV → OneLake
Blob Storage → Lakehouse

Notebook Activity

Executes Spark notebooks.

Common uses:

Data transformation
Data cleansing
Machine learning processing

Dataflow Activity

Runs Dataflow Gen2 processes.

Used when:

Low-code transformations are preferred
Business users participate in data preparation

Stored Procedure Activity

Executes SQL stored procedures.

Useful for:

Database maintenance
Incremental processing
Metadata updates

Using the Copy Data Activity

The Copy Data activity is heavily emphasized on the DP-700 exam.

Source

Defines where data originates.

Examples:

SQL Database
Oracle
REST API
CSV File
Blob Storage

Destination

Defines where data is written.

Examples:

Lakehouse
Data Warehouse
OneLake files
SQL endpoint

Mapping

Maps source columns to destination columns.

Example:

Source	Destination
CustomerID	CustomerKey
Name	CustomerName
City	CustomerCity

Data Sources Supported by Pipelines

Fabric pipelines support numerous source systems.

Common examples include:

Relational Databases

SQL Server
Azure SQL Database
Oracle
PostgreSQL
MySQL

File-Based Sources

CSV
JSON
Parquet
Excel

Cloud Storage

Azure Blob Storage
Azure Data Lake Storage
Amazon S3

Web-Based Sources

REST APIs
HTTP endpoints

Pipeline Destinations

Common destinations include:

Lakehouse

Frequently used for raw and curated data storage.

Benefits:

Delta format
Open storage
Spark compatibility

Data Warehouse

Ideal for structured analytical workloads.

Benefits:

SQL support
Relational design
High-performance reporting

OneLake Files

Used for raw file storage.

Batch Data Ingestion Patterns

The DP-700 exam focuses heavily on batch ingestion.

Full Load Pattern

Every execution loads the entire dataset.

Example:

Daily import of a 5,000-row lookup table.

Advantages:

Simple implementation

Disadvantages:

Higher processing costs
Longer runtimes

Incremental Load Pattern

Only new or changed records are loaded.

Example:

Import orders created since the last execution.

Advantages:

Faster
Lower costs
Reduced data movement

Disadvantages:

More complex configuration

Parameterized Pipelines

Parameters make pipelines reusable.

Example parameter:

SourceTable

Pipeline executions can specify:

			
Customers
Orders
Products
Invoices

This allows one pipeline design to ingest many tables.

Benefits:

Reduced development effort
Easier maintenance
Consistent ingestion processes

Dynamic Content

Dynamic expressions enable runtime flexibility.

Examples:

Generate file names:

Sales_@{utcnow()}.csv

Generate folders:

Raw/@{formatDateTime(utcnow(),'yyyy/MM/dd')}

Use parameter values:

@pipeline().parameters.TableName

Dynamic content is commonly tested on DP-700.

Control Flow Activities

Pipelines can include logic and branching.

If Condition

Executes different paths depending on conditions.

Example:

File exists → Continue
File missing → Send notification

Switch Activity

Handles multiple execution paths.

Example:

Process data differently based on source type.

ForEach Activity

Loops through collections.

Example:

Load 100 source tables using one pipeline.

Until Activity

Repeats execution until a condition becomes true.

Scheduling Pipelines

Pipelines commonly run on schedules.

Examples:

Hourly
Daily
Weekly
Monthly

Typical workloads:

Workload	Schedule
Sales Data	Hourly
ERP Data	Daily
Financial Data	Nightly
Master Data	Weekly

Event-Based Triggers

Instead of schedules, pipelines can run when events occur.

Examples:

New file arrives
Data source updated
Upstream process completed

Benefits:

Reduced latency
Faster processing
More responsive architecture

Monitoring Pipeline Executions

Fabric provides execution monitoring.

Data engineers can review:

Run Status

Succeeded
Failed
In Progress
Cancelled

Duration

How long execution required.

Activity-Level Results

Identify which step failed.

Error Messages

Useful for troubleshooting.

Common issues include:

Authentication failures
Missing files
Schema mismatches
Permission problems

Error Handling

Reliable ingestion solutions require proper error handling.

Common approaches:

Retry Policies

Automatically rerun failed activities.

Logging

Record execution details.

Validation

Check data quality before loading.

Notifications

Alert administrators when failures occur.

Security Considerations

Pipeline ingestion must follow security best practices.

Secure Credentials

Use managed identities and secure connections whenever possible.

Least Privilege

Grant only required permissions.

Workspace Security

Control who can modify pipelines.

Data Governance

Apply sensitivity labels and auditing where appropriate.

Pipeline Best Practices

Use Parameterization

Avoid hardcoding values.

Build Reusable Components

Create generic ingestion pipelines.

Use Incremental Loads

When possible, reduce data movement.

Monitor Executions

Review failures proactively.

Implement Error Handling

Design for operational resilience.

Separate Environments

Maintain Dev, Test, and Production pipelines.

Pipeline vs Dataflow Gen2 vs Notebook

Understanding when to use each tool is a common exam objective.

Feature	Pipeline	Dataflow Gen2	Notebook
Orchestration	Excellent	Limited	Limited
Data Movement	Excellent	Good	Good
Low-Code	Yes	Yes	No
Spark Processing	No	No	Yes
Complex Programming	No	No	Yes
Scheduling	Excellent	Good	Good

Use Pipelines When:

Moving data between systems
Orchestrating workflows
Scheduling processes
Managing dependencies

Use Dataflow Gen2 When:

Low-code transformations are required

Use Notebooks When:

Spark processing is needed
Custom Python or Scala logic is required

DP-700 Exam Tips

Remember these key points:

✓ Pipelines are primarily orchestration and data movement tools.

✓ The Copy Data activity is the most common ingestion activity.

✓ Pipelines support both scheduled and event-based execution.

✓ Parameters and dynamic expressions improve reusability.

✓ Incremental loads are preferred for large datasets.

✓ Pipelines can execute notebooks and dataflows.

✓ Monitoring and troubleshooting pipeline runs are important operational responsibilities.

✓ Control flow activities such as ForEach and If Condition are frequently used in enterprise solutions.

✓ Pipelines are generally the preferred Fabric tool for orchestrating end-to-end ingestion workflows.

Practice Exam Questions

Question 1

A data engineer needs to copy data nightly from Azure SQL Database into a Fabric Lakehouse. Which Fabric component is most appropriate?

A. Semantic Model
B. Data Pipeline
C. Dashboard
D. KQL Queryset

Correct Answer: B

Explanation:
Data Pipelines are designed for orchestrating and executing data movement activities such as copying data from Azure SQL Database into a Lakehouse.

Question 2

Which pipeline activity is primarily used to move data from a source system to a destination?

A. Notebook Activity
B. Copy Data Activity
C. If Condition Activity
D. Switch Activity

Correct Answer: B

Explanation:
The Copy Data activity is specifically designed for ingesting and transferring data between sources and destinations.

Question 3

A company wants a pipeline to process 50 tables using a single reusable workflow. Which feature should be implemented?

A. Data Warehouse
B. OneLake Shortcut
C. Parameters
D. Mirroring

Correct Answer: C

Explanation:
Parameters allow a pipeline to accept table names and other runtime values, making the solution reusable.

Question 4

Which control flow activity is used to repeatedly process a collection of items?

A. ForEach
B. Wait
C. Lookup
D. If Condition

Correct Answer: A

Explanation:
The ForEach activity iterates through collections and executes activities for each item.

Question 5

A data engineer wants a pipeline to run automatically every night at midnight. What should be configured?

A. Sensitivity Label
B. Scheduled Trigger
C. Dataflow Refresh Policy
D. Lakehouse Shortcut

Correct Answer: B

Explanation:
Scheduled triggers are used to execute pipelines at predefined times.

Question 6

Which Fabric destination is most commonly used for storing raw and curated Delta tables?

A. Lakehouse
B. Dashboard
C. Workspace Role
D. Semantic Model

Correct Answer: A

Explanation:
Lakehouses provide Delta Lake storage and are commonly used as ingestion targets.

Question 7

A pipeline should execute only when a new file arrives in storage. What should be used?

A. Manual Execution
B. Incremental Refresh
C. Event-Based Trigger
D. Full Load

Correct Answer: C

Explanation:
Event-based triggers allow pipelines to start when specific events occur, such as file creation.

Question 8

Which statement about incremental loading is correct?

A. It reloads all records every execution.
B. It loads only new or changed records.
C. It requires deleting the destination table first.
D. It cannot be implemented in pipelines.

Correct Answer: B

Explanation:
Incremental loading minimizes processing by transferring only new or modified data.

Question 9

A data engineer needs to execute custom PySpark transformation logic as part of a pipeline. Which activity should be used?

A. Copy Data Activity
B. If Condition Activity
C. Stored Procedure Activity
D. Notebook Activity

Correct Answer: D

Explanation:
Notebook activities allow execution of Spark notebooks containing custom Python, Scala, SQL, or Spark code.

Question 10

A pipeline execution fails due to a temporary network interruption. Which design practice can help improve reliability?

A. Use dashboard subscriptions
B. Apply endorsement labels
C. Configure retry policies
D. Disable monitoring

Correct Answer: C

Explanation:
Retry policies automatically reattempt failed activities and are a key best practice for building resilient ingestion pipelines.

Go to the DP-700 Exam Prep Hub main page.

DP-700, Microsoft Certification, Microsoft Fabric June 3, 2026

Implement mirroring (DP-700 Exam Prep)

This post is a part of the DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric Exam Prep Hub.
This topic falls under these sections:
Ingest and transform data (30–35%)
   --> Ingest and transform batch data
      --> Implement mirroring

Note that there are 10 practice questions (with answers) at the end of each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available from the hub's main page below the exam topics section.

Introduction

One of the most important capabilities in Microsoft Fabric for modern data engineering is Mirroring. Mirroring enables organizations to continuously replicate data from operational databases and external data platforms into Microsoft Fabric with minimal configuration and without requiring complex ETL pipelines.

For the DP-700 exam, you should understand:

What Mirroring is
When to use Mirroring
Supported source systems
How Mirroring works
Mirroring architecture and components
Benefits and limitations
Security considerations
Differences between Mirroring and other ingestion methods
Monitoring and managing mirrored databases

What Is Mirroring?

Mirroring is a Microsoft Fabric capability that continuously replicates data from supported source systems into OneLake.

Unlike traditional batch ingestion approaches, Mirroring provides near real-time synchronization of source data changes into Fabric.

The primary goal is to simplify operational analytics by allowing organizations to:

Keep transactional systems as the system of record
Replicate data into Fabric automatically
Analyze data using Fabric workloads without building custom ingestion pipelines

Think of Mirroring as:

“Continuously copying operational database changes into Fabric while keeping the source database independent.”

Why Use Mirroring?

Traditionally, moving data into an analytics platform requires:

ETL pipelines
Dataflows
Custom code
Scheduling
Change Data Capture (CDC) implementation
Ongoing maintenance

Mirroring removes much of this complexity.

Benefits include:

Reduced Data Movement Complexity

No need to create:

Copy activities
Incremental load logic
Watermark tracking
Custom CDC solutions

Near Real-Time Analytics

Changes made in source databases are replicated continuously.

Faster Time to Value

Data engineers can begin analyzing data almost immediately.

Centralized Data Access

Mirrored data becomes available within:

OneLake
Lakehouses
Warehouses
Notebooks
Power BI
SQL Analytics Endpoints

Mirroring Architecture

A typical architecture consists of:

Source System

Examples:

Azure SQL Database
Azure SQL Managed Instance
SQL Server
Azure Cosmos DB
Snowflake
Other supported sources

↓

Change Tracking / CDC

Fabric captures changes from the source.

↓

Mirroring Service

Fabric continuously reads changes.

↓

OneLake

Data is stored in Delta Parquet format.

↓

Analytics Workloads

Data can be consumed by:

Lakehouses
Data Warehouses
Notebooks
Spark
Power BI
Real-Time Analytics

How Mirroring Works

The process typically follows these stages:

Step 1: Initial Snapshot

Fabric performs an initial load of source tables.

This creates a baseline copy in OneLake.

Step 2: Continuous Change Capture

Fabric captures:

Inserts
Updates
Deletes

from the source system.

Step 3: Synchronization

Changes are continuously applied to the mirrored data.

Step 4: Analytics

Users query the replicated data without impacting operational systems.

Mirrored Databases

When mirroring is configured, Fabric creates a:

Mirrored Database

This is a Fabric item that represents the source system.

The mirrored database:

Stores replicated tables
Maintains synchronization metadata
Tracks replication status
Exposes data to Fabric workloads

A mirrored database is not simply a copy of files.

It is a managed Fabric object that continuously synchronizes with the source.

Supported Mirroring Sources

Microsoft continues expanding supported sources.

Examples include:

Azure SQL Database

One of the most common mirroring sources.

Azure SQL Managed Instance

Supports enterprise operational workloads.

SQL Server

Supported in many hybrid scenarios.

Azure Cosmos DB

Supports analytical access to operational NoSQL data.

Snowflake

Allows integration of external cloud data platforms.

Exam Tip: Always verify supported sources based on the latest Microsoft documentation because supported systems continue to expand.

Mirroring vs Dataflows Gen2

A common DP-700 exam objective is choosing the appropriate ingestion method.

Feature	Mirroring	Dataflow Gen2
Continuous synchronization	Yes	No
Data transformation	Limited	Extensive
Low-code experience	Yes	Yes
Incremental changes handled automatically	Yes	Requires configuration
Near real-time updates	Yes	No
ETL processing	Not primary purpose	Primary purpose

Use Mirroring when:

You need operational analytics.
Data should remain synchronized automatically.
Minimal transformation is required.

Use Dataflows Gen2 when:

Complex transformations are required.
Data cleansing is needed.
Business logic must be applied during ingestion.

Mirroring vs Pipelines

Feature	Mirroring	Pipeline
Continuous replication	Yes	No
Orchestration	Limited	Extensive
Scheduling	Automatic	Configurable
Multiple system workflows	No	Yes
Transformation support	Limited	Extensive

Use Mirroring for continuous replication.

Use Pipelines for orchestration and workflow automation.

Mirroring vs Shortcuts

Many exam questions compare Mirroring and OneLake Shortcuts.

OneLake Shortcut

References data in another location
Does not copy data
Virtual access layer

Mirroring

Creates replicated copies
Synchronizes changes
Stores data in OneLake

Capability	Shortcut	Mirroring
Copies data	No	Yes
Continuous synchronization	No	Yes
Storage in OneLake	Referenced	Replicated
Data movement	None	Yes

Security Considerations

Mirroring respects Fabric security controls.

Security areas include:

Source Authentication

Secure connections are required to source systems.

Workspace Permissions

Users need appropriate access to mirrored database items.

OneLake Security

Access controls apply to replicated data.

Sensitivity Labels

Labels can be applied to mirrored data assets.

Auditing

Mirroring activities can be monitored through Fabric auditing and monitoring tools.

Monitoring Mirroring

Data engineers should monitor:

Replication Health

Shows whether synchronization is functioning correctly.

Replication Status

Examples:

Running
Initializing
Warning
Failed

Synchronization Latency

Measures how current the replicated data is compared to the source.

Error Logs

Useful for troubleshooting:

Authentication failures
Network issues
Schema changes
Permission problems

Schema Changes and Mirroring

Source systems often evolve over time.

Examples:

New columns added
Columns removed
Data type modifications
New tables created

Data engineers should understand how schema evolution affects mirrored databases.

Potential actions include:

Refreshing metadata
Revalidating mappings
Reviewing replication health

Exam questions may present scenarios involving schema modifications and synchronization behavior.

Common Mirroring Use Cases

Operational Analytics

Analyze transactional data without impacting production systems.

Example:

Sales application database
Replicated to Fabric
Power BI dashboards updated continuously

Hybrid Analytics

Combine:

SQL Server
Azure SQL
Cosmos DB

into a unified Fabric environment.

Data Modernization

Organizations migrating toward Fabric can begin replicating source systems immediately without redesigning all ETL processes.

Self-Service Analytics

Business users gain access to current data through Fabric and Power BI.

DP-700 Exam Tips

Remember the following:

✓ Mirroring continuously replicates source data into Fabric.

✓ Mirroring reduces the need for custom ETL and CDC implementations.

✓ Mirrored data is stored in OneLake.

✓ Mirrored databases are managed Fabric items.

✓ Mirroring is best for operational analytics and near real-time reporting.

✓ Shortcuts reference data without copying it; Mirroring copies and synchronizes data.

✓ Pipelines orchestrate workflows; Mirroring synchronizes data.

✓ Dataflows Gen2 are designed for transformation and ETL workloads.

✓ Monitor replication health, synchronization status, and latency.

✓ Understand the differences between Mirroring, Pipelines, Dataflows Gen2, and Shortcuts.

Practice Exam Questions

Question 1

A company wants to continuously replicate data from Azure SQL Database into Fabric with minimal engineering effort. Which feature should be used?

A. Dataflow Gen2
B. Mirroring
C. Notebook
D. Warehouse

Correct Answer: B

Explanation:
Mirroring continuously synchronizes data from supported operational systems into Fabric with minimal configuration.

Question 2

Which statement best describes a OneLake shortcut?

A. It creates a replicated copy of data in OneLake.
B. It continuously synchronizes source changes.
C. It provides virtual access to data without copying it.
D. It performs CDC automatically.

Correct Answer: C

Explanation:
Shortcuts provide access to external data without physically copying it into OneLake.

Question 3

A data engineer needs extensive data cleansing and transformation during ingestion. Which option is most appropriate?

A. Dataflow Gen2
B. Mirroring
C. Shortcut
D. Workspace role assignment

Correct Answer: A

Explanation:
Dataflows Gen2 are designed for ETL and transformation scenarios.

Question 4

What is typically performed first when configuring Mirroring?

A. Initial snapshot of source data
B. Continuous CDC synchronization
C. Power BI semantic modeling
D. Delta optimization

Correct Answer: A

Explanation:
Mirroring generally begins with an initial snapshot before applying incremental changes.

Question 5

Which benefit is most directly associated with Mirroring?

A. Eliminates workspace permissions
B. Replaces Power BI semantic models
C. Automatically synchronizes source changes into Fabric
D. Converts all data into KQL format

Correct Answer: C

Explanation:
The primary purpose of Mirroring is continuous synchronization of source data.

Question 6

A Fabric administrator wants to determine whether a mirrored database is successfully synchronizing. Which metric should be reviewed?

A. Semantic model refresh duration
B. Replication health and status
C. Capacity SKU name
D. Workspace description

Correct Answer: B

Explanation:
Replication health and synchronization status indicate whether mirroring is functioning properly.

Question 7

Which Fabric item represents a continuously synchronized copy of a source system?

A. Lakehouse shortcut
B. Notebook
C. Pipeline
D. Mirrored Database

Correct Answer: D

Explanation:
A Mirrored Database is the Fabric item created and maintained by the Mirroring feature.

Question 8

Which scenario is the best fit for Mirroring?

A. Complex multi-step ETL workflow across ten systems
B. Monthly batch processing only
C. Near real-time operational reporting from a transactional database
D. Interactive notebook development

Correct Answer: C

Explanation:
Mirroring excels at near real-time analytics on operational data sources.

Question 9

Which activity is most commonly used to orchestrate multiple workflows and dependencies?

A. Mirroring
B. Sensitivity labels
C. Pipelines
D. OneLake shortcuts

Correct Answer: C

Explanation:
Pipelines are designed for orchestration, dependency management, and workflow automation.

Question 10

A company wants analytics users to query current operational data without directly querying production databases. What is the primary advantage of Mirroring?

A. It replicates data into Fabric for analytical workloads.
B. It encrypts all source databases automatically.
C. It removes the need for OneLake.
D. It replaces Delta Lake storage.

Correct Answer: A

Explanation:
Mirroring creates synchronized copies of operational data inside Fabric, allowing analytical workloads to run without impacting production systems.

Go to the DP-700 Exam Prep Hub main page.

DP-700, Microsoft Certification, Microsoft Fabric, Microsoft OneLake June 3, 2026

Create and manage OneLake shortcuts (DP-700 Exam Prep)

This post is a part of the DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric Exam Prep Hub.
This topic falls under these sections:
Ingest and transform data (30–35%)
   --> Ingest and transform batch data
      --> Create and manage OneLake shortcuts

Note that there are 10 practice questions (with answers) at the end of each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available from the hub's main page below the exam topics section.

Introduction

One of the most powerful features of Microsoft Fabric is the ability to access data without physically copying it. Traditionally, organizations have struggled with data duplication, multiple copies of the same dataset, synchronization challenges, and increased storage costs.

Microsoft Fabric addresses these challenges through OneLake Shortcuts.

A OneLake Shortcut allows users to create a virtual reference to data stored in another location while maintaining a single source of truth. Instead of copying data into a Lakehouse, Fabric can reference external or internal data directly.

For the DP-700 exam, understanding OneLake Shortcuts is critical because they are a foundational component of:

Data virtualization
Data sharing
Multi-team collaboration
Data mesh architectures
Cost optimization
Governance strategies

You should understand:

What shortcuts are
How shortcuts work
Supported shortcut locations
Internal versus external shortcuts
Security implications
Shortcut management
Common use cases
When shortcuts should and should not be used

What Is a OneLake Shortcut?

A OneLake Shortcut is a pointer that provides access to data stored in another location.

Instead of:

			
Source Data
      ↓
Copy Data
      ↓
Destination

		

Fabric can use:

			
Source Data
      ↓
Shortcut
      ↓
Destination Access

		

The data remains in its original location.

No duplicate copy is created.

Why Use Shortcuts?

Organizations frequently encounter problems such as:

Multiple copies of data
Data synchronization issues
Storage costs
Governance challenges
Inconsistent reporting

Without shortcuts:

			
Sales Data
    ↓
Copy #1
Copy #2
Copy #3
Copy #4

		

With shortcuts:

			
Sales Data
    ↓
Single Source
    ↓
Multiple Consumers

		

This dramatically simplifies data management.

OneLake and Shortcuts

OneLake serves as Fabric’s unified storage layer.

Shortcuts extend OneLake by allowing data access across:

Fabric workspaces
Lakehouses
External cloud storage systems

The result is a unified data experience regardless of where the data physically resides.

Internal Shortcuts

What Are Internal Shortcuts?

Internal shortcuts reference data already stored within OneLake.

Examples:

Another Lakehouse
Another Workspace
Another Fabric item

Example:

			
Finance Lakehouse
        ↓
Shortcut
        ↓
Analytics Lakehouse

		

The data remains in the Finance Lakehouse.

Benefits of Internal Shortcuts

No Data Duplication

Only one copy of data exists.

Easier Governance

Single source of truth.

Simplified Maintenance

Updates are immediately available.

Lower Storage Costs

No additional storage consumption.

External Shortcuts

What Are External Shortcuts?

External shortcuts reference data stored outside Fabric.

Supported sources include:

Azure Data Lake Storage Gen2 (ADLS Gen2)
Amazon S3
Other supported external storage locations

Example:

			
ADLS Gen2
     ↓
Shortcut
     ↓
Fabric Lakehouse

		

Again, the data remains in the source system.

Supported Shortcut Locations

Common shortcut targets include:

Source	Supported
OneLake Lakehouse	Yes
OneLake Workspace	Yes
Azure Data Lake Storage Gen2	Yes
Amazon S3	Yes
Fabric Data Hub Sources	Supported Scenarios

The list of supported sources continues to expand as Fabric evolves.

How Shortcuts Work

A shortcut stores metadata that identifies:

Data location
Connection information
Access path

The shortcut itself contains very little data.

Instead, Fabric retrieves data directly from the source location when needed.

Shortcut Creation Process

Typical process:

Open a Lakehouse.
Navigate to Files or Tables.
Select Create Shortcut.
Choose source type.
Specify source location.
Authenticate if required.
Save the shortcut.

The shortcut immediately appears in the Lakehouse.

Shortcut Types in Lakehouses

Shortcuts can be created in:

Files Section

Used for file-based access.

Examples:

CSV files
JSON files
Parquet files

Tables Section

Used when data should be presented as tables.

Examples:

Delta tables
Structured datasets

Security Considerations

Security remains tied to the underlying source.

Important exam concept:

A shortcut does not automatically grant access to the underlying data.

Users must still have appropriate permissions.

Security Model

Example:

			
User
  ↓
Shortcut
  ↓
Source Data

		

Fabric evaluates access permissions before allowing access.

Shortcut Authentication

External shortcuts may require:

Organizational credentials
Managed identities
Service principals
Storage account permissions

Authentication depends on the source system.

Shortcut vs Data Copy

This is one of the most frequently tested concepts.

Shortcut

Data Remains at Source

Characteristics:

No duplication
Lower storage costs
Immediate visibility of updates

Copy Data

Data Replicated

Characteristics:

Separate copy exists
Additional storage consumption
Requires synchronization

Benefits of OneLake Shortcuts

Single Source of Truth

Everyone accesses the same dataset.

Reduced Storage Costs

Data is not duplicated.

Faster Implementation

No lengthy copy operations.

Simplified Governance

Data ownership remains centralized.

Improved Data Sharing

Teams can easily consume shared datasets.

Common Use Cases

Data Mesh Architecture

Different domains own their own data.

Example:

			
Finance Domain
Sales Domain
Marketing Domain

Other teams access data through shortcuts.

Shared Enterprise Data

A central data team maintains curated datasets.

Business units consume data via shortcuts.

External Data Lake Integration

An organization already stores data in ADLS Gen2.

Instead of moving the data:

			
ADLS Gen2
    ↓
Shortcut
    ↓
Fabric

		

Multi-Lakehouse Environments

Multiple Lakehouses access common reference data.

Example:

Customer Master Data

used by:

Sales Lakehouse
Marketing Lakehouse
Support Lakehouse

Shortcut Management

Data engineers should regularly:

Validate connectivity
Monitor permissions
Review ownership
Remove unused shortcuts
Verify source availability

Common Shortcut Issues

Permission Failures

User lacks source permissions.

Broken Connections

Source location moved or deleted.

Authentication Errors

Credentials have expired.

Source Unavailability

External storage temporarily unavailable.

Shortcuts and Data Governance

Shortcuts improve governance by:

Reducing duplicate copies
Maintaining ownership
Simplifying lineage tracking
Supporting centralized management

This aligns with Fabric’s broader governance strategy.

Shortcuts and Medallion Architecture

Shortcuts are often used in Medallion architectures.

Example:

			
Bronze Lakehouse
      ↓
Shortcut
      ↓
Silver Lakehouse

		

Instead of duplicating raw data.

Common DP-700 Exam Scenarios

Scenario 1

A company wants to access data stored in ADLS Gen2 without copying it into Fabric.

Solution:

Create a OneLake Shortcut

Scenario 2

Three departments need access to the same customer dataset.

Solution:

Use OneLake Shortcuts rather than creating copies.

Scenario 3

Storage costs are increasing because multiple teams maintain duplicate copies of data.

Solution:

Implement OneLake Shortcuts.

Scenario 4

A team needs access to data maintained by another Fabric workspace.

Solution:

Create an internal OneLake Shortcut.

Best Practices

Avoid Unnecessary Data Copies

Use shortcuts whenever duplication provides no benefit.

Establish Data Ownership

Maintain clear ownership of source datasets.

Secure Source Data

Permissions should be managed at the source.

Monitor Shortcut Health

Periodically validate connections.

Document Shared Datasets

Ensure consumers understand ownership and usage.

DP-700 Exam Focus Areas

You should understand:

✓ Internal shortcuts

✓ External shortcuts

✓ OneLake architecture

✓ Shortcut creation

✓ Security implications

✓ Authentication requirements

✓ Data virtualization

✓ Data sharing scenarios

✓ Governance benefits

✓ Storage optimization

✓ Single source of truth concepts

✓ Shortcut vs copy-data decisions

Practice Exam Questions

Question 1

A company wants to provide access to data stored in Azure Data Lake Storage Gen2 without copying the data into Fabric. What should be used?

A. OneLake Shortcut

B. Dataflow Gen2

C. Warehouse replication

D. Data pipeline copy activity

Answer: A

Explanation

OneLake Shortcuts allow Fabric to access external data directly without creating duplicate copies.

Question 2

What is the primary benefit of using OneLake Shortcuts?

A. Reduced data duplication

B. Automatic encryption

C. Increased Spark performance

D. Faster SQL query execution

Answer: A

Explanation

Shortcuts eliminate unnecessary data copies and help maintain a single source of truth.

Question 3

A shortcut that references another Lakehouse within OneLake is known as:

A. External shortcut

B. Managed shortcut

C. Internal shortcut

D. Mirrored shortcut

Answer: C

Explanation

Internal shortcuts reference data already stored within OneLake.

Question 4

Which external storage platform is commonly supported as a OneLake Shortcut source?

A. Microsoft Word

B. Power BI Desktop

C. Amazon S3

D. Microsoft Teams

Answer: C

Explanation

OneLake supports shortcuts to Amazon S3 and Azure Data Lake Storage Gen2.

Question 5

What happens to the source data when a OneLake Shortcut is created?

A. It is copied into Fabric.

B. It is converted to Delta format.

C. It remains in its original location.

D. It is archived.

Answer: C

Explanation

Shortcuts create references to data without moving or copying it.

Question 6

A user can see a shortcut but receives an access-denied error when attempting to query the data. What is the most likely cause?

A. Delta Lake corruption

B. Missing permissions on the source data

C. Warehouse capacity limitations

D. Missing notebook cluster

Answer: B

Explanation

Access to shortcut data still depends on permissions granted to the underlying source.

Question 7

Which statement best describes a OneLake Shortcut?

A. A metadata-based reference to data

B. A Spark transformation process

C. A replicated copy of source data

D. A backup mechanism

Answer: A

Explanation

A shortcut contains metadata that points to data stored elsewhere.

Question 8

A company wants multiple departments to use the same curated dataset while minimizing storage consumption.

What should be implemented?

A. Separate copies for each department

B. Multiple warehouses

C. Data mirroring

D. OneLake Shortcuts

Answer: D

Explanation

Shortcuts allow many teams to access the same dataset without duplication.

Question 9

Which architecture pattern benefits significantly from OneLake Shortcuts?

A. Data Mesh

B. Single-server OLTP

C. Desktop Reporting

D. Spreadsheet Modeling

Answer: A

Explanation

Data Mesh architectures often use shortcuts to share domain-owned data across teams.

Question 10

Which statement about shortcut security is correct?

A. Creating a shortcut automatically grants access to source data.

B. Shortcut security is ignored after creation.

C. Shortcuts bypass source authentication.

D. Source permissions are still enforced.

Answer: D

Explanation

Shortcuts do not override source security. Users must have the necessary permissions to access the underlying data.

DP-700 Exam Summary

Remember these key associations:

Requirement	Recommended Solution
Access data without copying	OneLake Shortcut
Share data across workspaces	Internal Shortcut
Access ADLS Gen2 data	External Shortcut
Reduce storage costs	OneLake Shortcut
Maintain single source of truth	OneLake Shortcut
Data Mesh architecture	OneLake Shortcut
Governance and lineage preservation	OneLake Shortcut

A common DP-700 exam clue is wording such as:

“The company wants to avoid creating duplicate copies of data.”

When you see this requirement, the correct answer is frequently OneLake Shortcuts, rather than data movement, replication, or copy-based solutions.

Go to the DP-700 Exam Prep Hub main page.

DP-700, Microsoft Certification, Microsoft Fabric June 3, 2026

Choose Between Dataflows Gen2, Notebooks, KQL, and T-SQL for data transformation (DP-700 Exam Prep)

This post is a part of the DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric Exam Prep Hub.
This topic falls under these sections:
Ingest and transform data (30–35%)
   --> Ingest and transform batch data
      --> Choose Between Dataflows Gen2, Notebooks, KQL, and T-SQL for data transformation

Note that there are 10 practice questions (with answers) at the end of each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available from the hub's main page below the exam topics section.

Introduction

Microsoft Fabric provides multiple technologies for transforming data. One of the most common challenges for a Data Engineer is determining which transformation tool is best suited for a specific business requirement.

The DP-700 exam frequently tests your ability to select the appropriate transformation technology based on:

Data volume
Data complexity
Required programming skills
Data source type
Performance requirements
Real-time versus batch processing needs
User expertise
Maintainability

The four most important transformation technologies covered in the exam are:

Dataflows Gen2
Notebooks
KQL
T-SQL

Although all four can transform data, they are optimized for different workloads and use cases.

Understanding their strengths, limitations, and ideal scenarios is critical for success on the DP-700 exam.

Overview of Transformation Technologies

Technology	Primary Purpose	Best For
Dataflows Gen2	Low-code ETL	Business-friendly transformations
Notebooks	Advanced engineering and Spark processing	Large-scale data engineering
T-SQL	Relational transformations	Warehouses and SQL workloads
KQL	Real-time analytics and telemetry processing	Logs and streaming data

Dataflows Gen2

What Are Dataflows Gen2?

Dataflows Gen2 are low-code data transformation tools within Microsoft Fabric that use Power Query.

They allow users to:

Connect to data sources
Clean data
Transform data
Load data into Fabric destinations

without writing significant amounts of code.

Transformation Engine

Dataflows Gen2 use:

Power Query
M Language (behind the scenes)

Most transformations are performed through a graphical interface.

Typical Transformations

Examples include:

Renaming columns
Removing duplicates
Filtering rows
Merging datasets
Splitting columns
Data type conversions
Calculated columns

When to Use Dataflows Gen2

Choose Dataflows Gen2 when:

Low-code development is desired
Data volumes are moderate
Business analysts participate in development
Transformations are relatively straightforward
Self-service data preparation is required

Examples:

Preparing Excel data
Cleaning CSV files
Combining multiple business datasets
Standard ETL processes

Advantages

Low-Code Experience

Minimal coding required.

Large Connector Library

Supports numerous source systems.

Easy Maintenance

Visual transformation steps are easier to understand.

Integration with Fabric

Loads directly into:

Lakehouses
Warehouses
Other Fabric destinations

Limitations

Less Flexible

Complex logic may become difficult.

Not Ideal for Very Large Data Volumes

Spark-based solutions often scale better.

Limited Advanced Programming

Compared to notebooks.

Notebooks

What Are Notebooks?

Notebooks are code-based development environments that support:

PySpark
Python
Scala
Spark SQL
R

within Microsoft Fabric.

Transformation Engine

Notebooks execute on Spark clusters.

This enables:

Distributed processing
Parallel execution
Large-scale transformations

Typical Transformations

Examples:

Complex joins
Data enrichment
Machine learning preparation
Feature engineering
Data quality validation
Custom business logic

When to Use Notebooks

Choose notebooks when:

Large data volumes exist
Spark processing is required
Advanced transformations are needed
Custom programming is necessary
Machine learning integration is planned

Examples:

Processing billions of records
Data science workflows
Medallion architecture pipelines
Complex transformations

Advantages

Massive Scalability

Handles large datasets efficiently.

Flexible Programming

Supports multiple languages.

Machine Learning Integration

Works with Spark ML libraries.

Advanced Data Engineering

Ideal for enterprise-scale pipelines.

Limitations

Requires Coding Skills

Less accessible for business users.

More Complex Development

Compared to Dataflows Gen2.

T-SQL

What Is T-SQL?

T-SQL (Transact-SQL) is Microsoft’s extension of SQL.

Fabric Warehouses and SQL endpoints support T-SQL for:

Querying
Transforming
Managing relational data

Transformation Techniques

Common operations include:

			
SELECT
JOIN
GROUP BY
CASE
CTE
MERGE
WINDOW FUNCTIONS

		

When to Use T-SQL

Choose T-SQL when:

Data resides in a Warehouse
Relational transformations are required
SQL expertise already exists
Dimensional models are being built

Examples:

Fact table loading
Dimension updates
Data warehouse ETL
Reporting data preparation

Advantages

Familiar Language

Widely used by data professionals.

Excellent Relational Processing

Optimized for structured data.

Strong Performance

Particularly for warehouse workloads.

Easy Integration

Works naturally with BI tools.

Limitations

Less Suitable for Unstructured Data

Not ideal for files and raw data.

Limited Distributed Processing

Compared to Spark.

KQL

What Is KQL?

Kusto Query Language (KQL) is designed for:

Log analytics
Telemetry analysis
Real-time data processing
Event analytics

KQL is commonly used in:

KQL Databases
Eventhouse
Real-Time Intelligence

Typical Transformations

Examples include:

Filtering events
Aggregations
Pattern detection
Time-series analysis
Stream transformations

When to Use KQL

Choose KQL when:

Working with telemetry data
Processing logs
Analyzing streaming events
Building real-time dashboards

Examples:

Sensor monitoring
Application logs
Security analytics
Operational monitoring

Advantages

Optimized for Time-Series Data

Excellent for event-driven workloads.

Fast Query Performance

Handles large event volumes efficiently.

Real-Time Analytics

Supports low-latency analysis.

Limitations

Not a General ETL Tool

Less suitable for traditional batch ETL.

Not Designed for Dimensional Modeling

Warehouses are generally better for reporting models.

Comparing Transformation Technologies

Requirement	Dataflows Gen2	Notebooks	T-SQL	KQL
Low-Code Development	Excellent	Poor	Moderate	Moderate
Large-Scale Processing	Moderate	Excellent	Good	Excellent
Relational Transformations	Moderate	Good	Excellent	Limited
Streaming Analytics	Limited	Moderate	Poor	Excellent
Machine Learning Support	Poor	Excellent	Poor	Limited
Telemetry Analytics	Poor	Moderate	Poor	Excellent
Business User Friendly	Excellent	Poor	Moderate	Moderate
Advanced Programming	Limited	Excellent	Moderate	Limited

Decision Framework

Choose Dataflows Gen2 When:

Low-code ETL is preferred
Business users are involved
Data volumes are moderate
Transformations are straightforward

Choose Notebooks When:

Spark processing is required
Data volumes are large
Complex transformations exist
Machine learning is involved

Choose T-SQL When:

Working with a Warehouse
Building dimensional models
SQL skills are available
Data is highly structured

Choose KQL When:

Processing logs
Analyzing telemetry
Supporting streaming analytics
Building operational monitoring solutions

Common DP-700 Scenario Questions

Scenario 1

A business analyst needs to combine Excel spreadsheets and remove duplicate rows using a visual interface.

Best choice:

Dataflows Gen2

Scenario 2

A data engineer must transform billions of records stored in a Lakehouse.

Best choice:

Notebook

Scenario 3

A warehouse team must populate fact and dimension tables.

Best choice:

T-SQL

Scenario 4

An operations team analyzes millions of application log events each hour.

Best choice:

KQL

Scenario 5

A machine learning team requires custom Python transformations.

Best choice:

Notebook

Exam Tips

Many DP-700 questions are not asking what can perform a transformation, but what should perform the transformation.

Remember these associations:

Requirement	Best Choice
Visual ETL	Dataflows Gen2
Spark processing	Notebook
Data warehouse transformations	T-SQL
Telemetry and logs	KQL
Machine learning preparation	Notebook
Self-service data preparation	Dataflows Gen2
Streaming analytics	KQL

Practice Exam Questions

Question 1

A business analyst needs to cleanse CSV files using a graphical interface with minimal coding. Which transformation technology should be used?

A. T-SQL

B. Notebook

C. KQL

D. Dataflows Gen2

Answer: D

Explanation

Dataflows Gen2 provide a low-code, visual interface that is ideal for business users and simple ETL processes.

Question 2

A data engineer must process several billion records stored in a Lakehouse using distributed computing.

Which option should be selected?

A. Notebook

B. Dataflows Gen2

C. T-SQL

D. KQL

Answer: A

Explanation

Notebooks leverage Spark for distributed processing and are designed for large-scale data transformations.

Question 3

Which technology is specifically optimized for transforming and analyzing telemetry and log data?

A. Dataflows Gen2

B. Notebook

C. KQL

D. T-SQL

Answer: C

Explanation

KQL is designed for log analytics, telemetry processing, and real-time operational analytics.

Question 4

A team is loading dimension and fact tables within a Fabric Warehouse.

Which transformation technology is most appropriate?

A. Notebook

B. Dataflows Gen2

C. KQL

D. T-SQL

Answer: D

Explanation

T-SQL is the preferred technology for relational transformations in Fabric Warehouses.

Question 5

A company requires machine learning feature engineering using Python libraries.

Which technology should be selected?

A. Notebook

B. Dataflows Gen2

C. T-SQL

D. KQL

Answer: A

Explanation

Notebooks support Python, Spark, and machine learning frameworks, making them ideal for feature engineering.

Question 6

Which technology relies primarily on Power Query transformations?

A. Notebook

B. Dataflows Gen2

C. T-SQL

D. KQL

Answer: B

Explanation

Dataflows Gen2 use Power Query and the M language behind the scenes for data transformations.

Question 7

An operations team needs to perform real-time aggregations on streaming sensor data.

Which option should be used?

A. Dataflows Gen2

B. Notebook

C. KQL

D. T-SQL

Answer: C

Explanation

KQL is optimized for real-time event processing and telemetry analysis.

Question 8

A data engineer needs maximum flexibility to implement custom business logic across multiple data sources.

Which technology is most appropriate?

A. KQL

B. Dataflows Gen2

C. T-SQL

D. Notebook

Answer: D

Explanation

Notebooks provide the highest degree of customization through programming languages such as Python and PySpark.

Question 9

A team already has extensive SQL expertise and needs to transform highly structured relational data in a Warehouse.

Which option is best?

A. Notebook

B. T-SQL

C. Dataflows Gen2

D. KQL

Answer: B

Explanation

T-SQL is optimized for relational transformations and leverages existing SQL skills.

Question 10

Which technology is generally the most business-user-friendly option for creating batch data transformation processes?

A. Notebook

B. KQL

C. T-SQL

D. Dataflows Gen2

Answer: D

Explanation

Dataflows Gen2 provide a visual, low-code experience that is easier for business users and citizen developers than code-based solutions.

DP-700 Exam Summary

When deciding between transformation technologies, focus on the primary workload:

Dataflows Gen2 → Low-code ETL and self-service data preparation
Notebooks → Spark, large-scale processing, advanced engineering, and machine learning
T-SQL → Relational transformations and warehouse development
KQL → Telemetry, logs, time-series analytics, and real-time event processing

A common DP-700 exam strategy is to identify the keywords in the scenario:

Visual interface → Dataflows Gen2
Billions of rows / Spark → Notebook
Warehouse / dimensional model → T-SQL
Logs / telemetry / real-time analytics → KQL

These keywords often point directly to the correct answer.

Go to the DP-700 Exam Prep Hub main page.

Data Development, DP-700, Microsoft Certification, Microsoft Fabric June 3, 2026

Choose an appropriate data store (DP-700 Exam Prep)

This post is a part of the DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric Exam Prep Hub.
This topic falls under these sections:
Ingest and transform data (30–35%)
   --> Ingest and transform batch data
      --> Choose an appropriate data store

Note that there are 10 practice questions (with answers) at the end of each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available from the hub's main page below the exam topics section.

Introduction

One of the most important responsibilities of a Microsoft Fabric Data Engineer is selecting the appropriate data store for a given workload. The choice of data store directly affects performance, scalability, maintainability, security, data modeling approaches, and overall solution cost.

Microsoft Fabric provides multiple storage and analytics options, each optimized for specific use cases. The DP-700 exam expects candidates to understand when and why to use each storage option, especially in batch ingestion and transformation scenarios.

A common exam theme is evaluating business requirements and selecting the most appropriate storage technology among:

OneLake
Lakehouse
Data Warehouse
KQL Database
Eventhouse
Mirrored Databases
Delta Tables
Shortcuts
External Storage Sources

Understanding the strengths and limitations of each option is critical for success on the exam.

Understanding Data Stores in Microsoft Fabric

A data store is a repository where data is persisted and made available for processing, analytics, reporting, or machine learning.

Selecting a data store depends on factors such as:

Data structure
Data volume
Query patterns
Processing requirements
Latency requirements
User skill sets
Governance needs

A poor storage choice can result in:

Slow query performance
Increased complexity
Higher costs
Difficult maintenance

OneLake: The Foundation of Fabric

What is OneLake?

OneLake is the unified logical data lake for Microsoft Fabric.

It serves as:

A single storage layer
A centralized data repository
A common storage foundation for all Fabric workloads

Key characteristics:

Tenant-wide storage
Based on Azure Data Lake Storage Gen2 architecture
Supports open formats
Eliminates data silos

Benefits

Single copy of data
Unified governance
Centralized security
Reduced duplication

Exam Tip

OneLake itself is not typically selected as the analytics store. Instead, workloads such as Lakehouses and Warehouses are built on top of OneLake.

Lakehouse

What is a Lakehouse?

A Lakehouse combines features of:

Data lakes
Data warehouses

Lakehouses support:

Structured data
Semi-structured data
Unstructured data

while maintaining:

Open file formats
Delta Lake support
Spark processing

When to Choose a Lakehouse

Choose a Lakehouse when:

Data engineering workloads dominate
Spark processing is required
Data science workloads are expected
Large volumes of raw data must be stored
Data arrives in multiple formats

Examples:

IoT data
Clickstream data
Log files
Data science projects

Lakehouse Advantages

Open Format Storage

Uses Delta Parquet files.

Spark Integration

Optimized for notebooks and Spark jobs.

Data Science Friendly

Supports machine learning workflows.

Multi-format Data

Handles structured and unstructured data.

Lakehouse Limitations

Less familiar to traditional SQL developers
Some reporting scenarios may perform better in a warehouse

Data Warehouse

What is a Fabric Warehouse?

A Fabric Warehouse is a fully managed relational analytics platform optimized for SQL workloads.

Characteristics:

Relational tables
T-SQL support
ACID transactions
Optimized query engine

When to Choose a Warehouse

Choose a Warehouse when:

Business users primarily use SQL
Dimensional models are required
Reporting workloads dominate
Data is highly structured

Examples:

Enterprise reporting
Financial reporting
Sales analytics
Executive dashboards

Warehouse Advantages

Familiar SQL Experience

Supports T-SQL.

Strong BI Integration

Works seamlessly with reporting tools.

Relational Modeling

Supports star and snowflake schemas.

High Query Performance

Optimized for analytical queries.

Warehouse Limitations

Less flexible for unstructured data
Not ideal for large-scale machine learning workloads

Lakehouse vs Warehouse

Feature	Lakehouse	Warehouse
Storage Format	Delta Files	Relational Tables
Primary Engine	Spark	SQL
Structured Data	Yes	Yes
Semi-Structured Data	Yes	Limited
Unstructured Data	Yes	No
Machine Learning	Excellent	Limited
BI Reporting	Good	Excellent
Data Science	Excellent	Limited

Delta Tables

What Are Delta Tables?

Delta tables are transactional storage structures built on Delta Lake technology.

Benefits include:

ACID compliance
Schema enforcement
Schema evolution
Time travel
Reliable batch processing

When to Use Delta Tables

Use Delta tables when:

Reliable batch ingestion is required
Incremental loads are needed
Historical versions must be maintained
Data quality controls are important

Exam Tip

Most Lakehouse production data should be stored as Delta tables.

KQL Database

What is a KQL Database?

KQL databases are optimized for:

Log analytics
Telemetry
Time-series analysis
Streaming workloads

They use:

Kusto Query Language (KQL)

instead of SQL.

When to Choose KQL Databases

Choose KQL databases for:

Application logs
Monitoring data
Telemetry
Operational analytics

Examples:

Server monitoring
Manufacturing sensors
Website activity tracking

Advantages

Extremely fast ingestion
High-performance time-series analysis
Optimized aggregations

Limitations

Not designed for dimensional modeling
Less suitable for traditional reporting

Eventhouse

What is Eventhouse?

Eventhouse is a Real-Time Intelligence component designed for large-scale event analytics.

Eventhouse supports:

Streaming ingestion
KQL analytics
High-volume telemetry

When to Use Eventhouse

Choose Eventhouse when:

Massive event volumes exist
Real-time analytics are required
Streaming data dominates

Mirrored Databases

What Are Mirrored Databases?

Mirroring replicates operational database data into Fabric.

Supported sources include:

Azure SQL Database
Azure SQL Managed Instance
SQL Server (supported scenarios)
Other supported databases

When to Choose Mirroring

Choose mirroring when:

Near real-time synchronization is required
Minimal ETL is desired
Operational systems must remain the source of truth

Advantages

Reduced data movement
Simplified architecture
Near real-time availability

Shortcuts

What Are Shortcuts?

Shortcuts provide virtual access to data stored elsewhere.

The data remains in its original location.

Examples:

Azure Data Lake Storage Gen2
Amazon S3
Other OneLake locations

When to Use Shortcuts

Choose shortcuts when:

Data duplication must be avoided
Multiple teams share datasets
Existing storage investments should be preserved

Benefits

No copying
Reduced storage costs
Single source of truth

Choosing Based on Workload Type

Data Engineering Workloads

Recommended Store:

✔ Lakehouse

Reason:

Spark-native
Flexible storage
Delta support

Business Intelligence Workloads

Recommended Store:

✔ Warehouse

Reason:

SQL optimized
Dimensional modeling
Reporting performance

Data Science Workloads

Recommended Store:

✔ Lakehouse

Reason:

ML integration
Notebook support
Large-scale data processing

Streaming Analytics

Recommended Store:

✔ KQL Database
✔ Eventhouse

Reason:

Low latency
High ingestion rates

Operational Data Replication

Recommended Store:

✔ Mirrored Database

Reason:

Simplified synchronization

Common DP-700 Scenario Questions

Scenario 1

A company wants to store structured and unstructured files while supporting Spark notebooks.

Best choice:

Lakehouse

Scenario 2

A finance department needs highly optimized SQL reporting.

Best choice:

Warehouse

Scenario 3

An operations team analyzes billions of telemetry records daily.

Best choice:

KQL Database or Eventhouse

Scenario 4

A company wants to use data already stored in ADLS Gen2 without copying it.

Best choice:

Shortcut

Scenario 5

A data science team requires Delta tables and machine learning workflows.

Best choice:

Lakehouse

Decision Framework

Ask the following questions:

Is the workload primarily SQL analytics?

→ Warehouse

Is Spark required?

→ Lakehouse

Is machine learning required?

→ Lakehouse

Is the data mostly telemetry or logs?

→ KQL Database

Is the data streaming continuously?

→ Eventhouse or KQL Database

Must external data remain in place?

→ Shortcut

Must operational databases replicate into Fabric?

→ Mirrored Database

Best Practices

Store Curated Data as Delta Tables

Provides reliability and transactional consistency.

Avoid Unnecessary Copies

Use shortcuts when appropriate.

Match Store to Workload

Do not force all workloads into one store.

Separate Raw and Curated Layers

Use Medallion Architecture:

Bronze
Silver
Gold

Use Warehouses for Reporting

Leverage optimized SQL engines.

Use Lakehouses for Engineering

Take advantage of Spark and Delta Lake.

DP-700 Exam Focus Areas

You should understand:

✓ OneLake architecture

✓ Lakehouse capabilities

✓ Warehouse capabilities

✓ Delta tables

✓ KQL databases

✓ Eventhouse

✓ Mirrored databases

✓ Shortcuts

✓ SQL vs Spark workloads

✓ Reporting vs data science workloads

✓ Structured vs semi-structured data

✓ Batch vs streaming storage choices

✓ Common architecture decision scenarios

Practice Exam Questions

Question 1

A company needs to store structured, semi-structured, and unstructured data while enabling Spark notebook processing. Which data store should be selected?

A. KQL Database

B. Warehouse

C. Lakehouse

D. Eventhouse

Answer: C

Explanation

Lakehouses support multiple data formats and integrate natively with Spark, making them ideal for data engineering and data science workloads.

Question 2

Which Fabric data store is optimized for traditional SQL-based analytical reporting?

A. Eventhouse

B. Shortcut

C. Lakehouse

D. Warehouse

Answer: D

Explanation

Warehouses are designed for structured relational analytics and provide strong T-SQL support.

Question 3

A company collects billions of sensor readings each day and requires fast time-series analysis.

Which data store is most appropriate?

A. Warehouse

B. Shortcut

C. KQL Database

D. Mirrored Database

Answer: C

Explanation

KQL databases are optimized for telemetry, logs, and time-series analytics.

Question 4

You need to provide access to data stored in Azure Data Lake Storage Gen2 without copying the files into Fabric.

What should you use?

A. Warehouse

B. Mirrored Database

C. Delta Table

D. Shortcut

Answer: D

Explanation

Shortcuts provide virtual access to external data sources while avoiding duplication.

Question 5

Which feature is provided by Delta tables?

A. Automatic dashboard creation

B. ACID transaction support

C. Real-time alerting

D. Event routing

Answer: B

Explanation

Delta tables provide ACID transactions, schema enforcement, and reliable data processing.

Question 6

A business intelligence team primarily writes T-SQL queries and builds dimensional models.

Which storage option should they use?

A. Eventhouse

B. KQL Database

C. Warehouse

D. Lakehouse

Answer: C

Explanation

Warehouses are optimized for SQL analytics and dimensional modeling.

Question 7

A company wants near real-time replication of operational Azure SQL Database data into Fabric.

Which solution should be selected?

A. Mirrored Database

B. Eventhouse

C. Warehouse

D. Delta Table

Answer: A

Explanation

Mirrored databases synchronize source database changes into Fabric with minimal ETL effort.

Question 8

Which Fabric storage option is generally the best choice for machine learning workloads?

A. Warehouse

B. Lakehouse

C. KQL Database

D. Eventhouse

Answer: B

Explanation

Lakehouses support Spark, notebooks, Delta tables, and machine learning workflows.

Question 9

What is the primary purpose of OneLake?

A. Replacing all Lakehouses

B. Serving as Fabric’s unified storage foundation

C. Providing only streaming analytics

D. Managing deployment pipelines

Answer: B

Explanation

OneLake is the centralized storage layer that underpins all Fabric workloads.

Question 10

A solution requires high-volume real-time event analytics with streaming ingestion.

Which Fabric component is most appropriate?

A. Warehouse

B. Mirrored Database

C. Delta Table

D. Eventhouse

Answer: D

Explanation

Eventhouse is designed specifically for large-scale streaming analytics and real-time intelligence scenarios.

Exam Tip

For DP-700, many questions can be answered by remembering this mapping:

Requirement	Best Choice
Spark, ML, flexible data formats	Lakehouse
SQL analytics and reporting	Warehouse
Telemetry and time-series data	KQL Database
Massive real-time event analytics	Eventhouse
External data without copying	Shortcut
Near real-time operational replication	Mirrored Database
Unified Fabric storage layer	OneLake

A common exam pattern is to present multiple technically possible options. Focus on selecting the option that is optimized for the workload, not merely one that could work.

Go to the DP-700 Exam Prep Hub main page.

DP-700, Microsoft Certification, Microsoft Fabric June 3, 2026

Design and implement a loading pattern for streaming data (DP-700 Exam Prep)

This post is a part of the DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric Exam Prep Hub.
This topic falls under these sections:
Ingest and transform data (30–35%)
   --> Design and implement loading patterns
      --> Design and implement a loading pattern for streaming data

Note that there are 10 practice questions (with answers) at the end of each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available from the hub's main page below the exam topics section.

Introduction

Traditional batch data processing has been the foundation of analytics systems for decades. However, many modern business scenarios require data to be processed and analyzed as soon as it is generated. Examples include IoT sensors, website clickstreams, financial transactions, manufacturing equipment telemetry, and application monitoring.

Microsoft Fabric provides several capabilities that support streaming and real-time analytics through its Real-Time Intelligence workloads, Eventstreams, KQL databases, Data Activator, Lakehouses, and Spark technologies.

For the DP-700 exam, you should understand:

Streaming versus batch processing
Real-time and near real-time architectures
Event-driven data ingestion
Eventstreams
Event processing patterns
Streaming destinations
KQL databases
Lakehouse streaming ingestion
Event-driven orchestration
Windowing concepts
Checkpointing and fault tolerance
Performance and scalability considerations

Many DP-700 scenario questions focus on choosing the appropriate loading pattern based on latency requirements and business needs.

Understanding Streaming Data

Streaming data is data that arrives continuously over time rather than in large batches.

Examples include:

Source	Example Data
IoT Devices	Temperature readings
Web Applications	User clicks
Retail Systems	Purchases
Mobile Apps	User activity
Manufacturing Equipment	Sensor telemetry
Financial Systems	Transaction events

Instead of loading data once per day, streaming systems continuously process incoming events.

Batch vs Streaming Processing

Batch Processing

Processes accumulated data at scheduled intervals.

Example:

			
Daily Sales File
       ↓
Midnight ETL Process
       ↓
Data Warehouse

		

Characteristics:

High latency
Simpler architecture
Efficient for large historical datasets

Streaming Processing

Processes events continuously as they arrive.

Example:

			
Sensor Event
      ↓
Immediate Processing
      ↓
Analytics Platform

		

Characteristics:

Low latency
Near real-time insights
Event-driven architecture

Streaming Data Latency Categories

Real-Time

Typically seconds or less.

Example:

Fraud Detection

Near Real-Time

Typically seconds to minutes.

Example:

Operational Dashboards

Micro-Batch

Small batches processed frequently.

Example:

			
Every 30 Seconds
Every 1 Minute
Every 5 Minutes

Many streaming implementations in Fabric use micro-batch processing internally.

Streaming Architecture in Microsoft Fabric

A common Fabric streaming architecture:

			
Event Source
      ↓
Eventstream
      ↓
Transformation
      ↓
Destination
      ↓
Analytics

		

Possible destinations include:

KQL Database
Lakehouse
Warehouse
Real-Time Dashboard

Event-Driven Processing

Streaming systems are event-driven.

An event represents something that happened.

Examples:

			
Order Created
Order Updated
Machine Started
Temperature Changed
Sensor Failed

		

Events are generated continuously and processed immediately.

Eventstreams

Eventstreams are one of the core ingestion services in Microsoft Fabric Real-Time Intelligence.

Eventstreams provide:

Event ingestion
Routing
Filtering
Transformation
Distribution

Eventstreams simplify streaming architecture by reducing custom development requirements.

Eventstream Sources

Common sources include:

Azure Event Hubs

High-volume event ingestion service.

IoT Hubs

Designed for IoT device communication.

Fabric Events

Events generated within Fabric workloads.

Custom Applications

Applications publishing events directly.

Eventstream Destinations

Eventstreams can route data to:

KQL Databases

Optimized for real-time analytics.

Lakehouses

Supports historical storage and analytics.

Eventhouse

Supports large-scale streaming workloads.

Activator

Supports automated actions and alerts.

Designing a Streaming Loading Pattern

A typical design includes:

			
Event Producer
       ↓
Eventstream
       ↓
Validation
       ↓
Transformation
       ↓
Storage Layer
       ↓
Analytics

		

Each stage serves a specific purpose.

Step 1: Event Ingestion

The first step is capturing events from source systems.

Example:

			
Manufacturing Sensor
      ↓
Temperature Reading
      ↓
Eventstream

		

The ingestion layer must support:

High throughput
Reliability
Scalability

Step 2: Data Validation

Streaming data often contains:

Missing fields
Invalid values
Corrupt messages

Example:

Temperature = NULL

Such events may be:

Rejected
Corrected
Routed elsewhere

Step 3: Stream Transformation

Common transformations include:

Filtering

Remove unnecessary events.

Example:

Temperature > 80

Enrichment

Add contextual information.

Example:

			
Device ID
+
Location Data

Aggregation

Combine multiple events.

Example:

			
Average Temperature
Per Minute

Step 4: Storage

Streaming systems often separate:

Hot Storage

Recent data for immediate analysis.

Cold Storage

Historical data for long-term reporting.

Fabric commonly uses:

			
KQL Database
+
Lakehouse

for this purpose.

KQL Databases

KQL databases are optimized for:

Time-series data
Telemetry
Log analytics
Streaming workloads

Benefits include:

Fast ingestion
High query performance
Real-time dashboards

For DP-700, KQL databases are frequently associated with streaming scenarios.

Lakehouse Streaming Storage

Streaming data can also be written into Delta tables within a Lakehouse.

Benefits:

Historical retention
Data science workloads
Machine learning
Unified analytics

This pattern combines real-time and batch analytics.

Eventhouse

Eventhouse is designed for:

Large-scale event analytics
Streaming workloads
Real-time intelligence solutions

It integrates closely with KQL databases and Eventstreams.

Windowing Concepts

Streaming systems often process data using windows.

A window groups events together for calculations.

Tumbling Window

Fixed non-overlapping intervals.

Example:

Each event belongs to one window.

Sliding Window

Windows overlap.

Example:

			
Every minute
Last 5 minutes

Provides continuous calculations.

Session Window

Groups events based on activity.

Example:

User Activity Session

Useful for clickstream analysis.

Checkpointing

Checkpointing tracks processing progress.

Purpose:

Recovery after failures
Prevent data loss
Avoid duplicate processing

Without checkpointing:

			
System Failure
↓
Reprocess Everything

With checkpointing:

			
System Failure
↓
Resume From Last Checkpoint

Fault Tolerance

Streaming architectures must handle failures.

Strategies include:

Retry Logic

Automatically retry failed operations.

Checkpointing

Resume processing after failures.

Durable Storage

Persist data before processing.

Dead-Letter Queues

Store problematic events for investigation.

Event Ordering

Events may arrive out of sequence.

Example:

			
Event 3
Event 1
Event 2

Streaming solutions may require:

Event timestamps
Watermarks
Reordering logic

Scalability Considerations

Streaming systems must scale with event volume.

Important considerations:

Throughput

Events processed per second.

Parallelism

Multiple processors handling data simultaneously.

Partitioning

Distributing events across resources.

Resource Management

Balancing cost and performance.

Streaming vs Batch Loading in Fabric

Characteristic	Batch	Streaming
Latency	Minutes to Hours	Seconds
Trigger	Schedule	Event
Processing	Periodic	Continuous
Use Case	Historical Reporting	Operational Analytics
Architecture	Simpler	More Complex

Common Fabric Streaming Patterns

Pattern 1: IoT Analytics

			
IoT Devices
      ↓
Eventstream
      ↓
KQL Database
      ↓
Real-Time Dashboard

		

Pattern 2: Operational Monitoring

			
Applications
      ↓
Eventstream
      ↓
Eventhouse
      ↓
Alerts

		

Pattern 3: Real-Time + Historical Analytics

			
Events
      ↓
Eventstream
      ↓
Lakehouse
      ↓
Delta Tables
      ↓
Analytics

		

Common DP-700 Exam Scenarios

Scenario 1

A company wants dashboards updated within seconds of receiving telemetry.

Best solution:

Streaming ingestion using Eventstreams and KQL databases

Scenario 2

A manufacturing system generates millions of sensor events daily.

Best solution:

Eventstream → Eventhouse → KQL Database

Scenario 3

An organization wants real-time analytics and historical reporting.

Best solution:

Eventstream → Lakehouse → Delta Tables

Scenario 4

A system must automatically alert users when a sensor exceeds a threshold.

Best solution:

Streaming ingestion with Data Activator

Best Practices

Use Eventstreams for Ingestion

Provides scalable event routing and transformation.

Use KQL Databases for Real-Time Analytics

Optimized for telemetry and time-series data.

Store Historical Data in Lakehouses

Supports long-term analytics and machine learning.

Implement Checkpointing

Improves reliability and recovery.

Design for Scalability

Plan for growth in event volume.

Validate Data Early

Prevent poor-quality events from contaminating downstream systems.

DP-700 Exam Focus Areas

You should understand:

✓ Streaming vs batch processing

✓ Event-driven architectures

✓ Eventstreams

✓ Eventhouse

✓ KQL databases

✓ Real-time analytics

✓ Near real-time processing

✓ Windowing concepts

✓ Streaming transformations

✓ Event routing

✓ Checkpointing

✓ Fault tolerance

✓ Lakehouse streaming ingestion

✓ Real-Time Intelligence workloads

Practice Exam Questions

Question 1

A company requires dashboards to update within seconds of receiving IoT telemetry. Which loading pattern should be implemented?

A. Weekly snapshot loading

B. Daily batch processing

C. Streaming ingestion

D. Full data reloads

Answer: C

Explanation

Streaming ingestion provides low-latency processing and supports near real-time dashboard updates.

Question 2

Which Microsoft Fabric component is primarily used to ingest, route, and transform streaming events?

A. Dataflow Gen2

B. Eventstream

C. Warehouse

D. Deployment Pipeline

Answer: B

Explanation

Eventstreams are specifically designed for real-time event ingestion, transformation, and routing.

Question 3

A data engineer needs a destination optimized for time-series analytics and rapid ingestion of telemetry data.

Which destination should be selected?

A. Lakehouse

B. Warehouse

C. KQL Database

D. Dataflow Gen2

Answer: C

Explanation

KQL databases are optimized for real-time analytics, telemetry, and log data.

Question 4

What is the primary benefit of checkpointing in a streaming solution?

A. Enables recovery after processing failures

B. Compresses event data

C. Eliminates duplicates permanently

D. Encrypts incoming events

Answer: A

Explanation

Checkpointing records processing progress, allowing recovery from the last successful point after failures.

Question 5

Which window type uses fixed, non-overlapping intervals?

A. Session window

B. Tumbling window

C. Dynamic window

D. Watermark window

Answer: B

Explanation

Tumbling windows divide data into fixed intervals without overlap.

Question 6

An organization wants to preserve streaming data for long-term analytics and machine learning workloads.

Which destination is most appropriate?

A. Lakehouse

B. Data Activator

C. Eventstream

D. Workspace

Answer: A

Explanation

Lakehouses provide scalable storage and support advanced analytics and machine learning.

Question 7

Which characteristic most distinguishes streaming processing from batch processing?

A. Lower storage requirements

B. Simpler architecture

C. Continuous event processing

D. Larger processing windows

Answer: C

Explanation

Streaming systems process data continuously as events arrive rather than at scheduled intervals.

Question 8

A user activity analysis solution must group events based on periods of user activity separated by inactivity.

Which window type should be used?

A. Sliding window

B. Tumbling window

C. Fixed window

D. Session window

Answer: D

Explanation

Session windows are designed to group events according to user activity sessions.

Question 9

What is the primary purpose of event enrichment during stream processing?

A. Delete invalid records

B. Add contextual information to events

C. Increase event frequency

D. Reduce storage costs

Answer: B

Explanation

Enrichment adds additional business or reference data to incoming events to improve analytical value.

Question 10

A company requires a Fabric architecture that supports both real-time analytics and historical analysis of streaming data.

Which design is most appropriate?

A. Eventstream → KQL Database only

B. Dataflow Gen2 → Warehouse

C. Eventstream → Lakehouse → Delta Tables

D. Scheduled Pipeline → Warehouse

Answer: C

Explanation

Writing streaming data to a Lakehouse enables historical retention while supporting analytical workloads through Delta tables.

Exam Tip

For DP-700, remember the following associations:

Requirement	Recommended Fabric Technology
Real-time event ingestion	Eventstream
Time-series analytics	KQL Database
Large-scale event analytics	Eventhouse
Long-term storage	Lakehouse
Automated event-driven actions	Data Activator
Continuous processing	Streaming Pattern
Scheduled processing	Batch Pattern

A common exam clue is wording such as:

“Data must be available for analysis within seconds of being generated.”

When you see this requirement, the correct solution will almost always involve streaming ingestion, Eventstreams, and often KQL databases or Eventhouse, rather than traditional batch-oriented pipelines.

Go to the DP-700 Exam Prep Hub main page.