execute command activity stage data stage versions

Note per source data partition can use up to 4 DIUs. Copy from partition-option-enabled data stores (including Azure Database for PostgreSQL, Azure SQL Database, Azure SQL Managed Instance, Azure Synapse Analytics, Oracle, Netezza, SQL Server, and Teradata): 2-256 when writing to a folder, and 2-4 when writing to one single file. Copy into Azure Synapse Analytics using PolyBase or COPY statement: 2 Copy into Azure SQL Database or Azure Cosmos DB: between 4 and 16 depending on the sink tier (DTUs/RUs) and source file pattern Copy from single file: 2-4 - Copy from multiple files: 2-256 depending on the number and size of the files For example, if you copy data from a folder with 4 large files, the max effective DIU is 16. Copy from and to multiple files: 2-256 depending on the number and size of the filesįor example, if you copy data from a folder with 4 large files and choose to preserve hierarchy, the max effective DIU is 16 when you choose to merge file, the max effective DIU is 4.īetween 4 and 32 depending on the number and size of the files The following table lists the supported DIU ranges and default behavior in different copy scenarios: Copy scenario If not specified or you choose 'Auto' on the UI, the service dynamically applies the optimal DIU setting based on your source-sink pair and data pattern. The allowed DIUs to empower a copy activity run is between 2 and 256.

Data Integration Unit only applies to Azure integration runtime, but not self-hosted integration runtime.

When you select a Copy activity on the pipeline editor canvas and choose the Settings tab in the activity configuration area below the canvas, you will see options to configure all of the performance features detailed below.Ī Data Integration Unit is a measure that represents the power (a combination of CPU, memory, and network resource allocation) of a single unit within the service. This article outlines the copy activity performance optimization features that you can leverage in Azure Data Factory and Synapse pipelines.

Execute command activity stage data stage versions