From e0e1387231dc9daec9b28780c2bc92dc10f21d7a Mon Sep 17 00:00:00 2001 From: Anil Kumar K B <110081934+kbanil1105@users.noreply.github.com> Date: Fri, 22 Nov 2024 16:39:56 +0530 Subject: [PATCH] Update connector-lakehouse-copy-activity.md Add a note highlighting the clear difference b/w Overwrite and OverwriteSchema --- docs/data-factory/connector-lakehouse-copy-activity.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/data-factory/connector-lakehouse-copy-activity.md b/docs/data-factory/connector-lakehouse-copy-activity.md index c602706d3f..8b01b03271 100644 --- a/docs/data-factory/connector-lakehouse-copy-activity.md +++ b/docs/data-factory/connector-lakehouse-copy-activity.md @@ -133,7 +133,7 @@ The following properties are **required**: - **Append**: Append new values to existing table. - **Enable Partition**: This selection allows you to create partitions in a folder structure based on one or multiple columns. Each distinct column value (pair) is a new partition. For example, "year=2000/month=01/file". - **Partition column name**: Select from the destination columns in schemas mapping when you append data to a new table. When you append data to an existing table that already has partitions, the partition columns are derived from the existing table automatically. Supported data types are string, integer, boolean, and datetime. Format respects type conversion settings under the **Mapping** tab. - - **Overwrite**: Overwrite the existing data and schema in the table using the new values. If this operation is selected, you can enable partition on your target table: + - **Overwrite**: Upon selecting the Table action as Overwrite from UI, it's basically a "OverwriteSchema" which overwrites the existing data and schema in the table using the new values supporting the Delta Lake time travel feature. In order to rollback to legacy feature "Overwrite", will need to use dynamic expression like @if(equals(pipeline().parameters.refresh_type,'full'),'Overwrite','Append'), which basically creates a new table and also creates backup table for every run of the pipeline with no support to time travel feature. If Table action as Overwrite is selected from UI, you can enable partition on your target table: - **Enable Partition**: This selection allows you to create partitions in a folder structure based on one or multiple columns. Each distinct column value (pair) is a new partition. For example, "year=2000/month=01/file". - **Partition column name**: Select from the destination columns in schemas mapping. Supported data types are string, integer, boolean, and datetime. Format respects type conversion settings under the **Mapping** tab.