OVERRIDE_FILE_LOAD

Target database: Snowflake, Amazon Redshift, Azure SQL Database, Azure Synapse SQL, Microsoft Fabric, Google BigQuery, Databricks

OVERRIDE_FILE_LOAD is a load step type that can be used to override an automatically generated file load. OVERRIDE_FILE_LOAD is available in file loads.

See also:

Usage

OPTION

OVERRIDE_FILE_LOAD: sql_code

Variables

Variables supported in an OVERRIDE_FILE_LOAD step:

Variable	Description	Snowflake	Amazon Redshift	Azure SQL Database	Azure Synapse SQL	BigQuery
copy_options	Resolved as the Snowflake copy options in file load execution.	x
data_source	Synonymous to storage_integration, resolved as the storage integration (Snowflake) or external data source (Azure SQL Database) in file load execution.	x		x
file_format	Resolved as the file format options in file load execution.	x	x	x	x	x
from_file	Resolved as the source file path in file load execution.	x		x
from_file_list	Resolved as a comma-separated source file list in file load execution.	x				x
from_path	Resolved as the source path(s) in file load execution.	x	x	x	x
manifestrunid	Resolved as the manifest-level run id in load execution.	x	x	x	x	x
source_credentials	Resolved as data source credentials in file load execution.	x	x
source_encryption	Resolved as encryption settings in file load execution.	x
storage_integration	Resolved as the storage integration (Snowflake) or as the external data source (Azure SQL Database) in file load execution.	x		x		x
target_entity_attribute_list	Resolved as a comma-separated list of target entity attributes in file load execution.	x			x	x
target_entity_logical_name	Resolved as the target entity logical name in load execution.	x	x	x	x	x
target_entity_name	Resolved as the target entity name in load execution.	x	x	x	x	x
target_schema	Resolved as the schema of the target entity in load execution.	x	x	x	x	x

Examples

See examples in Using Run ID Logic user guide. OVERRIDE_FILE_LOAD can be used with or without Run ID Logic.

See variable specific examples in the Variables documentation.