OPT_STORAGE_INTEGRATION
Target database: Snowflake, Azure SQL Database, Azure Synapse SQL, BigQuery
OPT_STORAGE_INTEGRATION is a load option that can be used to define the use of a
Storage integration (Snowflake)
External data source (Azure SQL, Azure Synapse SQL)
External connection (BigQuery)
in a file load.
See also:
Usage
OPT_STORAGE_INTEGRATION: sql_code
Notes
OPT_STORAGE_INTEGRATION can be used in file loads.
OPT_STORAGE_INTEGRATION is also supported in OVERRIDE_FILE_LOAD load steps where it will be resolved in place of the <storage_integration> (or <data_source>) variable.
Examples
Snowflake file load
Storage integration set with OPT_STORAGE_INTEGRATION:
OPT_STORAGE_INTEGRATION: ade_taxi_data
File load executed in Snowflake:
COPY INTO ...
FROM ...
STORAGE_INTEGRATION = ade_taxi_data
FILE_FORMAT = (...);
Azure SQL Database file load
External data source set with OPT_STORAGE_INTEGRATION:
OPT_STORAGE_INTEGRATION: ade_taxi_data
File load executed in Azure SQL Database:
BULK INSERT ...
FROM ...
WITH (DATA_SOURCE = ade_taxi_data, ...);
BigQuery file load
External connection set with OPT_STORAGE_INTEGRATION:
OPT_STORAGE_INTEGRATION: `ade_taxi_data`
File load executed in BigQuery:
LOAD DATA INTO ...
FROM FILES(...)
WITH CONNECTION `ade_taxi_data`;