Table Load Options
Last updated
Last updated
Option Definitions:
Load Strategy
Dictates whether to use the default COPY INTO
command or a custom SQL statement for loading the target table.
Truncate Table Option to completely empty the table before loading new data, this is useful when a complete refresh of the table data is required.
CSV File Format
Specifies the Snowflake file format for data loading. Used in the COPY INTO
command for the target table. Defaults to: (TYPE = 'CSV' FIELD_OPTIONALLY_ENCLOSED_BY = '"' SKIP_HEADER = 1)
if left blank.
Custom SQL
Allows a custom SQL query for loading staged files into the target table, bypassing the default COPY INTO
command. Enables advanced data manipulation and transformation during the load.
Replacement Variables for Custom SQL:
${stageFilePath} - the location of the file uploaded
${tableName} - db.schema.table defined for the transfer
${logId} - the log id for the upload
${username} - the snowflake username
Using these variables in the custom sql code will cause the app to replace the variables with what has been defined for the feed. This is useful when adding the user or log id as columns in the target table.