Documentation

Define table with external shell script or command with arguments

external:
  shell: ./import_table.sh --from "{{{db_url.raw}}}" --table "{{{table.db}}}"

or > external: > command: ./import_table.sh > arguments: > - --from "{{{db_url.raw}}}" > - --table "{{{table.db}}}"

Define table with SQL query specified directly in YAML

sql_query:
  query: SELECT * FROM foo

Define table with SQL query specified directly in YAML. vars is an optional object used to specify variables used in mustache interpolation.

sql_file:
  source: some_file.sql
  vars:
    agg: sum

Define table with Explicit DDL to create schema and (optionally) SQL Insert Statements to add data, with ExtendedStatement specified directly in YAML. vars is an optional object used to specify variables used in mustache interpolation. The table will always be recreated if update strategy calls for it, and any existing data on table will be lost.

sql_file_with_schema:
  source: some_file_extended.sql
  vars:
    agg: sum

Insert into a table (or create if non-existent) with SQL query specified directly in YAML. The data is appended to the table, and the table is never truncated. vars is an optional object used to specify variables used in mustache interpolation.

sql_file_insert:
  source: some_file.sql
  vars:
    agg: sum

Insert into a table (or create if non-existent) with explicit DDL to create schema and SQL Insert Statements to add data, with ExtendedStatement specified directly in YAML. The data is appended to the table, and the table is never truncated. vars is an optional object used to specify variables used in mustache interpolation.

sql_file_with_schema_insert:
  source: some_file.sql
  vars:
    agg: sum

Copy a table

copy:
  table: table_to_be_copied
  if_exists: append