Documentation

Assert the relationship between table and another table or constant value

Supported checks: equal, greater_than, greater_than_or_equal, less_than, less_than_or_equal, approximately_equal (relative, absolute – see example below).

assert_count:
  table: target_table
  equal: source_table

assert_count:
  table: target_table
  greater_than_or_equal: 871

Approximate equality:

assert_count:
  table: target_table
  approximately_equal: source_table
  type: relative
  tolerance: 0.01

Define a hook with external shell script or command with arguments

external:
  shell: ./execute_hook.sh --connection "{{{db_url.raw}}}" --table "{{{table.db}}}"

or > external: > command: ./execute_hook.sh > arguments: > - --connection "{{{db_url.raw}}}" > - --table "{{{table.db}}}"

Assert that table has all rows unique in terms of selected columns.

assert_unique:
  table: target_table
  columns: [Artist, Title]

Assert that table have only values within specified set in a certain column

assert_all_values_within:
  table: target_table
  column: target_column
  type: date
  from: 2009-01-01
  to: 2013-12-31

or

assert_all_values_within:
  table: target_table
  column: target_column
  values: [StringOne, StringTwo]

Assert that table have any values within specified set in a certain column

assert_any_values_within:
  table: target_table
  column: target_column
  type: date
  from: 2009-01-01
  to: 2013-12-31

or > assert_any_values_within: > table: target_table > column: target_column > values: [StringOne, StringTwo]

Assert that table have no values within specified set in a certain column

assert_no_values_within:
  table: target_table
  column: target_column
  type: date
  from: 2009-01-01
  to: 2013-12-31

or > assert_no_values_within: > table: target_table > column: target_column > values: [StringOne, StringTwo]

Assert expression is true

assert_expression:
  table: target_table
  expression: AVG(total) = 42
  alias: avg_total

Fail if any of the given expressions/columns have any NULL values.

assert_not_null:
  table: target_table
  columns:
    - zip_code
    - expression: NULLIF(zip_code, '')
      alias: zip_code_not_null

Checks the cardinalities of multiple columns that may be sourced from different tables.

assert_cardinalities:
 table: target_table
 column: column_foo
 equal:
   source_table_foo:
     - column_bar
     - column_baz
   source_table_bar:
     - column_bar

Checks the cardinalities of multiple columns

assert_multiple_columns_cardinalities:
  table: target_table
  columns:
    - column_foo
    - column_thud
  equal:
    table: source_table_foo:
    columns:
      - column_bar
      - column_baz