airflow.providers.amazon.aws.utils.openlineage

Module Contents

Functions

get_facets_from_redshift_table(redshift_hook, table, ...)

Query redshift for table metadata.

get_identity_column_lineage_facet(field_names, ...)

Get column lineage facet.

airflow.providers.amazon.aws.utils.openlineage.get_facets_from_redshift_table(redshift_hook, table, redshift_data_api_kwargs, schema='public')[source]

Query redshift for table metadata.

SchemaDatasetFacet and DocumentationDatasetFacet (if table has description) will be created.

airflow.providers.amazon.aws.utils.openlineage.get_identity_column_lineage_facet(field_names, input_datasets)[source]

Get column lineage facet.

Simple lineage will be created, where each source column corresponds to single destination column in each input dataset and there are no transformations made.

Was this entry helpful?