airflow.providers.microsoft.azure.triggers.wasb
¶
Module Contents¶
Classes¶
Check for existence of the given blob in the provided container. |
|
Check for the existence of a blob with the given prefix in the provided container. |
- class airflow.providers.microsoft.azure.triggers.wasb.WasbBlobSensorTrigger(container_name, blob_name, wasb_conn_id='wasb_default', public_read=False, poke_interval=5.0)[source]¶
Bases:
airflow.triggers.base.BaseTrigger
Check for existence of the given blob in the provided container.
WasbBlobSensorTrigger is fired as deferred class with params to run the task in trigger worker.
- Parameters
container_name (str) – name of the container in which the blob should be searched for
blob_name (str) – name of the blob to check existence for
wasb_conn_id (str) – the connection identifier for connecting to Azure WASB
poke_interval (float) – polling period in seconds to check for the status
public_read (bool) – whether an anonymous public read access should be used. Default is False
- class airflow.providers.microsoft.azure.triggers.wasb.WasbPrefixSensorTrigger(container_name, prefix, wasb_conn_id='wasb_default', check_options=None, public_read=False, poke_interval=5.0)[source]¶
Bases:
airflow.triggers.base.BaseTrigger
Check for the existence of a blob with the given prefix in the provided container.
WasbPrefixSensorTrigger is fired as a deferred class with params to run the task in trigger.
- Parameters
container_name (str) – name of the container in which the blob should be searched for
prefix (str) – prefix of the blob to check existence for
include – specifies one or more additional datasets to include in the response. Options include:
snapshots
,metadata
,uncommittedblobs
,copy
,deleted
delimiter – filters objects based on the delimiter (for e.g ‘.csv’)
wasb_conn_id (str) – the connection identifier for connecting to Azure WASB
check_options (dict | None) – Optional keyword arguments that WasbAsyncHook.check_for_prefix_async() takes.
public_read (bool) – whether an anonymous public read access should be used. Default is False
poke_interval (float) – polling period in seconds to check for the status