airflow.providers.airbyte.triggers.airbyte

Module Contents

Classes

AirbyteSyncTrigger

Triggers Airbyte Sync, makes an asynchronous HTTP call to get the status via a job ID.
class airflow.providers.airbyte.triggers.airbyte.AirbyteSyncTrigger(job_id, conn_id, api_type, end_time, poll_interval)[source]

Bases: airflow.triggers.base.BaseTrigger

Triggers Airbyte Sync, makes an asynchronous HTTP call to get the status via a job ID.

This trigger is designed to initiate and monitor the status of Airbyte Sync jobs. It makes use of asynchronous communication to check the progress of a job run over time.

Parameters

  • conn_id (str) – The connection identifier for connecting to Airbyte.

  • api_type (Literal[config, cloud]) – The type of Airbyte API to use. Either “config” or “cloud”.

  • job_id (int) – The ID of an Airbyte Sync job.

  • end_time (float) – Time in seconds to wait for a job run to reach a terminal status. Defaults to 7 days.

  • poll_interval (float) – polling period in seconds to check for the status.

serialize()[source]

Serialize AirbyteSyncTrigger arguments and classpath.

async run()[source]

Make async connection to Airbyte, polls for the pipeline run status.

async is_still_running(hook)[source]

Async function to check whether the job is submitted via async API.

If job is in running state returns True if it is still running else return False

Was this entry helpful?