airflow.providers.apache.livy.sensors.livy

This module contains the Apache Livy sensor.

Module Contents

Classes

LivySensor

Monitor a Livy sessions for termination.
class airflow.providers.apache.livy.sensors.livy.LivySensor(*, batch_id, livy_conn_id='livy_default', livy_conn_auth_type=None, extra_options=None, **kwargs)[source]

Bases: airflow.sensors.base.BaseSensorOperator

Monitor a Livy sessions for termination.

Parameters

  • livy_conn_id (str) – reference to a pre-defined Livy connection

  • batch_id (int | str) – identifier of the monitored batch depends on the option that’s being modified.

template_fields: Sequence[str] = ('batch_id',)[source]
get_hook()[source]

Get valid hook.

Returns

hook

Return type

airflow.providers.apache.livy.hooks.livy.LivyHook

poke(context)[source]

Override when deriving this class.

Was this entry helpful?