airflow.providers.apache.cassandra.sensors.record

Module Contents

Classes

CassandraRecordSensor

Checks for the existence of a record in a Cassandra cluster.
class airflow.providers.apache.cassandra.sensors.record.CassandraRecordSensor(*, keys, table, cassandra_conn_id=CassandraHook.default_conn_name, **kwargs)[source]

Bases: airflow.sensors.base.BaseSensorOperator

Checks for the existence of a record in a Cassandra cluster.

See also

For more information on how to use this operator, take a look at the guide: Waiting for a Record to be created

For example, if you want to wait for a record that has values ‘v1’ and ‘v2’ for each primary keys ‘p1’ and ‘p2’ to be populated in keyspace ‘k’ and table ‘t’, instantiate it as follows:

>>> cassandra_sensor = CassandraRecordSensor(
...     table="k.t",
...     keys={"p1": "v1", "p2": "v2"},
...     cassandra_conn_id="cassandra_default",
...     task_id="cassandra_sensor",
... )
Parameters

  • table (str) – Target Cassandra table. Use dot notation to target a specific keyspace.

  • keys (dict[str, str]) – The keys and their values to be monitored

  • cassandra_conn_id (str) – The connection ID to use when connecting to Cassandra cluster

template_fields: Sequence[str] = ('table', 'keys')[source]
poke(context)[source]

Override when deriving this class.

Was this entry helpful?