`airflow.providers.apache.spark.hooks.spark_connect`¶

Module Contents¶

Classes¶

SparkConnectHook

Hook for Spark Connect.

class airflow.providers.apache.spark.hooks.spark_connect.SparkConnectHook(conn_id=default_conn_name)[source]¶

Bases: airflow.hooks.base.BaseHook, airflow.utils.log.logging_mixin.LoggingMixin

Hook for Spark Connect.

PARAM_USE_SSL = 'use_ssl'[source]¶

PARAM_TOKEN = 'token'[source]¶

PARAM_USER_ID = 'user_id'[source]¶

conn_name_attr = 'conn_id'[source]¶

default_conn_name = 'spark_connect_default'[source]¶

conn_type = 'spark_connect'[source]¶

hook_name = 'Spark Connect'[source]¶

classmethod get_ui_field_behaviour()[source]¶

Return custom UI field behaviour for Spark Connect connection.

classmethod get_connection_form_widgets()[source]¶

Return connection widgets to add to Spark Connect connection form.

get_connection_url()[source]¶

Was this entry helpful?