airflow.providers.apache.spark.decorators.pyspark

Module Contents

Functions

pyspark_task([python_callable, multiple_outputs])

Attributes

SPARK_CONTEXT_KEYS

airflow.providers.apache.spark.decorators.pyspark.SPARK_CONTEXT_KEYS = ['spark', 'sc'][source]
airflow.providers.apache.spark.decorators.pyspark.pyspark_task(python_callable=None, multiple_outputs=None, **kwargs)[source]

Was this entry helpful?