`tests.system.apache.spark.example_spark_dag`¶

Example Airflow DAG to submit Apache Spark applications using SparkSubmitOperator, SparkJDBCOperator and SparkSqlOperator.

Module Contents¶

tests.system.apache.spark.example_spark_dag.ENV_ID[source]¶

tests.system.apache.spark.example_spark_dag.DAG_ID = 'example_spark_operator'[source]¶

tests.system.apache.spark.example_spark_dag.submit_job[source]¶

tests.system.apache.spark.example_spark_dag.test_run[source]¶

Was this entry helpful?