This is a provider package for
apache.spark provider. All classes for this provider package
airflow.providers.apache.spark python package.
You can install this package on top of an existing Airflow 2.1+ installation via
pip install apache-airflow-providers-apache-spark
Auto-apply apply_default decorator (#15667)
Due to apply_default decorator removal, this version of the provider requires Airflow 2.1.0+.
If your Airflow version is < 2.1.0, and you want to install this provider version, first upgrade
Airflow to at least version 2.1.0. Otherwise your Airflow package version will be upgraded
automatically and you will have to manually run
airflow upgrade db to complete the migration.
Make SparkSqlHook use Connection (#15794)
Updated documentation and readme files.
Initial version of the provider.