Content¶
Guides
References
Commits
apache-airflow-providers-apache-pig
¶This is a provider package for apache.pig
provider. All classes for this provider package
are in airflow.providers.apache.pig
python package.
You can install this package on top of an existing Airflow 2 installation (see Requirements
below)
for the minimum Airflow version supported) via
pip install apache-airflow-providers-apache-pig
This release of provider is only available for Airflow 2.3+ as explained in the Apache Airflow providers support policy.
You cannot use pig_properties
any more as connection extras. If you want to add extra parameters
to pig
command, you need to do it via pig_properties
(string list) of the PigCliHook (new parameter)
or via pig_opts
(string with options separated by spaces) or pig_properties
(string list) in
the PigOperator . Any use of pig_properties
extras in connection will raise an exception,
informing that you need to remove them and pass them as parameters.
Both pig_properties
and pig_opts
are now templated fields in the PigOperator.
Pig cli connection properties cannot be passed by connection extra (#27644)
Move min airflow version to 2.3.0 for all providers (#27196)
This release of provider is only available for Airflow 2.2+ as explained in the Apache Airflow providers support policy https://github.com/apache/airflow/blob/main/README.md#support-for-providers
Auto-apply apply_default decorator (#15667)
Warning
Due to apply_default decorator removal, this version of the provider requires Airflow 2.1.0+.
If your Airflow version is < 2.1.0, and you want to install this provider version, first upgrade
Airflow to at least version 2.1.0. Otherwise your Airflow package version will be upgraded
automatically and you will have to manually run airflow upgrade db
to complete the migration.
Updated documentation and readme files.
Initial version of the provider.