Writing logs to Alibaba OSS¶

Remote logging to Alibaba OSS uses an existing Airflow connection to read or write logs. If you don’t have a connection properly setup, this process will fail.

Enabling remote logging¶

To enable this feature, airflow.cfg must be configured as follows:

[logging]
# Airflow can store logs remotely in Alibaba OSS. Users must supply a remote
# location URL (starting with either 'oss://...') and an Airflow connection
# id that provides access to the storage location.
remote_logging = True
remote_base_log_folder = oss://my-bucket/path/to/logs
remote_log_conn_id = oss_default

In the above example, Airflow will try to use OSSHook('oss_default').