Amazon S3 to SFTP¶
Use the S3ToSFTPOperator
transfer to copy the data from an Amazon Simple Storage Service (S3) file into a remote file
using SFTP protocol.
For more information about the service visits Amazon Transfer for SFTP API documentation.
Prerequisite Tasks¶
To use these operators, you must do a few things:
Create necessary resources using AWS Console or AWS CLI.
Install API libraries via pip.
pip install 'apache-airflow[amazon]'Detailed information is available Installation of Airflow®
Operators¶
Amazon S3 To SFTP transfer operator¶
This operator loads data from Amazon S3 to a SFTP server.
To get more information about this operator visit:
S3ToSFTPOperator
Example usage:
tests/system/amazon/aws/example_s3_to_sftp.py
create_s3_to_sftp_job = S3ToSFTPOperator(
task_id="create_s3_to_sftp_job",
sftp_path="sftp_path",
s3_bucket=s3_bucket,
s3_key=s3_key,
)