airflow.providers.amazon.aws.transfers.sftp_to_s3
¶
Module Contents¶
Classes¶
Transfer files from an SFTP server to Amazon S3. |
- class airflow.providers.amazon.aws.transfers.sftp_to_s3.SFTPToS3Operator(*, s3_bucket, s3_key, sftp_path, sftp_conn_id='ssh_default', s3_conn_id='aws_default', use_temp_file=True, **kwargs)[source]¶
Bases:
airflow.models.BaseOperator
Transfer files from an SFTP server to Amazon S3.
See also
For more information on how to use this operator, take a look at the guide: SFTP to Amazon S3 transfer operator
- Parameters
sftp_conn_id (str) – The sftp connection id. The name or identifier for establishing a connection to the SFTP server.
sftp_path (str) – The sftp remote path. This is the specified file path for downloading the file from the SFTP server.
s3_conn_id (str) – The s3 connection id. The name or identifier for establishing a connection to S3
s3_bucket (str) – The targeted s3 bucket. This is the S3 bucket to where the file is uploaded.
s3_key (str) – The targeted s3 key. This is the specified path for uploading the file to S3.
use_temp_file (bool) – If True, copies file first to local, if False streams file from SFTP to S3.