Package apache-airflow-providers-google¶

Google services including:

Google Ads

Google Cloud (GCP)

Google Firebase

Google LevelDB

Google Marketing Platform

Google Workspace (formerly Google Suite)

This is detailed commit list of changes for versions provider package: google. For high-level changelog, see package information including changelog.

8.4.0¶

Latest change: 2022-10-01

Commit	Committed	Subject
fa0cb363b8	2022-10-01	`Correcting the transfer config name. (#25719)`
cee610ae5c	2022-10-01	`Fix parsing of optional 'mode' field in BigQuery Result Schema (#26786)`
b7203cd36e	2022-10-01	`Fix MaxID logic for GCSToBigQueryOperator (#26768)`
f8db64c35c	2022-09-28	`Update docs for September Provider's release (#26731)`
dce27557eb	2022-09-28	`Fix GCS sensor system tests failing with DebugExecutor (#26742)`
26f94c5370	2022-09-26	`Cloud Data Loss Prevention Operators assets (#26618)`
01ac40af75	2022-09-22	`Update gcs.py (#26570)`
e61d823f18	2022-09-21	`Cloud Storage Transfer Operators assets & system tests migration (AIP-47) (#26072)`
a60e3b9317	2022-09-21	`Migrate Data Loss Prevention system tests according to AIP-47 (#26060)`
c4256ca1a0	2022-09-21	`Add BigQuery Column and Table Check Operators (#26368)`
4c33f6bcf5	2022-09-20	`Merge deferrable BigQuery operators to exisitng one (#26433)`
8e98b1c6df	2022-09-20	`Google Drive to Google Cloud Storage Transfer Operator - system tests migration (AIP-47) (#26487)`
e315900396	2022-09-20	`specifying project id when calling wait_for_operation in delete/create cluster (#26418)`
6045f7ad69	2022-09-19	`Cloud Functions Operators assets & system tests migration (AIP-47) (#26073)`
1f7b296227	2022-09-18	`Auto tail file logs in Web UI (#26169)`
07fe356de0	2022-09-18	`GCSToBigQueryOperator Resolve 'max_id_key' job retrieval and xcom return (#26285)`
b4f8a069f0	2022-09-18	`Allow for the overriding of 'stringify_dict' for json export format on BaseSQLToGCSOperator (#26277)`
706a618014	2022-09-18	`Append GoogleLink base in the link class (#26057)`
97b144fbed	2022-09-18	`Fix JSONDecodeError in Datafusion operators (#26202)`
9444d9789b	2022-09-14	`Work around pyupgrade edge cases (#26384)`
d67ac5932d	2022-09-14	`Apply PEP-563 (Postponed Evaluation of Annotations) to core airflow (#26290)`
06acf40a43	2022-09-13	`Apply PEP-563 (Postponed Evaluation of Annotations) to non-core airflow (#26289)`
23ad7e292a	2022-09-10	`Cloud Video Intelligence Operators assets & system tests migration (AIP-47) (#26132)`
3a539ff663	2022-09-09	`Life Science assets & system tests migration (AIP-47) (#25548)`
5066844513	2022-09-09	`D400 first line should end with period batch02 (#25268)`
f938cd4fc8	2022-09-08	`Add deferrable big query operators and sensors (#26156)`
8cac96918b	2022-09-07	`GCSToBigQueryOperator allow for schema_object in alternate GCS Bucket (#26190)`
12cbc0f1dd	2022-09-07	`Don't throw an exception when a BQ cusor job has no schema (#26096)`
8acdc2a834	2022-08-30	`Replace SQL with Common SQL in pre commit (#26058)`
1d06374194	2022-08-30	`Hook into Mypy to get rid of those cast() (#26023)`
da8f133053	2022-08-29	`Use AsyncClient for Composer Operators in deferrable mode (#25951)`
1ed014647e	2022-08-29	`Add 'output' property to MappedOperator (#25604)`
d4eb60712d	2022-08-27	`Use project_id to get authenticated client (#25984)`
4c3fb1ff2b	2022-08-27	`Google Cloud Tasks Sensor for queue being empty (#25622)`
c81178063a	2022-08-27	`Cloud Build assets & system tests migration (AIP-47) (#25895)`
62a46c1e18	2022-08-27	`Added append_job_name parameter to DataflowTemplatedJobStartOperator (#25746)`
15b49add28	2022-08-23	`Sql to GSC operators update docs for parquet format (#25878)`
25a9ae3b2e	2022-08-23	`Limit Google Protobuf for compatibility with biggtable client (#25886)`
ecf0460b7d	2022-08-22	`Dataproc submit job operator async (#25302)`
fc6dfa338a	2022-08-20	`Support project_id argument in BigQueryGetDataOperator (#25782)`
6e66dd7776	2022-08-19	`Make GoogleBaseHook credentials functions public (#25785)`
6e41c7eb33	2022-08-16	`Fixed never ending loop to in CreateWorkflowInvocation (#25737)`
6c5b0776c0	2022-08-14	`Adding a parameter for exclusion of trashed files in GoogleDriveHook (#25675)`
1b412c9cbe	2022-08-10	`Consolidate to one 'schedule' param (#25410)`

8.3.0¶

Latest change: 2022-08-10

Commit	Committed	Subject
e5ac6c7cfb	2022-08-10	`Prepare docs for new providers release (August 2022) (#25618)`
2e2d4bffd5	2022-08-09	`Dataform operators (#25587)`
c8c4a42723	2022-08-08	`Fix GCSListObjectsOperator docstring (#25614)`
029e3ae96f	2022-08-05	`Remove deprecated modules (#25543)`
7d2c2ee879	2022-08-04	`add description method in BigQueryCursor class (#25366)`
e84d753015	2022-08-04	`Fix BigQueryInsertJobOperator cancel_on_kill (#25342)`
803c0e252f	2022-08-03	`Fix BaseSQLToGCSOperator approx_max_file_size_bytes (#25469)`
faf3c4fe47	2022-08-02	`Fix PostgresToGCSOperat bool dtype (#25475)`
c8cacad4d6	2022-08-02	`Migrate Google example trino_to_gcs to new design AIP-47 (#25420)`
d2900022a2	2022-08-02	`Migrate Google example automl_nl_text_extraction to new design AIP-47 (#25418)`
acab8f52dd	2022-07-29	`Move all "old" SQL operators to common.sql providers (#25350)`
f6b48ac6df	2022-07-28	`Memorystore assets & system tests migration (AIP-47) (#25361)`
f4b93cc097	2022-07-28	`Translate system tests migration (AIP-47) (#25340)`
a8e4519815	2022-07-28	`Fix Vertex AI Custom Job training issue (#25367)`
5d4abbd58c	2022-07-27	`Deprecate hql parameters and synchronize DBApiHook method APIs (#25299)`
8bc147192c	2022-07-27	`Fix Flask Login user setting for Flask 2.2 and Flask-Login 0.6.2 (#25318)`
28db8c10b2	2022-07-26	`Migrate Google example life_sciences to new design AIP-47 (#25264)`
10c9a3697a	2022-07-26	`Migrate Google example natural_language to new design AIP-47 (#25262)`
b288bf4da4	2022-07-26	`Delete redundant system test bigquery_to_bigquery (#25261)`
c8af0592c0	2022-07-26	`Improve taskflow type hints with ParamSpec (#25173)`
df00436569	2022-07-22	`Unify DbApiHook.run() method with the methods which override it (#23971)`
66b3ca1d28	2022-07-21	`Migrate Google example bigquery_to_mssql to new design AIP-47 (#25174)`
9644451676	2022-07-19	`Migrate Google example compute_igm to new design AIP-47 (#25132)`
3a80b36ed9	2022-07-19	`Migrate Google example automl_vision to new design AIP-47 (#25152)`
c0ce8a8375	2022-07-18	`Migrate Google example gcs_to_sftp to new design AIP-47 (#25107)`
e32e9c5880	2022-07-18	`Bump typing-extensions and mypy for ParamSpec (#25088)`
4473b27d08	2022-07-16	`Migrate Google campaign manager example to new design AIP-47 (#25069)`
9b7e4a7324	2022-07-16	`Migrate Google analytics example to new design AIP-47 (#25006)`
77626b7fc8	2022-07-13	`Add project_id as a templated variable in two BQ operators (#24768)`

8.2.0¶

Latest change: 2022-07-13

Commit	Committed	Subject
d2459a241b	2022-07-13	`Add documentation for July 2022 Provider's release (#25030)`
93992f2361	2022-07-12	`PubSub assets & system tests migration (AIP-47) (#24867)`
a13c51e224	2022-07-12	`Migrate Google sheets example to new design AIP-47 (#24975)`
a038b52b5a	2022-07-12	`Migrate Google ads example to new design AIP-47 (#24941)`
c618da444e	2022-07-12	`Modify BigQueryCreateExternalTableOperator to use updated hook function (#24363)`
626d9db290	2022-07-12	`Migrate Google example gcs_to_gdrive to new design AIP-47 (#24949)`
fb51e04cfd	2022-07-12	`Migrate Google firestore example to new design AIP-47 (#24830)`
b777514253	2022-07-12	`Add handling state of existing Dataproc batch (#24924)`
acaa0635c8	2022-07-08	`Automatically detect if non-lazy logging interpolation is used (#24910)`
fb7162418e	2022-07-07	`Add links for Google Kubernetes Engine operators (#24786)`
46bbfdade0	2022-07-07	`Move all SQL classes to common-sql provider (#24836)`
80b6754746	2022-07-06	`Migrate Google example sql_to_sheets to new design AIP-47 (#24814)`
3b35325840	2022-07-06	`Add test_connection method to 'GoogleBaseHook' (#24682)`
96b01a8012	2022-07-05	`Remove "bad characters" from our codebase (#24841)`
9227d56e68	2022-07-04	`Datacatalog assets & system tests migration (AIP-47) (#24600)`
fe13eae3bf	2022-07-04	`perf(BigQuery): pass table_id as str type (#23141)`
37ea530cb7	2022-07-04	`Migrate Google example DAG mssql_to_gcs to new design AIP-47 (#24541)`
46ac083f7e	2022-07-01	`Align Black and blacken-docs configs (#24785)`
0de31bd73a	2022-06-29	`Move provider dependencies to inside provider folders (#24672)`
45b11d4ed1	2022-06-29	`Use our yaml util in all providers (#24720)`
510a6bab45	2022-06-28	`Remove 'hook-class-names' from provider.yaml (#24702)`
7a7ca50160	2022-06-28	`Migrate Google example DAG s3_to_gcs to new design AIP-47 (#24641)`
abb304c92f	2022-06-25	`Migrate Google example DAG bigquery_transfer to new design AIP-47 (#24543)`
ded22eb5b6	2022-06-24	`Add gcp_conn_id argument to GoogleDriveToLocalOperator (#24622)`
e2f19505bf	2022-06-22	`Upgrade FAB to 4.1.1 (#24399)`
9c59831ee7	2022-06-21	`Update providers to use functools compat for ''cached_property'' (#24582)`
88ddf65708	2022-06-20	`Migrate Google example DAG oracle_to_gcs to new design AIP-47 (#24542)`
32fc4be502	2022-06-20	`Migrate Google example DAG mysql_to_gcs to new design AIP-47 (#24540)`
a35f342833	2022-06-20	`Migrate Google search_ads DAG to new design AIP-47 (#24298)`
e7a1c50d62	2022-06-20	`GCSDeleteObjectsOperator empty prefix bug fix (#24353)`
dd35fdaf35	2022-06-20	`Migrate Google gcs_to_sheets DAG to new design AIP-47 (#24501)`
0561c1aac4	2022-06-19	`Add DeprecationWarning for column_transformations parameter in AutoML (#24467)`

8.1.0¶

Latest change: 2022-06-15

Commit	Committed	Subject
952a5ea8d8	2022-06-15	`Update release docs for Google and Oracle providers (#24461)`
ce50d3731a	2022-06-15	`Use insert_job in the BigQueryToGCPOpertor and adjust links (#24416)`
2a084ee8d7	2022-06-14	`Update Oracle library to latest version (#24311)`
69c46252dd	2022-06-14	`fix typo in google provider additional extras (#24431)`
08b675cf66	2022-06-13	`Fix links to sources for examples (#24386)`
94257f48f4	2022-06-13	`Expose SQL to GCS Metadata (#24382)`
8e0bddaea6	2022-06-12	`Deprecate remaining occurrences of 'bigquery_conn_id' in favor of 'gcp_conn_id' (#24376)`
6eb60f816c	2022-06-12	`Migrate Google calendar example DAG to new design AIP-47 (#24333)`
bc3fc8c9fc	2022-06-12	`Migrate Google azure_fileshare example DAG to new design AIP-47 (#24349)`
6ab02b69a0	2022-06-12	`Remove bigquery example already migrated to AIP-47 (#24379)`
cb90ca7afb	2022-06-12	`Migrate Google sheets example DAG to new design AIP-47 (#24351)`

8.0.0¶

Latest change: 2022-06-09

Commit	Committed	Subject
dcdcf3a2b8	2022-06-09	`Update release notes for RC2 release of Providers for May 2022 (#24307)`
047a6162b0	2022-06-08	`Workaround job race bug on biguery to gcs transfer (#24330)`
717a7588bc	2022-06-07	`Update package description to remove double min-airflow specification (#24292)`
b1ad017cee	2022-06-07	`pydocstyle D202 added (#24221)`
aeabe994b3	2022-06-07	`Prepare docs for May 2022 provider's release (#24231)`
c3a9ef1ada	2022-06-07	`AIP-47 - Migrate google leveldb DAGs to new design ##22447 (#24233)`
c23826915d	2022-06-07	`Apply per-run log templates to log handlers (#24153)`
80c1ce76e1	2022-06-06	`Cloud Storage assets & StorageLink update (#23865)`
ec84ffe71c	2022-06-06	`Fix GCSToGCSOperator cannot copy a single file/folder without copying other files/folders with that prefix (#24039)`
027b707d21	2022-06-05	`Add explanatory note for contributors about updating Changelog (#24229)`
55fd02a389	2022-06-04	`Add key_secret_project_id parameter which specifies a project with KeyFile (#23930)`
90233bc7cb	2022-06-04	`Added impersonation_chain for DataflowStartFlexTemplateOperator and DataflowStartSqlJobOperator (#24046)`
c01a5a50b4	2022-06-04	`Fix BigQuery system tests (#24013)`
a597a76e8f	2022-06-03	`fix BigQueryInsertJobOperator (#24165)`
e13b15946e	2022-06-03	`Workflows assets & system tests migration (AIP-47) (#24105)`
368f292ca1	2022-06-03	`Update credentials when using ADC in Compute Engine (#23773)`
96e8fb4a07	2022-06-01	`Fix the link to google workplace (#24080)`
3dd7b1ddba	2022-06-01	`set color to operators in cloud_sql.py (#24000)`
841ed27101	2022-06-01	`Spanner assets & system tests migration (AIP-47) (#23957)`
fedab9d64a	2022-06-01	`Remove hack from BigQuery DTS hook (#23887)`
e58985598f	2022-05-30	`Ensure @contextmanager decorates generator func (#23103)`
92ddcf4ac6	2022-05-27	`Introduce 'flake8-implicit-str-concat' plugin to static checks (#23873)`
ec6761a5c0	2022-05-23	`Clean up f-strings in logging calls (#23597)`
65f3b18fc1	2022-05-22	`Sql to gcs with exclude columns (#23695)`
a43e98d050	2022-05-22	`Fix DataprocJobBaseOperator not being compatible with dotted names (#23439). (#23791)`
5bfacf81c6	2022-05-20	`[Issue#22846] allow option to encode or not encode UUID when uploading from Cassandra to GCS (#23766)`
f60fa98a2e	2022-05-19	`Cloud SQL assets & system tests migration (AIP-47) (#23583)`
d3b0880286	2022-05-17	`Speech To Text assets & system tests migration (AIP-47) (#23643)`
3bf9a1df38	2022-05-16	`Add fields to CLOUD_SQL_EXPORT_VALIDATION. (#23724)`
bc0dcddfb5	2022-05-12	`Migrate Dataproc to new system tests design (#22777)`

7.0.0¶

Latest change: 2022-05-12

Commit	Committed	Subject
75c60923e0	2022-05-12	`Prepare provider documentation 2022.05.11 (#23631)`
cd49a8b9f6	2022-05-11	`[FEATURE] google provider - BigQueryInsertJobOperator log query (#23648)`
60a1d9d191	2022-05-10	`[FEATURE] google provider - split GkeStartPodOperator execute (#23518)`
74557e41e3	2022-05-10	`Add exportContext.offload flag to CLOUD_SQL_EXPORT_VALIDATION. (#23614)`
428a439953	2022-05-09	`Clean up in-line f-string concatenation (#23591)`
766726f2e3	2022-05-09	`Fix 'PostgresToGCSOperator' does not allow nested JSON (#23063)`
82c244f9c7	2022-05-08	`Fix GCSToGCSOperator ignores replace parameter when there is no wildcard (#23340)`
627b5698ec	2022-05-04	`Add Stackdriver assets and migrate system tests to AIP-47 (#23320)`
3977e1798d	2022-05-04	`CloudTasks assets & system tests migration (AIP-47) (#23282)`
dfe0f75938	2022-05-04	`TextToSpeech assets & system tests migration (AIP-47) (#23247)`
2d109401b3	2022-05-04	`Bump pre-commit hook versions (#22887)`
427e14b763	2022-05-03	`Fix code-snippets in google provider (#23438)`
fa0cc7cec7	2022-05-02	`Cleanup Google provider CHANGELOG.rst (#23390)`
3f6d5eef42	2022-05-01	`'DataprocHook': Remove deprecated function 'submit' (#23389)`
511d0ee256	2022-04-30	`Bigquery assets (#23165)`
3f9845095e	2022-04-29	`Remove redundant docstring in 'BigQueryUpdateTableSchemaOperator' (#23349)`
0fcdc5e1fb	2022-04-29	`'S3ToGCSOperator': Remove 'dest_gcs_conn_id' (#23348)`
05ccfd42f2	2022-04-29	`Dataproc: Remove default value of 'region' (#23350)`
359dc58207	2022-04-29	`Google provider: Remove 'bigquery_conn_id', 'google_cloud_storage_conn_id' (#23326)`
c82b3b9466	2022-04-28	`'GCSFileTransformOperator': New templated fields 'source_object', 'destination_object' (#23328)`
9449a107f0	2022-04-28	`'DatastoreHook': Remove 'datastore_conn_id' (#23323)`
1f32603549	2022-04-28	`update processor to fix broken download URLs (#23299)`
8a7b61a8e4	2022-04-28	`Migrate gcs to new system tests design (#22778)`
72e2ea68a1	2022-04-27	`'CloudBuildCreateBuildOperator': Remove deprecated 'body' parameter (#23263)`
6cf0176f2a	2022-04-27	`Remove deprecated parameters from PubSub operators: (#23261)`
4d9c55c9d9	2022-04-27	`Remove deprecated parameters from BigQueryHook: (#23269)`
915b0c689e	2022-04-27	`add missing docstring in 'BigQueryHook.create_empty_table' (#23270)`
710eb6f3e6	2022-04-26	`* 'CloudDatastoreImportEntitiesOperator' : Remove 'xcom_push'. Please use 'BaseOperator.do_xcom_push' (#23252)`
2d569fdaf0	2022-04-26	`Create links for Biqtable operators (#23164)`
434ab5a03c	2022-04-26	`'BigtableCreateInstanceOperator' & 'BigtableHook.create_instance' Remove 'replica_cluster_id', 'replica_cluster_zone'. (#23251)`
5ca1f3bf70	2022-04-26	`Dataproc : remove 'location' in favor of 'region' (#23250)`
1416ac4195	2022-04-26	`'PubSubPullSensor': Remove 'project' and 'return_immediately' (#23231)`
06dfc2536c	2022-04-26	`Remove deprecated 'params' from google operators (#23230)`
37a7b27242	2022-04-26	`'LookerStartPdtBuildOperator', 'LookerCheckPdtBuildSensor' : fix empty materialization id handling (#23025)`
967140e6c3	2022-04-25	`Add location support to BigQueryDataTransferServiceTransferRunSensor.`
d6094e58ba	2022-04-25	`Fix static checks`
22ea28f23e	2022-04-25	`Remove run_in_gke_cluster flag`
c46d04eb2d	2022-04-25	`Create system test for K8s and dataproc operators`
35cbc89c3a	2022-04-25	`Create Dataproc operators for GKE`
27ad3b7827	2022-04-25	`Remove 'GCSObjectsWtihPrefixExistenceSensor'`
544d658921	2022-04-25	`Change CloudDatastoreExportEntitiesLink to StorageLink`
b3cc2f5d10	2022-04-25	`Fix pre-commit check`
43ded6c877	2022-04-25	`Add links for Cloud Datastore operators`
de65a5cc5a	2022-04-25	`Support serviceAccount attr for dataflow in the Apache beam`
76dc7375b2	2022-04-25	`Migrate Datastore system tests to new design (AIP-47)`
0373fb0247	2022-04-25	`'GoogleDriveToGCSOperator': Remove 'destination_bucket' and 'destination_object'`
6b459995b2	2022-04-25	`Add the format of Vertex Endpoint ID to the docstrings`
27af0b7ebe	2022-04-25	`Add the new parameter to the docstring`
48abf571be	2022-04-25	`Add 'endpoint_id' arg to 'google.cloud.operators.vertex_ai.CreateEndpointOperator'`
8b6b0848a3	2022-04-23	`Use new Breese for building, pulling and verifying the images. (#23104)`
07a13bb708	2022-04-21	`Change ComputeSSH to throw provider import error instead paramiko (#23035)`
c36bcc4c06	2022-04-15	`Upgrade to support Google Ads v10 (#22965)`
ea1ae1963e	2022-04-14	`Fix cancel_on_kill after execution timeout for DataprocSubmitJobOperator (#22955)`
9a623e94cb	2022-04-13	`migrate system test gcs_to_bigquery into new design (#22753)`
aa317d92ea	2022-04-13	`Fix select * query xcom push for BigQueryGetDataOperator (#22936)`
27b3e31178	2022-04-11	`implements #22859 - Add .sql as templatable extension (#22920)`
03e1c9b152	2022-04-11	`MSSQLToGCSOperator fails: datetime is not JSON Serializable (#22882)`
6933022e94	2022-04-10	`Fix new MyPy errors in main (#22884)`
6aa65a38e0	2022-04-08	`Add example DAG for demonstrating usage of GCS sensors (#22808)`

6.8.0¶

Latest change: 2022-04-07

Commit	Committed	Subject
56ab82ed7a	2022-04-07	`Prepare mid-April provider documentation. (#22819)`
838cf401b9	2022-04-06	`Fail ''LocalFilesystemToGCSOperator'' if src does not exist (#22772)`
99b0211d50	2022-04-04	`Modify transfer operators to handle more data (#22495)`
f9e18472c0	2022-04-04	`Add autodetect arg in BQCreateExternalTable Operator (#22710)`
327eab3e26	2022-03-31	`Add links for BigQuery Data Transfer (#22280)`
02976bef88	2022-03-27	`Refactor: BigQuery to GCS Operator (#22506)`
719135ade0	2022-03-27	`Remove references to deprecated operators/params in PubSub operators (#22519)`
ca4b8d1744	2022-03-27	`Create Endpoint and Model Service, Batch Prediction and Hyperparameter Tuning Jobs operators for Vertex AI service (#22088)`
388723950d	2022-03-27	`PostgresToGoogleCloudStorageOperator - BigQuery schema type for time zone naive fields (#22536)`
c063fc688c	2022-03-25	`Update black precommit (#22521)`
3c7cd47319	2022-03-25	`New design of system tests (#22311)`
7ab45d41d6	2022-03-24	`Update secrets backends to use get_conn_value instead of get_conn_uri (#22348)`
d231e9b448	2022-03-24	`Remove coerce_datetime usage from GCSTimeSpanFileTransformOperator (#22501)`
82a26c0591	2022-03-24	`Fix the docstrings (#22497)`
38fde2ea79	2022-03-23	`Fix 'download_media' url in 'GoogleDisplayVideo360SDFtoGCSOperator' (#22479)`
0f0a1a7d22	2022-03-23	`Fix to 'CloudBuildRunBuildTriggerOperator' fails to find build id. (#22419)`

6.7.0¶

Latest change: 2022-03-22

Commit	Committed	Subject
d7dbfb7e26	2022-03-22	`Add documentation for bugfix release of Providers (#22383)`
7b851edc91	2022-03-21	`Add 'LocalFilesystemToGoogleDriveOperator' (#22219)`
14e6b657c2	2022-03-21	`Add timeout and retry to the BigQueryInsertJobOperator (#22395)`
a3ffbee7c9	2022-03-20	`Fix skipping non-GCS located jars (#22302)`
88402038ca	2022-03-19	`Add dataflow_default_options to templated_fields (#22367)`
6448b2458c	2022-03-15	`[FIX] typo doc of gcs operator (#22290)`

6.6.0¶

Latest change: 2022-03-14

Commit	Committed	Subject
16adc035b1	2022-03-14	`Add documentation for Classifier release for March 2022 (#22226)`
87c1246b79	2022-03-14	`Add Dataplex operators (#20377)`
c1ab8e2d7b	2022-03-14	`Protect against accidental misuse of XCom.get_value() (#22244)`
c108f264ab	2022-03-13	`Change the default 'chunk_size' to a clear representation & add documentation (#22222)`
45435399fe	2022-03-13	`Support Uploading Bigger Files to Google Drive (#22179)`
42a891d605	2022-03-13	`Update ''GKEDeleteClusterOperator', ''GKECreateClusterOperator'' docstrings (#22212)`
d08284ed25	2022-03-11	`` Add map_index to XCom model and interface (#22112)``
828d1cba4d	2022-03-10	`Add support for ARM platform (#22127)`
4ac771c316	2022-03-09	`Fix spelling (#22107)`
dd0724fdd2	2022-03-08	`Add guide for DataprocInstantiateInlineWorkflowTemplateOperator (#22062)`
dfd9805a23	2022-03-08	`Use yaml safe load (#22091)`
eba9703751	2022-03-08	`Revert "Use yaml safe load (#22085)" (#22089)`
7f4935bab3	2022-03-08	`Use yaml safe load (#22085)`
a11d831e3f	2022-03-07	`Allow for uploading metadata with GCS Hook Upload (#22058)`

6.5.0¶

Latest change: 2022-03-07

Commit	Committed	Subject
f5b96315fe	2022-03-07	`Add documentation for Feb Providers release (#22056)`
6db9b0029b	2022-03-07	`Add Looker PDT operators (#20882)`
9020b3a89d	2022-03-06	`Add autodetect arg to external table creation in GCSToBigQueryOperator (#21944)`
a0e2ebaa27	2022-03-02	`Unpin 'google-cloud-memcache' (#21912)`
84ed747db8	2022-03-02	`Unpin ''pandas-gbq'' and remove unused code (#21915)`
fb6b2d1fee	2022-03-01	`Make project_id argument optional in all dataproc operators (#21866)`
08575ddd8a	2022-03-01	`Change BaseOperatorLink interface to take a ti_key, not a datetime (#21798)`
6ca118dff1	2022-03-01	`Allow templates in more DataprocUpdateClusterOperator fields (#21865)`
0c55ca2cda	2022-02-28	`Suppress hook warnings from the Bigquery transfers (#20119)`
73eb24f25c	2022-02-24	`Fix bigquery_dts parameter docstring typo (#21786)`
3b4c26eb3a	2022-02-23	`Add Dataproc assets/links (#21756)`
6061cc4219	2022-02-20	`Add Auto ML operators for Vertex AI service (#21470)`
295efd36ea	2022-02-17	`Dataflow Assets (#21639)`
af2c047320	2022-02-16	`Add GoogleCalendarToGCSOperator (#20769)`
1b568d73e1	2022-02-15	`Extract ClientInfo to module level (#21554)`
dc03000de8	2022-02-15	`Datafusion assets (#21518)`
56365b102c	2022-02-15	`Dataproc metastore assets (#21267)`
6692e9191d	2022-02-15	`Normalize *_conn_id parameters in BigQuery sensors (#21430)`
2eb10565b2	2022-02-15	`Fixed PostgresToGCSOperator fail on empty resultset for use_server_side_cursor=True (#21307)`
da1e6578e0	2022-02-15	`Fix multi query scenario in bigquery example DAG (#21575)`

6.4.0¶

Latest change: 2022-02-14

Commit	Committed	Subject
28378d867a	2022-02-14	`Add documentation for RC3 release of providers for Jan 2022 (#21553)`
6bb0857df9	2022-02-13	`(providers_google) add a location check in bigquery (#19571)`
6579648af2	2022-02-13	`Fix bigquery-hook when no engine_kwargs are passed`
da485da29a	2022-02-13	`Add support for BeamGoPipelineOperator (#20386)`
05a883b35e	2022-02-11	`Google Cloud Composer opearators (#21251)`
833087f4f9	2022-02-10	`Enable asynchronous job submission in BigQuery hook (#21385)`
51aff276ca	2022-02-10	`Optionally raise an error if source file does not exist in GCSToGCSOperator (#21391)`
07fe9e8c6a	2022-02-09	`Never set DagRun.state to State.NONE (#21263)`
0a3ff43d41	2022-02-08	`Add pre-commit check for docstring param types (#21398)`
d94fa37830	2022-02-08	`Fixed changelog for January 2022 (delayed) provider's release (#21439)`
e973740208	2022-02-08	`Create CustomJob and Datasets operators for Vertex AI service (#21253)`
34d63fabc0	2022-02-08	`Fix BigQueryDataTransferServiceHook.get_transfer_run() request parameter (#21293)`
6b88d432d9	2022-02-06	`Support to upload file to Google Shared Drive (#21319)`
1a77bc6481	2022-02-06	`:bug: (BigQueryHook) fix compatibility with sqlalchemy engine (#19508)`
6c3a67d4fc	2022-02-05	`Add documentation for January 2021 providers release (#21257)`
39e395f981	2022-02-04	`Add more SQL template fields renderers (#21237)`
e840acf8d1	2022-02-04	`Fix BigQuery system test (#21320)`
ddb5246bd1	2022-02-03	`Refactor operator links to not create ad hoc TaskInstances (#21285)`
1d4b709e20	2022-01-28	`Revert "Create CustomJob and Datasets operators for Vertex AI service (#20077)" (#21203)`
48d44b885b	2022-01-28	`Cloudsql import links fix. (#21199)`
640c0b6763	2022-01-28	`Create CustomJob and Datasets operators for Vertex AI service (#20077)`
cb73053211	2022-01-27	`Add optional features in providers. (#21074)`
60aa518ebf	2022-01-26	`batch as templated field in DataprocCreateBatchOperator (#20905)`
623163f16a	2022-01-25	`Extend dataproc example dag (#21091)`
86ef016eab	2022-01-23	`Make timeout Optional for wait_for_operation (#20981)`
506efb6fa3	2022-01-21	`Squelch more deprecation warnings (#21003)`
372849486c	2022-01-21	`Fix last google provider MyPy errors (#21010)`
73c0d241d8	2022-01-21	`Remove a few stray ':type's in docs (#21014)`
602abe8394	2022-01-20	`Remove ':type' lines now sphinx-autoapi supports typehints (#20951)`
b8526abc2c	2022-01-19	`Add encoding parameter to 'GCSToLocalFilesystemOperator' to fix #20901 (#20919)`
58452f97db	2022-01-03	`Add hook for integrating with Google Calendar (#20542)`

6.3.0¶

Latest change: 2021-12-31

Commit	Committed	Subject
f77417eb0d	2021-12-31	`Fix K8S changelog to be PyPI-compatible (#20614)`
97496ba2b4	2021-12-31	`Update documentation for provider December 2021 release (#20523)`
a22d5bd076	2021-12-31	`Fix mypy errors in Google Cloud provider (#20611)`
4233ebe5ce	2021-12-31	`Fix setting of project ID in ''provide_authorized_gcloud'' (#20428)`
83f8e178ba	2021-12-31	`Even more typing in operators (template_fields/ext) (#20608)`
746ee587da	2021-12-31	`Delete pods by default in KubernetesPodOperator (#20575)`
41dbe2c4fc	2021-12-30	`Fix mypy errors in google/cloud/operators/stackdriver (#20601)`
dda688776c	2021-12-30	`Fix Google mlengine MyPy errors (#20569)`
d56e7b56bb	2021-12-30	`Fix template_fields type to have MyPy friendly Sequence type (#20571)`
bd9e8cef26	2021-12-30	`Fix Google Mypy Dataproc errors (#20570)`
a6e60ce25d	2021-12-30	`Change download_video parameter to resourceName (#20528)`
af4a2b0240	2021-12-30	`Fix big query to mssql/mysql transfer issues (#20001)`
a0821235fb	2021-12-30	`Use typed Context EVERYWHERE (#20565)`
da88ed1943	2021-12-29	`Fix MyPy errors in Google Cloud (again) (#20469)`
3a480f5ff4	2021-12-29	`Fix passing the gzip compression parameter on sftp_to_gcs. (#20553)`
bfd6d45cec	2021-12-29	`switch to follow_redirects on httpx.get call in CloudSQL provider (#20239)`
7d4d38b546	2021-12-29	`avoid deprecation warnings in BigQuery transfer operators (#20502)`
b7086f9815	2021-12-28	`Use Python3.7+ syntax in pyupgrade (#20501)`
a4622e19fa	2021-12-22	`Support regional GKE cluster (#18966)`
2ffdcf4b41	2021-12-21	`Fixes docstring for PubSubCreateSubscriptionOperator (#20237)`
d4c4f9e09e	2021-12-21	`Fix mypy errors for google.cloud_build (#20234)`
c6dbb3f885	2021-12-21	`Fix MyPy for Google Bigquery (#20329)`
ed604b62f3	2021-12-18	`Fix remaining MyPy errors in Google Provider (#20358)`
17404f1f10	2021-12-16	`Move source_objects datatype check out of GCSToBigQueryOperator.__init__ (#20347)`
174681911f	2021-12-16	`Fix MyPy Errors for dataproc package (#20327)`
2fb5e1d0ec	2021-12-15	`Fix cached_property MyPy declaration and related MyPy errors (#20226)`
21b8661886	2021-12-15	`Fix missing get_backup method for Dataproc Metastore (#20326)`
cdaa9a2529	2021-12-15	`Fix MyPy errors for google.cloud.tasks (#20233)`
43efde6230	2021-12-15	`Fix MyPy Errors for Apache Beam (and Dataflow) provider. (#20301)`
c4b3694101	2021-12-15	`Fix MyPy errors in leveldb (#20222)`
1570519a97	2021-12-14	`Fix MyPy errors for google.cloud.transfers (#20229)`
632bd0133e	2021-12-13	`Fix MyPY errors for google.cloud.example_dags (#20232)`
644051abcb	2021-12-13	`Fix MyPy errors for google/marketing_platform and suite (#20227)`
a208463802	2021-12-13	`Organize S3 Classes in Amazon Provider (#20167)`
98514cc159	2021-12-13	`Add optional location to bigquery data transfer service (#15088) (#20221)`
1f662571b2	2021-12-12	`Fix MyPy errors in google.cloud.sensors (#20228)`
22341b90da	2021-12-11	`Add Google Cloud Tasks how-to documentation (#20145)`
e9262752dc	2021-12-11	`Finalised Datastore documentation (#20138)`
fa96b09395	2021-12-09	`Update Sphinx and Sphinx-AutoAPI (#20079)`
ed8b63ba24	2021-12-08	`Providers facebook hook multiple account (#19377)`
50bf536656	2021-12-08	`Remove deprecated method call (blob.download_as_string) (#20091)`
564fe635bd	2021-12-06	`Added example DAG for MSSQL to Google Cloud Storage (GCS) (#19873)`
cb082d361a	2021-12-02	`Remove deprecated template_fields from GoogleDriveToGCSOperator (#19991)`
6977c47572	2021-12-01	`BigQueryHook fix typo in run_load doc string (#19924)`
f6dca1fa5e	2021-12-01	`Update doc reference links (#19909)`

6.2.0¶

Latest change: 2021-11-30

Commit	Committed	Subject
853576d901	2021-11-30	`Update documentation for November 2021 provider's release (#19882)`
fb478c00cd	2021-11-28	`Move 'bucket_name' validation out of '__init__' in Google Marketing Platform operators (#19383)`
e9e530979a	2021-11-28	`Update 'default_args' value in example_functions DAG from str to int (#19865)`
bf68b9a846	2021-11-26	`Create dataproc serverless spark batches operator (#19248)`
a192cecf6b	2021-11-26	`updates pipeline_timeout CloudDataFusionStartPipelineOperator (#18773)`
eb163c81d1	2021-11-25	`Fix GCS system tests (#19227)`
744d11bdb2	2021-11-25	`Clean up ''default_args'' usage in docs (#19803)`
0b2e1a8744	2021-11-22	`Added wait mechanizm to the DataprocJobSensor to avoid 509 errors when Job is not available (#19740)`
3336bb6c3c	2021-11-19	`Fix badly merged impersonation in GKEPodOperator (#19696)`
952ef908bc	2021-11-19	`Support impersonation_chain parameter in the GKEStartPodOperator (#19518)`
853c16465a	2021-11-18	`Clean-up of google cloud example dags - batch 3 (#19664)`
355dec8fea	2021-11-17	`Misc. documentation typos and language improvements (#19599)`
b9d31cd449	2021-11-17	`Cleanup dynamic 'start_date' use for miscellaneous Google example DAGs (#19400)`
daf234bd5e	2021-11-16	`Remove reference to deprecated operator in example_dataproc (#19619)`
48f228cf9e	2021-11-15	`#16691 Providing more information in docs for DataprocCreateCluster operator migration (#19446)`
6ef44b6a50	2021-11-15	`Clean-up of google cloud example dags - batch 2 (#19527)`
dc0159e7e4	2021-11-14	`Add support in GCP connection for reading key from Secret Manager (#19164)`
4212c49324	2021-11-14	`Update Azure modules to comply with AIP-21 (#19431)`
aa2cb5545f	2021-11-12	`Remove remaining 'pylint: disable' comments (#19541)`
c8dc0311da	2021-11-08	`Fix Cloud SQL system tests (#19014)`
26ad55beb0	2021-11-08	`Add dataproc metastore operators (#18945)`
9efb989d19	2021-11-07	`Clean-up of google cloud example dags (#19436)`
f421409b4d	2021-11-05	`Fix typos in warnings, docstrings, exceptions (#19424)`
a3c9956f79	2021-10-30	`Add support of 'path' parameter for GCloud Storage Transfer Service operators (#17446)`

6.1.0¶

Latest change: 2021-10-29

Commit	Committed	Subject
d9567eb106	2021-10-29	`Prepare documentation for October Provider's release (#19321)`
55abc2f620	2021-10-28	`Support query timeout as an argument in CassandraToGCSOperator (#18927)`
e4aa377da7	2021-10-28	`Update BigQueryCreateExternalTableOperator doc and parameters (#18676)`
20847fdbf8	2021-10-27	`Add value to "namespaceId" of query (#19163)`
3c08c025c5	2021-10-27	`Move validation of templated input params to run after the context init (#19048)`
eba1b68b30	2021-10-27	`Update dataflow.py (#19231)`
7ecf29f70d	2021-10-26	`Fix hard-coded /tmp directory in CloudSQL Hook (#19229)`
726a1517ec	2021-10-26	`Fix bug in Dataflow hook when no jobs are returned (#18981)`
d9192a55ba	2021-10-22	`Replacing non-attribute template_fields for BigQueryToMsSqlOperator (#19052)`
4fae04a471	2021-10-21	`Upgrade the Dataproc package to 3.0.0 and migrate from v1beta2 to v1 api (#18879)`
0e95b57772	2021-10-19	`Google provider catch invalid secret name (#18790)`
86a2a19ad2	2021-10-17	`More f-strings (#18855)`
a418fd96f7	2021-10-17	`Use google cloud credentials when executing beam command in subprocess (#18992)`
5c3e453820	2021-10-15	`Fix BigQueryToMsSqlOperator documentation (#18995)`
406b38b2e3	2021-10-15	`Replace default api_version of FacebookAdsReportToGcsOperator (#18996)`
1571f80546	2021-10-14	`Add pre-commit hook for common misspelling check in files (#18964)`
20df60de24	2021-10-07	`Dataflow Operators - use project and location from job in on_kill method. (#18699)`
86bf2a29ba	2021-10-04	`Simplify strings previously split across lines (#18679)`

6.0.0¶

Latest change: 2021-09-30

Commit	Committed	Subject
840ea3efb9	2021-09-30	`Update documentation for September providers release (#18613)`
9279c44c91	2021-09-29	`Fix part of Google system tests (#18494)`
2fadf3c3cf	2021-09-27	`Fix kubernetes engine system test (#18548)`
a458fcc573	2021-09-27	`Updating miscellaneous provider DAGs to use TaskFlow API where applicable (#18278)`
97d6892318	2021-09-25	`Rename AzureDataLakeStorage to ADLS (#18493)`
a5439eee72	2021-09-23	`Add index to the dataset name to have separate dataset for each example DAG (#18459)`
18d7e1e227	2021-09-21	`Fix BigQuery system test (#18373)`
e25eea052f	2021-09-19	`Inclusive Language (#18349)`
7458f1e786	2021-09-18	`Remove check for at least one schema in GCSToBigquery (#18150)`
2474f8922d	2021-09-13	`Migrate Google Cloud Build from Discovery API to Python SDK (#18184)`
8ae2bb9bfa	2021-09-13	`Fix error when create external table using table resource (#17998)`
9140ad8d8f	2021-09-11	`Use parameters instead of params (#18143)`
3d4bfdcbb9	2021-09-10	`Add missing __init__.py files for some test packages (#18142)`
cfb602a33d	2021-09-10	`Fix ''BigQuery'' data extraction in ''BigQueryToMySqlOperator'' (#18073)`
2fd3f27ebd	2021-09-10	`Make next_dagrun_info take a data interval (#18088)`
944dcfbb91	2021-09-07	`Change TaskInstance and TaskReschedule PK from execution_date to run_id (#17719)`
bfad233b91	2021-09-06	`Fix providers tests in main branch with eager upgrades (#18040)`
21348c194d	2021-09-03	`fix(CloudSqlProxyRunner): don't query connections from Airflow DB (#18006)`
9a0c10ba3f	2021-09-01	`deduplicate running jobs on BigQueryInsertJobOperator (#17496)`
fe34582fc2	2021-09-01	`New google operator: SQLToGoogleSheetsOperator (#17887)`
500780651c	2021-08-31	`Add possibility to run DAGs from system tests and see DAGs logs (#17868)`

5.1.0¶

Latest change: 2021-08-30

Commit	Committed	Subject
0a68588479	2021-08-30	`Add August 2021 Provider's documentation (#17890)`
b5da846dd1	2021-08-30	`Fix missing Data Fusion sensor integration (#17914)`
07405e6df4	2021-08-30	`[AIRFLOW-9300] Add DatafusionPipelineStateSensor and aync option to the CloudDataFusionStartPipelineOperator (#17787)`
42e13e1a5a	2021-08-30	`Remove all deprecation warnings in providers (#17900)`
aa5952e58c	2021-08-27	`Gcp ai hyperparameter tuning (#17790)`
87769db98f	2021-08-27	`Allow omission of 'initial_node_count' if 'node_pools' is specified (#17820)`
be75dcd39c	2021-08-23	`Update description about the new ''connection-types'' provider meta-data`
d04aa13526	2021-08-20	`[Airflow 13779] use provided parameters in the wait_for_pipeline_state hook (#17137)`
76ed2a49c6	2021-08-19	`Import Hooks lazily individually in providers manager (#17682)`
b68d1935f9	2021-08-19	`Add error check for config_file parameter in GKEStartPodOperator (#17700)`
29aab6434f	2021-08-17	`Adds secrets backend/logging/auth information to provider yaml (#17625)`
b06d528603	2021-08-11	`Don't cache Google Secret Manager client (#17539)`
67cbb0f181	2021-08-02	`Enable specifying dictionary paths in 'template_fields_renderers' (#17321)`
c384f9b0f5	2021-07-29	`GCP Secret Manager error handling for missing credentials (#17264)`

5.0.0¶

Latest change: 2021-07-26

Commit	Committed	Subject
87f408b1e7	2021-07-26	`Prepares docs for Rc2 release of July providers (#17116)`
448e50bd23	2021-07-26	`Updating Google Cloud example DAGs to use XComArgs (#16875)`
aaf44ccace	2021-07-26	`Updating miscellaneous Google example DAGs to use XComArgs (#16876)`
d01cc945dd	2021-07-26	`Fixes several failing tests after broken main (#17222)`
babc4250f3	2021-07-26	`Fixes statich check failures (#17218)`
5d2224795b	2021-07-25	`Google Ads Hook: Support newer versions of the google-ads library (#17160)`
966b250199	2021-07-25	`Fix GCStoGCS operator with replace diabled and existing destination object (#16991)`
763919d415	2021-07-25	`Adding custom Salesforce connection type + SalesforceToS3Operator updates (#17162)`
81bd40933e	2021-07-23	`[CASSANDRA-16814] Fix cassandra to gcs type inconsistency. (#17183)`
026ffe65d4	2021-07-19	`fix: dataprocpysparkjob project_id as self.project_id (#17075)`
d02ded65ea	2021-07-15	`Fixed wrongly escaped characters in amazon's changelog (#17020)`
b916b75079	2021-07-15	`Prepare documentation for July release of providers. (#17015)`
a3f5c93806	2021-07-13	`Update alias for field_mask in Google Memmcache (#16975)`
b0f7f91fe2	2021-07-07	`Standardise dataproc location param to region (#16034)`
866a601b76	2021-06-28	`Removes pylint from our toolchain (#16682)`

4.0.0¶

Latest change: 2021-06-18

Commit	Committed	Subject
bbc627a3da	2021-06-18	`Prepares documentation for rc2 release of Providers (#16501)`
cbf8001d76	2021-06-16	`Synchronizes updated changelog after buggfix release (#16464)`
8a9c337838	2021-06-15	`Remove class references in changelogs (#16454)`
1fba5402bb	2021-06-15	`More documentation update for June providers release (#16405)`
3c5cc42e13	2021-06-14	`Fix deprecation warnings location in google provider (#16403)`
b272f9cec9	2021-06-13	`fix: ensure datetime-related values fully compatible with MySQL and BigQuery (#15026)`
7f8f75eb80	2021-06-12	`Add BigQueryToMsSqlOperator (#15422)`
0c80a7d411	2021-06-11	`Fixes AzureFileShare connection extras (#16388)`
9c94b72d44	2021-06-07	`Updated documentation for June 2021 provider release (#16294)`
1e647029e4	2021-06-01	`Rename the main branch of the Airflow repo to be 'main' (#16149)`
99d1535287	2021-05-31	`Fix: GCS To BigQuery source_object (#16160)`
e1137523d4	2021-05-30	`Fix: Unnecessary downloads in ''GCSToLocalFilesystemOperator'' (#16171)`
904709d34f	2021-05-27	`Check synctatic correctness for code-snippets (#16005)`
86768859c6	2021-05-26	`Fix bigquery type error when export format is parquet (#16027)`
6ae9aeec3f	2021-05-26	`pass wait_for_done parameter down to _DataflowJobsController (#15541)`
476d0f6e3d	2021-05-22	`Bump pyupgrade v2.13.0 to v2.18.1 (#15991)`
aa4713e43f	2021-05-21	`Use api version only in GoogleAdsHook not operators (#15266)`
76a80bb17c	2021-05-19	`Move plyvel to google provider extra (#15812)`
bb115da0b7	2021-05-17	`Get rid of requests as core dependency (#15781)`
9c8391a13f	2021-05-10	`Fix spelling (#15699)`
3711a29e5e	2021-05-09	`Fix argument ordering and type of bucket and object (#15738)`
a01567c471	2021-05-08	`Fix sql_to_gcs docstring lint error (#15730)`
f3fada9101	2021-05-07	`Add short description to BaseSQLToGCSOperator docstring (#15728)`
37681bca00	2021-05-07	`Auto-apply apply_default decorator (#15667)`
b8c0fde38a	2021-05-07	`Add extra links for google dataproc (#10343)`
3b4fdd0a7a	2021-05-06	`add oracle connection link (#15632)`
cf6324e43b	2021-05-04	`Implement BigQuery Table Schema Update Operator (#15367)`
0f97a3970d	2021-05-04	`Rename example bucket names to use INVALID BUCKET NAME by default (#15651)`

3.0.0¶

Latest change: 2021-05-01

Commit	Committed	Subject
807ad32ce5	2021-05-01	`Prepares provider release after PIP 21 compatibility (#15576)`
814e471d13	2021-04-29	`Update pre-commit checks (#15583)`
bf2b48174a	2021-04-27	`Add Connection Documentation for Providers (#15499)`
4b031d39e1	2021-04-27	`Make Airflow code Pylint 2.8 compatible (#15534)`
e229f3541d	2021-04-27	`Use Pip 21.* to install airflow officially (#15513)`
71c673e427	2021-04-22	`Update Docstrings of Modules with Missing Params (#15391)`
3b9a91806e	2021-04-22	`Bugfix: Fix rendering of ''object_name'' in ''GCSToLocalFilesystemOperator'' (#15487)`
c5e302030d	2021-04-21	`Fix typo in DataprocCreateClusterOperator (#15462)`
42a1ca8aab	2021-04-20	`Fixes wrongly specified path for leveldb hook (#15453)`
6da36bad2c	2021-04-18	`[Airflow-15245] - passing custom image family name to the DataProcClusterCreateoperator (#15250)`
f649905606	2021-04-15	`fix docstring typos (#15392)`
7bf69edca0	2021-04-08	`Fix typo in a docstring (#15276)`

2.2.0¶

Latest change: 2021-04-06

Commit	Committed	Subject
042be2e4e0	2021-04-06	`Updated documentation for provider packages before April release (#15236)`
eae22cec9c	2021-04-06	`Adds 'Trino' provider (with lower memory footprint for tests) (#15187)`
e49722859b	2021-04-05	`Updates 3.6 limits for latest versions of a few libraries (#15209)`
1d641d8f11	2021-04-01	`update remaining old import paths of operators (#15127)`
099c490cff	2021-03-28	`Override project in dataprocSubmitJobOperator (#14981)`
5379698892	2021-03-27	`Improve docstrings for various modules (#15047)`
a7ca1b3b0b	2021-03-26	`Fix Sphinx Issues with Docstrings (#14968)`
a7e144bec8	2021-03-23	`Google Dataflow Hook to handle no Job Type (#14914)`
72ea841b4b	2021-03-22	`GCS to BigQuery Transfer Operator with Labels and Description parameter (#14881)`
e172bd0e16	2021-03-22	`Update docstrings to adhere to sphinx standards (#14918)`
68e4c4dcb0	2021-03-20	`Remove Backport Providers (#14886)`
ddc9133d36	2021-03-15	`Add GCS timespan transform operator (#13996)`
943baff670	2021-03-10	`Add job labels to bigquery check operators. (#14685)`
6dc24c95e3	2021-03-07	`Fix grammar and remove duplicate words (#14647)`
e7bb17aeb8	2021-03-06	`Use built-in 'cached_property' on Python 3.8 where possible (#14606)`
7daebefd15	2021-03-05	`Use libyaml C library when available. (#14577)`
35c9a90292	2021-03-01	`Add Google leveldb hook and operator (#13109) (#14105)`

2.1.0¶

Latest change: 2021-02-27

Commit	Committed	Subject
589d6dec92	2021-02-27	`Prepare to release the next wave of providers: (#14487)`
50a1504c52	2021-02-27	`Fix spellings (#14483)`
bfef559cf6	2021-02-27	`Corrects order of argument in docstring in GCSHook.download method (#14497)`
33214d9326	2021-02-26	`Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)`
c281979982	2021-02-23	`Documentation and example dag for CloudDLPDeidentifyContentOperator, GCSObjectExistenceSensor, GCSObjectsWithPrefixExistenceSensor (#14033)`
ca35bd7f7f	2021-02-21	`By default PIP will install all packages in .local folder (#14125)`
a7e4266d67	2021-02-21	`Refactor GoogleDriveToGCSOperator to use common methods (#14276)`
1ab406663e	2021-02-16	`Add GoogleDriveToLocalOperator (#14191)`
59c94c679e	2021-02-13	`Add 'exists_ok' flag to BigQueryCreateEmptyTable(Dataset)Operator (#14026)`
e31b27d593	2021-02-13	`Add materialized view support for BigQuery (#14201)`
e3bcaa3ba3	2021-02-12	`Correct typo in GCSObjectsWtihPrefixExistenceSensor (#14179)`
7faa2d978c	2021-02-10	`Add BigQueryUpdateTableOperator (#14149)`
1da6972165	2021-02-10	`Fixes to dataproc operators and hook (#14086)`
02288cf2ba	2021-02-10	`Add param to CloudDataTransferServiceOperator (#14118)`
7d38645472	2021-02-09	`#9803 fix bug in copy operation without wildcard (#13919)`
b0c382426c	2021-02-07	`Add gdrive_to_gcs operator, drive sensor, additional functionality to drive hook, and supporting tests (#13982)`
5d7d46bb33	2021-02-05	`Improve GCSToSFTPOperator paths handling (#11284)`
10343ec29f	2021-02-05	`Corrections in docs and tools after releasing provider RCs (#14082)`

2.0.0¶

Latest change: 2021-02-04

Commit	Committed	Subject
88bdcfa0df	2021-02-04	`Prepare to release a new wave of providers. (#14013)`
1872d8719d	2021-02-03	`Add Apache Beam operators (#12814)`
0e8c77b93a	2021-02-03	`Support google-cloud-logging' >=2.0.0 (#13801)`
833e338323	2021-02-02	`Fix four bugs in StackdriverTaskHandler (#13784)`
d2efb33239	2021-02-02	`Support google-cloud-monitoring>=2.0.0 (#13769)`
ac2f72c98d	2021-02-01	`Implement provider versioning tools (#13767)`
823741cfea	2021-01-28	`Improve GCS system test envs (#13946)`
6d6588fe2b	2021-01-28	`Add Google Cloud Workflows Operators (#13366)`
810c15ed85	2021-01-27	`Fix and improve GCP BigTable hook and system test (#13896)`
6616617331	2021-01-27	`Add env variables to PubSub example dag (#13794)`
f473ca7130	2021-01-24	`Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851)`
a9ac2b040b	2021-01-23	`Switch to f-strings using flynt. (#13732)`
9592be88e5	2021-01-22	`Fix Google Spanner example dag (#13842)`
af52fdb511	2021-01-22	`Improve environment variables in GCP Dataflow system test (#13841)`
e7946f1cb7	2021-01-22	`Improve environment variables in GCP Datafusion system test (#13837)`
61c1d6ec6c	2021-01-22	`Improve environment variables in GCP Memorystore system test (#13833)`
202f66093a	2021-01-22	`Improve environment variables in GCP Lifeciences system test (#13834)`
70bf307f38	2021-01-21	`Add How To Guide for Dataflow (#13461)`
3fd5ef3555	2021-01-21	`Add missing logos for integrations (#13717)`
309788e5e2	2021-01-18	`Refactor DataprocOperators to support google-cloud-dataproc 2.0 (#13256)`
7ec858c452	2021-01-17	`updated Google DV360 Hook to fix SDF issue (#13703)`
ef8617ec9d	2021-01-14	`Support google-cloud-tasks>=2.0.0 (#13347)`
189af54043	2021-01-13	`Add system tests for Stackdriver operators (#13644)`
a6f999b62e	2021-01-11	`Support google-cloud-automl >=2.1.0 (#13505)`
947dbb73bb	2021-01-11	`Support google-cloud-datacatalog>=3.0.0 (#13534)`
2fb68342b0	2021-01-07	`Replace deprecated module and operator in example_tasks.py (#13527)`
003584bbf1	2021-01-05	`Fix failing backport packages test (#13497)`
7d1ea4cb10	2021-01-05	`Replace deprecated module and operator in example_tasks.py (#13473)`
c7d75ad887	2021-01-05	`Revert "Support google-cloud-datacatalog 3.0.0 (#13224)" (#13482)`
feb84057d3	2021-01-04	`Support google-cloud-datacatalog 3.0.0 (#13224)`
3a3e739981	2021-01-04	`Fix insert_all method of BigQueryHook to support tables without schema (#13138)`
c33d2c06b6	2021-01-02	`Fix another pylint c-extension-no-member (#13438)`
f6518dd6a1	2021-01-02	`Generalize MLEngineStartTrainingJobOperator to custom images (#13318)`
9de7127083	2020-12-31	`Support google-cloud-bigquery-datatransfer>=3.0.0 (#13337)`
406181d64a	2020-12-31	`Add Parquet data type to BaseSQLToGCSOperator (#13359)`
295d66f914	2020-12-30	`Fix Grammar in PIP warning (#13380)`
13a9747bf1	2020-12-28	`Revert "Support google-cloud-tasks>=2.0.0 (#13334)" (#13341)`
04ec45f045	2020-12-28	`Add DataprocCreateWorkflowTemplateOperator (#13338)`
1f712219fa	2020-12-28	`Support google-cloud-tasks>=2.0.0 (#13334)`
f4745c8ce1	2020-12-26	`Fix typo in example (#13321)`
e9d65bd458	2020-12-24	`Decode Remote Google Logs (#13115)`
e7aeacf335	2020-12-24	`Add OracleToGCS Transfer (#13246)`
323084e97d	2020-12-24	`Add timeout option to gcs hook methods. (#13156)`
0b626c8042	2020-12-22	`Support google-cloud-redis>=2.0.0 (#13117)`
9042a58553	2020-12-22	`Add more operators to example DAGs for Cloud Tasks (#13235)`
8c00ec89b9	2020-12-22	`Support google-cloud-pubsub>=2.0.0 (#13127)`
b26b0df5b0	2020-12-22	`Update compatibility with google-cloud-kms>=2.0 (#13124)`
9a1d3820d6	2020-12-22	`Support google-cloud-datacatalog>=1.0.0 (#13097)`
f95b1c9c95	2020-12-21	`Add regional support to dataproc workflow template operators (#12907)`
6cf76d7ac0	2020-12-18	`Fix typo in pip upgrade command :( (#13148)`
23f27c1b1c	2020-12-18	`Add system tests for CloudKMSHook (#13122)`
cddbf81b12	2020-12-17	`Fix Google BigQueryHook method get_schema() (#13136)`
1259c712a4	2020-12-17	`Update compatibility with google-cloud-os-login>=2.0.0 (#13126)`
bcf77586ef	2020-12-16	`Fix Data Catalog operators (#13096)`
5090fb0c89	2020-12-15	`Add script to generate integrations.json (#13073)`
b4b9cf5597	2020-12-14	`Check for missing references to operator guides (#13059)`
1c1ef7ee69	2020-12-14	`Add project_id to client inside BigQuery hook update_table method (#13018)`

1.0.0¶

Latest change: 2020-12-09

Commit	Committed	Subject
32971a1a2d	2020-12-09	`Updates providers versions to 1.0.0 (#12955)`
b40dffa085	2020-12-08	`Rename remaing modules to match AIP-21 (#12917)`
9b39f24780	2020-12-08	`Add support for dynamic connection form fields per provider (#12558)`
1dcd3e13fd	2020-12-05	`Add support for extra links coming from the providers (#12472)`
2037303eef	2020-11-29	`Adds support for Connection/Hook discovery from providers (#12466)`
02d94349be	2020-11-29	`Don't use time.time() or timezone.utcnow() for duration calculations (#12353)`
76bcd08dca	2020-11-28	`Added '@apply_defaults' decorator. (#12620)`
e1ebfa68b1	2020-11-27	`Add DataflowJobMessagesSensor and DataflowAutoscalingEventsSensor (#12249)`
3fa51f94d7	2020-11-24	`Add check for duplicates in provider.yaml files (#12578)`
c34ef853c8	2020-11-20	`Separate out documentation building per provider (#12444)`
9e3b2c554d	2020-11-19	`GCP Secrets Optional Lookup (#12360)`
0080354502	2020-11-18	`Update provider READMEs for 1.0.0b2 batch release (#12449)`
7ca0b6f121	2020-11-18	`Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438)`
8d09506464	2020-11-18	`Fix download method in GCSToBigQueryOperator (#12442)`
2c0920fba5	2020-11-17	`Adds mechanism for provider package discovery. (#12383)`
2cda2f2a0a	2020-11-17	`Add missing pre-commit definition - provider-yamls (#12393)`
80a957f142	2020-11-17	`Add Dataflow sensors - job metrics (#12039)`
ae7cb4a1e2	2020-11-17	`Update wrong commit hash in backport provider changes (#12390)`
917e6c4424	2020-11-16	`Add provide_file_and_upload to GCSHook (#12310)`
cfa4ecfeb0	2020-11-15	`Add DataflowJobStatusSensor and support non-blocking execution of jobs (#11726)`
6889a333cf	2020-11-15	`Improvements for operators and hooks ref docs (#12366)`
7825e8f590	2020-11-13	`Docs installation improvements (#12304)`
32b59f8350	2020-11-12	`Fixes the sending of an empty list to BigQuery 'list_rows' (#12307)`
250436d962	2020-11-10	`Fix spelling in Python files (#12230)`
502ba309ea	2020-11-10	`Enable Markdownlint rule - MD022/blanks-around-headings (#12225)`
dd2095f4a8	2020-11-10	`Simplify string expressions & Use f-string (#12216)`
f37c6e6fce	2020-11-10	`Add Compute Engine SSH hook (#9879)`
85a18e13d9	2020-11-09	`Point at pypi project pages for cross-dependency of provider packages (#12212)`
59eb5de78c	2020-11-09	`Update provider READMEs for up-coming 1.0.0beta1 releases (#12206)`
61feb6ec45	2020-11-09	`Provider's readmes generated for elasticsearch and google packages (#12194)`
b2a28d1590	2020-11-09	`Moves provider packages scripts to dev (#12082)`
fcb6b00efe	2020-11-08	`Add authentication to AWS with Google credentials (#12079)`
2ef3b7ef8c	2020-11-08	`Fix ERROR - Object of type 'bytes' is not JSON serializable when using store_to_xcom_key parameter (#12172)`
0caec9fd32	2020-11-06	`Dataflow - add waiting for successful job cancel (#11501)`
cf9437d79f	2020-11-06	`Simplify string expressions (#12123)`
91a64db505	2020-11-04	`Format all files (without excepions) by black (#12091)`
fd3db778e7	2020-11-04	`Add server side cursor support for postgres to GCS operator (#11793)`
f1f1940261	2020-11-04	`Add DataflowStartSQLQuery operator (#8553)`
41bf172c1d	2020-11-04	`Simplify string expressions (#12093)`
5f5244b74d	2020-11-04	`Add template fields renderers to Biguery and Dataproc operators (#12067)`
4e8f9cc8d0	2020-11-03	`Enable Black - Python Auto Formmatter (#9550)`
8c42cf1b00	2020-11-03	`Use PyUpgrade to use Python 3.6 features (#11447)`
45ae145c25	2020-11-03	`Log BigQuery job id in insert method of BigQueryHook (#12056)`
e324b37a67	2020-11-03	`Add job name and progress logs to Cloud Storage Transfer Hook (#12014)`
6071fdd584	2020-11-02	`Improve handling server errors in DataprocSubmitJobOperator (#11947)`
2f703df12d	2020-10-30	`Add SalesforceToGcsOperator (#10760)`
e5713e00b3	2020-10-29	`Add drain option when canceling Dataflow pipelines (#11374)`
37eaac3c5d	2020-10-29	`The PRs which are not approved run subset of tests (#11828)`
79cb771992	2020-10-28	`Fixing re pattern and changing to use a single character class. (#11857)`
5a439e84eb	2020-10-26	`Prepare providers release 0.0.2a1 (#11855)`
240c7d4d72	2020-10-26	`Google Memcached hooks - improve protobuf messages handling (#11743)`
8afdb6ac6a	2020-10-26	`Fix spellings (#11825)`
872b1566a1	2020-10-25	`Generated backport providers readmes/setup for 2020.10.29 (#11826)`
6ce855af11	2020-10-24	`Fix spelling (#11821)`
4830687453	2020-10-24	`Use Python 3 style super classes (#11806)`
727c739afb	2020-10-22	`Improve Cloud Memorystore for Redis example (#11735)`
1da8379c91	2020-10-22	`Fix static checks after merging #10121 (#11737)`
91503308c7	2020-10-22	`Add Google Cloud Memorystore Memcached Operators (#10121)`
950c16d0b0	2020-10-21	`Retry requests in case of error in Google ML Engine Hook (#11712)`
2bfc53b5eb	2020-10-21	`Fix doc errors in google provider files. (#11713)`
53e6062105	2020-10-21	`Enforce strict rules for yamllint (#11709)`
349b0811c3	2020-10-20	`Add D200 pydocstyle check (#11688)`
2d854c3505	2020-10-19	`Add service_account to Google ML Engine operator (#11619)`
46a121fb7b	2020-10-18	`docs: Update Bigquery clustering docstrings (#11232)`
49c58147fe	2020-10-18	`Strict type checking for provider Google (#11609)`
0823d46a7f	2020-10-16	`Add type annotations for AWS operators and hooks (#11434)`
3c10ca6504	2020-10-16	`Add DataflowStartFlexTemplateOperator (#8550)`
8865d14df4	2020-10-16	`Strict type checking for provider google cloud (#11548)`
16e7129719	2020-10-13	`Added support for provider packages for Airflow 2.0 (#11487)`
06141d6d01	2020-10-12	`Google cloud operator strict type check (#11450)`
d305876bee	2020-10-12	`Remove redundant None provided as default to dict.get() (#11448)`
1845cd11b7	2020-10-11	`Strict type check for google ads and cloud hooks (#11390)`
bd204bb91b	2020-10-11	`Optionally set null marker in csv exports in BaseSQLToGCSOperator (#11409)`
75071831ba	2020-10-10	`Remove redundant parentheses from Python files (#10967)`
8baf657fc2	2020-10-09	`Fix regression in DataflowTemplatedJobStartOperator (#11167)`
b0fcf67559	2020-10-07	`Add AzureFileShareToGCSOperator (#10991)`
47b05a87f0	2020-10-07	`Improve handling of job_id in BigQuery operators (#11287)`
0a0e1af800	2020-10-03	`Fix Broken Markdown links in Providers README TOC (#11249)`
ca4238eb4d	2020-10-02	`Fixed month in backport packages to October (#11242)`
5220e4c384	2020-10-02	`Prepare Backport release 2020.09.07 (#11238)`
cb52fb0ae1	2020-09-27	`Add example DAG and system test for MySQLToGCSOperator (#10990)`
99accec29d	2020-09-25	`Fix incorrect Usage of Optional[str] & Optional[int] (#11141)`
e3f96ce7a8	2020-09-24	`Fix incorrect Usage of Optional[bool] (#11138)`
daf8f31080	2020-09-23	`Add template fields renderers for better UI rendering (#11061)`
f3e87c5030	2020-09-22	`Add D202 pydocstyle check (#11032)`
cb979f9f21	2020-09-22	`Get Airflow configs with sensitive data from CloudSecretManagerBackend (#11024)`
76545bb3d6	2020-09-16	`Add example dag and system test for S3ToGCSOperator (#10951)`
22c631625f	2020-09-16	`Fix more docs spellings (#10965)`
12a652f534	2020-09-13	`Fix parameter name collision in AutoMLBatchPredictOperator #10723 (#10869)`
41a62735ed	2020-09-11	`Add on_kill method to BigQueryInsertJobOperator (#10866)`
3e91da56e8	2020-09-11	`fix typo in firebase/example_filestore DAG (#10875)`
68cc7273bf	2020-09-10	`Add on_kill method to DataprocSubmitJobOperator (#10847)`
f920957214	2020-09-10	`Fix and remove some more typos from spelling_wordlist.txt (#10845)`
9549274d11	2020-09-09	`Upgrade black to 20.8b1 (#10818)`
078bfaf60a	2020-09-08	`Extract missing gcs_to_local example DAG from gcs example (#10767)`
10ce31127f	2020-09-08	`Deprecate using global as the default region in Google Dataproc operators and hooks (#10772)`
f14f379716	2020-09-07	`[AIRFLOW-10672] Refactor BigQueryToGCSOperator to use new method (#10773)`
c8ee455685	2020-09-07	`Refactor DataprocCreateCluster operator to use simpler interface (#10403)`
ece685b5b8	2020-09-05	`Asynchronous execution of Dataproc jobs with a Sensor (#10673)`
6e3d7b63d3	2020-09-04	`Add masterConfig parameter to MLEngineStartTrainingJobOperator (#10578)`
804548d58f	2020-09-01	`Add Dataprep operators (#10304)`
11c00bc820	2020-08-30	`Fix typos: duplicated "the" (#10647)`
2ca615cffe	2020-08-29	`Update Google Cloud branding (#10642)`
1b533f617e	2020-08-28	`Fix broken master - DLP (#10635)`
5ae82a56da	2020-08-28	`Fix Google DLP example and improve ops idempotency (#10608)`
3867f76625	2020-08-28	`Update Google Cloud branding (#10615)`
91ff31ad10	2020-08-27	`Documentation for Google Cloud Data Loss Prevention (#8201) (#9651)`
fdd9b6f65b	2020-08-25	`Enable Black on Providers Packages (#10543)`
d760265452	2020-08-25	`PyDocStyle: No whitespaces allowed surrounding docstring text (#10533)`
d1bce91bb2	2020-08-25	`PyDocStyle: Enable D403: Capitalized first word of docstring (#10530)`
866701c801	2020-08-25	`Fix typo in "Cloud" (#10534)`
47265e7b58	2020-08-24	`Fix typo in PostgresHook (#10529)`
3696c34c28	2020-08-24	`Fix typo in the word "release" (#10528)`
2f2d8dbfaf	2020-08-25	`Remove all "noinspection" comments native to IntelliJ (#10525)`
3734876d98	2020-08-24	`Implement impersonation in google operators (#10052)`
b0598b5351	2020-08-24	`Add support for creating multiple replicated clusters in Bigtable hook and operator (#10475)`
ee7ca128a1	2020-08-22	`Fix broken Markdown refernces in Providers README (#10483)`
515cc72c99	2020-08-22	`Fix typo in timed_out (#10459)`
7c206a82a6	2020-08-22	`Replace assigment with Augmented assignment (#10468)`
88c7d2e526	2020-08-21	`Dataflow operators don't not always create a virtualenv (#10373)`
083c3c129b	2020-08-18	`Simplified GCSTaskHandler configuration (#10365)`
1ae5bdf23e	2020-08-17	`Add test for GCSTaskHandler (#9600) (#9861)`
e195a980bc	2020-08-16	`Add type annotations for mlengine_operator_utils (#10297)`
382c1011b6	2020-08-16	`Add Bigtable Update Instance Hook/Operator (#10340)`
bfa5a8d5f1	2020-08-15	`CI: Fix failing docs-build (#10342)`
be46d20fb4	2020-08-15	`Improve idempotency of BigQueryInsertJobOperator (#9590)`
47387a69e6	2020-08-14	`Catch Permission Denied exception when getting secret from GCP Secret Manager. (#10326)`
2f0613b0c2	2020-08-13	`Implement Google BigQuery Table Partition Sensor (#10218)`
f6734b3b85	2020-08-12	`Enable Sphinx spellcheck for doc generation (#10280)`
8f8db8959e	2020-08-12	`DbApiHook: Support kwargs in get_pandas_df (#9730)`
ef088314f8	2020-08-09	`Added DataprepGetJobsForJobGroupOperator (#10246)`
b43f90abf4	2020-08-09	`Fix various typos in the repo (#10263)`
c29533888f	2020-08-08	`Add labels param to Google MLEngine Operators (#10222)`
cdec301254	2020-08-07	`Add correct signature to all operators and sensors (#10205)`
eff0f03210	2020-08-06	`` Update guide for Google Cloud Secret Manager Backend (#10172)``
24c8e4c2d6	2020-08-06	`Changes to all the constructors to remove the args argument (#10163)`
010322692e	2020-08-06	`Improve handling Dataproc cluster creation with ERROR state (#9593)`
1437cb7495	2020-08-04	`Add correct signatures for operators in google provider package (#10144)`
6efa1b9cb7	2020-08-03	`Add additional Cloud Datastore operators (#10032)`
27020f8e58	2020-08-03	`Add try clause to DataFusionHook.wait_for_pipeline_state (#10031)`
4e3799fec4	2020-08-02	`[AIRFLOW-4541] Replace os.mkdirs usage with pathlib.Path(path).mkdir (#10117)`
85c56b1737	2020-08-02	`Add missing params to GCP Pub/Sub creation_subscription (#10106)`
b79466c12f	2020-08-02	`Fix sensor not providing arguments for GCSHook (#10074)`
4ee35d0279	2020-08-02	`Fix hook not passing gcp_conn_id to base class (#10075)`
aeea71274d	2020-08-02	`Remove 'args' parameter from provider operator constructors (#10097)`
4c84661adb	2020-07-31	`Split Display Video 360 example into smaler DAGs (#10077)`
59cbff0874	2020-07-29	`Fix docstrings in BigQueryGetDataOperator (#10042)`
81b87d48ed	2020-07-27	`Add unit tests for GcpBodyFieldSanitizer in Google providers (#9996)`
7d24b088cd	2020-07-25	`Stop using start_date in default_args in example_dags (2) (#9985)`
8b10a4b35e	2020-07-25	`Stop using start_date in default_args in example_dags (#9982)`
ef98edf4da	2020-07-23	`Add more information about using GoogleAdsHook (#9951)`
33f0cd2657	2020-07-22	`apply_default keeps the function signature for mypy (#9784)`
39a0288a47	2020-07-22	`Add Google Authentication for experimental API (#9848)`
c2db0dfeb1	2020-07-22	`More strict rules in mypy (#9705) (#9906)`
c4244e18bb	2020-07-22	`Fix calling 'get_client' in BigQueryHook.table_exists (#9916)`
5eacc16420	2020-07-22	`Add support for impersonation in GCP hooks (#9915)`
1cfdebf5f8	2020-07-21	`Fix insert_job method of BigQueryHook (#9899)`
c8c52e69c8	2020-07-21	`Remove type hint causing DeprecationWarning in Firestore operators (#9819)`
eb6f1d1cf0	2020-07-16	`Fix typo in datafusion operator (#9859)`
b01d95ec22	2020-07-15	`Change DAG.clear to take dag_run_state (#9824)`
6d65c15d15	2020-07-15	`Add guide for AI Platform (previously Machine Learning Engine) Operators (#9798)`
770de53eb5	2020-07-15	`BigQueryTableExistenceSensor needs to specify keyword arguments (#9832)`
2d8dbacdf6	2020-07-15	`Add CloudVisionDeleteReferenceImageOperator (#9698)`
9f017951b9	2020-07-15	`Add Google Deployment Manager Hook (#9159)`
ed5004cca7	2020-07-14	`Allow 'replace' flag in gcs_to_gcs operator. (#9667)`
553bb7af7c	2020-07-13	`Keep functions signatures in decorators (#9786)`
68925904e4	2020-07-13	`Add multiple file upload functionality to GCS hook (#8849)`
1de78e8f97	2020-07-12	`Add Google Stackdriver link (#9765)`
092d33f298	2020-07-11	`Fix StackdriverTaskHandler + add system tests (#9761)`
b2305660f0	2020-07-09	`Update example DAG for AI Platform operators (#9727)`
23f80f34ad	2020-07-08	`Move gcs & wasb task handlers to their respective provider packages (#9714)`
44d4ae809c	2020-07-06	`Upgrade to latest pre-commit checks (#9686)`
a79e2d4c4a	2020-07-06	`Move provider's log task handlers to the provider package (#9604)`
cd3d9d9340	2020-07-02	`Fix using .json template extension in GMP operators (#9566)`
4799af30ee	2020-06-30	`Extend BigQuery example with include clause (#9572)`
e33f1a12d7	2020-06-30	`Add template_ext to BigQueryInsertJobOperator (#9568)`
40add26d45	2020-06-29	`Remove almost all references to airflow.contrib (#9559)`
c420dbd6e1	2020-06-27	`Bump Pylint to 2.5.3 (#9294)`
0051c89cba	2020-06-26	`nitpick fix (#9527)`
87fdbd0708	2020-06-25	`Use literal syntax instead of function calls to create data structure (#9516)`
7256f4caa2	2020-06-22	`Pylint fixes and deprecation of rare used methods in Connection (#9419)`
e13a14c873	2020-06-21	`Enable & Fix Whitespace related PyDocStyle Checks (#9458)`
5b680e27e8	2020-06-19	`Don't use connection to store task handler credentials (#9381)`
d0e7db4024	2020-06-19	`Fixed release number for fresh release (#9408)`
416334e2ec	2020-06-19	`Properly propagated warnings in operators (#9348)`
12af6a0800	2020-06-19	`Final cleanup for 2020.6.23rc1 release preparation (#9404)`
c7e5bce57f	2020-06-19	`Prepare backport release candidate for 2020.6.23rc1 (#9370)`
4e09c64423	2020-06-18	`Adds GCP Secret Manager Hook (#9368)`
40bf8f28f9	2020-06-18	`Detect automatically the lack of reference to the guide in the operator descriptions (#9290)`
f6bd817a3a	2020-06-16	`Introduce 'transfers' packages (#9320)`
639972d995	2020-06-16	`Add support for latest Apache Beam SDK in Dataflow operators (#9323)`
1459970b3b	2020-06-15	`Rename CloudBuildCreateBuildOperator to CloudBuildCreateOperator (#9314)`
431ea3291c	2020-06-15	`Resolve upstream tasks when template field is XComArg (#8805)`
aee6ab94eb	2020-06-15	`Wait for pipeline state in Data Fusion operators (#8954)`
fb1c8b83d4	2020-06-10	`Add test for BQ operations using location (#9206)`
a26afbfa51	2020-06-10	`Make generated job_id more informative in BQ insert_job (#9203)`
c41192fa1f	2020-06-10	`Upgrade pendulum to latest major version ~2.0 (#9184)`
b1c8c5ed5b	2020-06-09	`Allows using private endpoints in GKEStartPodOperator (#9169)`
5918efc86a	2020-06-05	`Add 3.8 to the test matrices (#8836)`
9bcdadaf7e	2020-06-05	`Add 'main' param to template_fields in DataprocSubmitPySparkJobOperator (#9154)`
f56811dff3	2020-06-05	`[AIRFLOW-6290] Create guide for GKE operators (#8883)`
76962867b5	2020-06-04	`Fix sql_to_gcs hook gzip of schema_file (#9140)`
17adcea835	2020-06-02	`Fix handling of subprocess error handling in s3_file_transform and gcs (#9106)`
7898525468	2020-06-01	`Add BigQueryInsertJobOperator (#8868)`
29eb68b90b	2020-05-31	`Create guide for Dataproc Operators (#9037)`
886afaf622	2020-05-29	`Add example dag and system test for LocalFilesystemToGCSOperator (#9043)`
a779c4dfc2	2020-05-29	`add separate example dags and system tests for GCSToGoogleSheetsOperator (#9066)`
ada26be23c	2020-05-29	`Add correct description for dst param in LocalFilesystemToGCSOperator (#9055)`
81b2761b86	2020-05-29	`add example dag and system test for GoogleSheetsToGCSOperator (#9056)`
0b0e4f7a4c	2020-05-26	`Preparing for RC3 relase of backports (#9026)`
00642a46d0	2020-05-26	`Fixed name of 20 remaining wrongly named operators. (#8994)`
3994030ea6	2020-05-26	`Refactor BigQuery operators (#8858)`
cdb3f25456	2020-05-26	`All classes in backport providers are now importable in Airflow 1.10 (#8991)`
1d36b0303b	2020-05-23	`Fix references in docs (#8984)`
cf5cf45e1c	2020-05-23	`Support YAML input for CloudBuildCreateOperator (#8808)`
499493c5c5	2020-05-19	`[AIRFLOW-6586] Improvements to gcs sensor (#7197)`
375d1ca229	2020-05-19	`Release candidate 2 for backport packages 2020.05.20 (#8898)`
841d816647	2020-05-19	`Allow setting the pooling time in DLPHook (#8824)`
12c5e5d8ae	2020-05-17	`Prepare release candidate for backport packages (#8891)`
f3521fb0e3	2020-05-16	`Regenerate readme files for backport package release (#8886)`
15273f0ea0	2020-05-16	`Check for same task instead of Equality to detect Duplicate Tasks (#8828)`
92585ca4cb	2020-05-15	`Added automated release notes generation for backport operators (#8807)`
e1e833bb26	2020-05-13	`Update GoogleBaseHook to not follow 308 and use 60s timeout (#8816)`
8b54919711	2020-05-12	`Refactor BigQuery hook methods to use python library (#8631)`
6911dfe837	2020-05-12	`Fix template fields in Google operators (#8840)`
4b06fde0f1	2020-05-12	`Fix Flake8 errors (#8841)`
1d12c347cb	2020-05-12	`Refactor BigQuery check operators (#8813)`
493b685d78	2020-05-10	`Add separate example DAGs and system tests for google cloud speech (#8778)`
79ef8bed89	2020-05-10	`Added Upload Multiple Entity Read Files to specified big query dataset (#8610)`
280f1f0c4c	2020-05-10	`Correctly restore upstream_task_ids when deserializing Operators (#8775)`
58aefb23b1	2020-05-08	`Added SDFtoGCSOperator (#8740)`
723c52c942	2020-05-07	`Add documentation for SpannerDeployInstanceOperator (#8750)`
25ee4211b3	2020-05-06	`Support all RuntimeEnvironment parameters in DataflowTemplatedJobStartOperator (#8531)`
8d6f1aa4b5	2020-05-05	`Support num_retries field in env var for GCP connection (#8700)`
67caae0f25	2020-05-04	`Add system test for gcs_to_bigquery (#8556)`
bc45fa6759	2020-05-03	`Add system test and docs for Facebook Ads operators (#8503)`
a28c66f23d	2020-04-30	`[AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625)`
992a24ce41	2020-04-28	`Split and improve BigQuery example DAG (#8529)`
c1fb28230f	2020-04-28	`Refactor BigQueryHook dataset operations (#8477)`
e8d0f8feab	2020-04-26	`Improve idempodency in CloudDataTransferServiceCreateJobOperator (#8430)`
37fdfa9775	2020-04-26	`[AIRFLOW-6281] Create guide for GCS to GCS transfer operators (#8442)`
14b22e6ffe	2020-04-25	`Add hook and operator for Google Cloud Life Sciences (#8481)`
72ddc94d1e	2020-04-23	`Pass location using parmamter in Dataflow integration (#8382)`
912aa4b423	2020-04-23	`Added GoogleDisplayVideo360DownloadLineItemsOperator (#8174)`
57c8c05839	2020-04-22	`Use python client in BQ hook create_empty_table/dataset and table_exists (#8377)`
5d3a7eef30	2020-04-20	`Allow multiple extra_packages in Dataflow (#8394)`
79c99b1b6a	2020-04-18	`Added location parameter to BigQueryCheckOperator (#8273)`
79d3f33c1b	2020-04-17	`Clean up temporary files in Dataflow operators (#8313)`
efcffa323d	2020-04-16	`Add Dataproc SparkR Example (#8240)`
b198a1fa94	2020-04-15	`Create guide for BigQuery operators (#8276)`
2636cc932c	2020-04-14	`Raise exception when GCP credential doesn't support account impersonation (#8213)`
eee4ebaeeb	2020-04-14	`Added Facebook Ads Operator #7887 (#8008)`
8cae07ea18	2020-04-14	`fixed typo (#8294)`
45c8983306	2020-04-13	`Less aggressive eager upgrade of requirements (#8267)`
1fd9ed3840	2020-04-13	`Add mypy plugin for decorators. (#8145)`
327b0a9f77	2020-04-13	`Added GoogleDisplayVideo360UploadLineItemsOperator (#8216)`
bb5e403a32	2020-04-10	`Honor schema type for MySQL to GCS data pre-process (#8090)`
87969a350d	2020-04-09	`[AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170)`
3fc89f29f5	2020-04-06	`[AIRFLOW-7106] Cloud data fusion integration - Allow to pass args to start pipeline (#7849)`
7ef75d2393	2020-04-03	`[AIRFLOW-7117] Honor self.schema in sql_to_gcs as schema to upload (#8049)`
ed2bc00576	2020-04-02	`Add Google Ads list accounts operator (#8007)`
3808a6206e	2020-04-01	`Unify Google class/package names (#8033)`
8a02402576	2020-03-31	`Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011)`
8e89780071	2020-03-31	`Add more refactor steps for providers.google (#8010)`
aae3b8fb27	2020-03-31	`Individual package READMEs (#8012)`
779023968f	2020-03-30	`[AIRFLOW-7075] Operators for storing information from GCS into GA (#7743)`
49abce5217	2020-03-30	`Improve system tests for Cloud Build (#8003)`
0f19a930d1	2020-03-29	`Remove GKEStartPodOperator when backporting (#7908)`
0e1c238b2f	2020-03-28	`Get Airflow Variables from GCP Secrets Manager (#7946)`
eb4af4f944	2020-03-28	`Make BaseSecretsBackend.build_path generic (#7948)`
01f99426fd	2020-03-28	`Add download/upload operators for GCS and Google Sheets (#7866)`
892522f8e2	2020-03-26	`Change signature of GSheetsHook methods (#7853)`
bfd425157a	2020-03-26	`Improve idempotency in MLEngineHook.create_model (#7811)`
f9c226343d	2020-03-26	`Fix CloudSecretsManagerBackend invalid connections_prefix (#7861)`
e3920f12f4	2020-03-26	`Improve setUp/tearDown in Cloud Firestore system test (#7862)`
8ba8a7295a	2020-03-26	`Improve example DAGs for Cloud Memorystore (#7855)`
f7d1a437c1	2020-03-26	`Fix CloudMemorystoreCreateInstanceAndImportOperator operator (#7856)`
beef6c230e	2020-03-26	`Improve authorization in GCP system tests (#7863)`
5f165f3e42	2020-03-26	`[AIRFLOW-5801] Get GCP credentials from file instead of JSON blob (#7869)`
686d7d50bd	2020-03-25	`Standardize SecretBackend class names (#7846)`
1982c3fdca	2020-03-24	`Run Dataflow for ML Engine summary in venv (#7809)`
eef87b9953	2020-03-23	`[AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830)`
529db07b2e	2020-03-23	`Improve Google PubSub hook publish method (#7831)`
4bde99f132	2020-03-23	`Make airflow/providers pylint compatible (#7802)`
a001489b59	2020-03-23	`Improve example DAG for ML Engine (#7810)`
9e5a8e7f83	2020-03-23	`Add call to Super class in 'google' providers (#7823)`
b86bf79bff	2020-03-23	`Fix typo in GCP credentials_provider's docstring (#7818)`
56c013ce92	2020-03-23	`Add missing docstring in BigQueryHook.create_empty_table (#7817)`
426a79847c	2020-03-23	`Imrove support for laatest API in MLEngineStartTrainingJobOperator (#7812)`
cdf1809fce	2020-03-23	`[AIRFLOW-7104] Add Secret backend for GCP Secrets Manager (#7795)`
27dac00e12	2020-03-22	`[AIRFLOW-7099] Improve system test for cloud transfer service (#7794)`
0daf5d729a	2020-03-22	`Add ability to specify a maximum modified time for objects in GCSToGCSOperator (#7791)`
c8088c2bd7	2020-03-20	`[AIRFLOW-7100] Add GoogleAnalyticsGetAdsLinkOperator (#7781)`
5106a29314	2020-03-20	`[AIRFLOW-6752] Add GoogleAnalyticsRetrieveAdsLinksListOperator (#7748)`
759ce2a80c	2020-03-20	`[AIRFLOW-6978] Add PubSubPullOperator (#7766)`
6b9b214e4c	2020-03-20	`[AIRFLOW-6732] Add GoogleAdsHook and GoogleAdsToGcsOperator (#7692)`
b118916969	2020-03-19	`[AIRFLOW-7069] Fix cloudsql system tests (#7770)`
ae854cae5a	2020-03-19	`[AIRFLOW-7082] Remove catch_http_exception decorator in GCP hooks (#7756)`
7e1e954d23	2020-03-19	`[AIRFLOW-7085] Cache credentials, project_id in GCP Base Hook (#7759)`
6e21c139b3	2020-03-19	`[AIRFLOW-XXXX] Fix reference to GCP classes in guides (#7762)`
ce022a3f72	2020-03-19	`[AIRFLOW-XXXX] Add cross-references for operators guide (#7760)`
029c84e552	2020-03-18	`[AIRFLOW-5421] Add Presto to GCS transfer operator (#7718)`
63a3102ede	2020-03-18	`[AIRFLOW-7064] Add CloudFirestoreExportDatabaseOperator (#7725)`
73305c7bd5	2020-03-18	`[AIRFLOW-7081] Remove env variables from GCP guide (#7755)`
60fdbf6d92	2020-03-18	`[AIRFLOW-5610] Add ability to specify multiple objects to copy in GCSToGCSOperator (#7728)`
de7e934ca3	2020-03-17	`[AIRFLOW-7079] Remove redundant code for storing template_fields (#7750)`
0de0347b27	2020-03-17	`[AIRFLOW-6855]: Escape project_dataset_table in SQL query in gcs to bq … (#7475)`
91557c6f87	2020-03-17	`[AIRFLOW-7073] GKEStartPodOperator always use connection credentials (#7738)`
51161dbd9d	2020-03-16	`[AIRFLOW-5664] Store timestamps with microseconds precision (#6354)`
2bc020c431	2020-03-14	`[AIRFLOW-7055] Verbose logging option for google provider (#7711)`
c997cab42d	2020-03-13	`[AIRFLOW-6724] Add Google Analytics 360 Accounts Retrieve Operator (#7630)`
137896f326	2020-03-12	`[AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op (#7685)`
1f77f943d5	2020-03-10	`[AIRFLOW-6980] Improve system tests and building providers package (#7615)`
bf9b6b6d70	2020-03-09	`[AIRFLOW-5013] Add GCP Data Catalog Hook and operators (#7664)`
e5130dc9fe	2020-03-09	`[AIRFLOW-2911] Add job cancellation capability to Dataflow service (#7659)`
faf0df4b94	2020-03-09	`[AIRFLOW-XXXX] Fix upsert operator in BQ example DAG (#7666)`
42eef38217	2020-03-07	`[AIRFLOW-6877] Add cross-provider dependencies as extras (#7506)`
b5b9795f04	2020-03-07	`[AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (fix) (#7624)`
6b65038fb4	2020-03-06	`[AIRFLOW-6990] Improve system tests for Google Marketing Platform (#7631)`
755fe52249	2020-03-05	`[AIRFLOW-6915] Add AI Platform Console Link for MLEngineStartTrainingJobOperator (#7535)`
cb2f339116	2020-03-04	`[AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (#7609)`
09fea3ce8e	2020-03-04	`[AIRFLOW-6977] Fix BigQuery DTS example DAG (#7612)`
8230ccc48b	2020-03-04	`[AIRFLOW-6926] Fix Google Tasks operators return types and idempotency (#7547)`
0d1e3088aa	2020-03-04	`[AIRFLOW-6970] Improve GCP Video Intelligence system tests (#7604)`
ab6bb0012c	2020-03-03	`[AIRFLOW-6971] Fix return type in CloudSpeechToTextRecognizeSpeechOperator (#7607)`
3db4ade3dc	2020-02-29	`[AIRFLOW-6924] Fix Google DLP operators return types (#7546)`
008b4bab14	2020-02-27	`[AIRFLOW-6730] Use total_seconds instead of seconds (#7363)`
bb552b2d9f	2020-02-25	`[AIRFLOW-6908] Lazy load AirflowException (#7528)`
d1a34246ac	2020-02-25	`[AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators (#7322)`
3320e432a1	2020-02-24	`[AIRFLOW-6817] Lazy-load 'airflow.DAG' to keep user-facing API untouched (#7517)`
dcf8743521	2020-02-24	`[AIRFLOW-6894] Prevent db query in example_dags (#7516)`
4d03e33c11	2020-02-22	`[AIRFLOW-6817] remove imports from 'airflow/__init__.py', replaced implicit imports with explicit imports, added entry to 'UPDATING.MD' - squashed/rebased (#7456)`
35b9616378	2020-02-21	`[AIRFLOW-4973] Add Cloud Data Fusion Pipeline integration (#7486)`
aff3a361b4	2020-02-20	`[AIRFLOW-6558] Campaign Manager operators for conversions (#7420)`
9cbd7de6d1	2020-02-18	`[AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412)`
5b199cb86b	2020-02-17	`[AIRFLOW-XXXX] Typo in example_bigquery DAG (#7429)`
2c9345a8e0	2020-02-17	`[AIRFLOW-6759] Added MLEngine operator/hook to cancel MLEngine jobs (#7400)`
946bdc23c0	2020-02-16	`[AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator (#7126)`
2381c820c8	2020-02-13	`[AIRFLOW-6505] Let emoji encoded properly for json.dumps() (#7399)`
04c1fefbf2	2020-02-03	`[AIRFLOW-6676] added GCSDeleteBucketOperator (#7307)`
a0252748ff	2020-02-03	`[AIRFLOW-6717] Remove non-existent field from templated_fields (#7340)`
97a429f9d0	2020-02-02	`[AIRFLOW-6714] Remove magic comments about UTF-8 (#7338)`
9d8d075578	2020-02-03	`[AIRFLOW-6715] Fix Google Cloud DLP Example DAG (#7337)`
cf141506a2	2020-02-02	`[AIRFLOW-6708] Set unique logger names (#7330)`
373c6aa4a2	2020-01-30	`[AIRFLOW-6682] Move GCP classes to providers package (#7295)`
83c037873f	2020-01-30	`[AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287)`
057f3ae3a4	2020-01-29	`[AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286)`
ceea293c16	2020-01-28	`[AIRFLOW-6656] Fix AIP-21 moving (#7272)`
c42a375e79	2020-01-27	`[AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265)`
059eda05f8	2020-01-21	`[AIRFLOW-6610] Move software classes to providers package (#7231)`
f4d3e5e545	2020-01-13	`[AIRFLOW-6102] [AIP-21] Rename Dataproc operators (#7151)`
e7bf8ecb48	2020-01-13	`[AIRFLOW-6119] [AIP-21] Rename GCS operators, hooks and sensors (#7125)`
5b6772cb83	2020-01-09	`[AIRFLOW-6125] [AIP-21] Rename S3 operator and SFTP operator (#7112)`
4f8592ae8f	2020-01-08	`[AIRFLOW-6118] [AIP-21] Rename Pubsub operators and hook (#7046)`
20299473f1	2020-01-03	`[AIRFLOW-6115] [AIP-21] Rename GCP vision operators (#7020)`
18e8cea4e7	2020-01-03	`[AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007)`
95087af140	2019-12-31	`[AIRFLOW-6110] [AIP-21] Rename natural_language service (#6968)`
69629a5a94	2019-12-09	`[AIRFLOW-5807] Move SFTP from contrib to providers. (#6464)`
25e9047a4a	2019-12-09	`[AIRFLOW-6193] Do not use asserts in Airflow main code (#6749)`
ed0a14f321	2019-12-09	`[AIRFLOW-6120] Rename GoogleCloudBaseHook (#6734)`
2f2f89c148	2019-12-01	`[AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701)`
03c870a617	2019-11-26	`[AIRFLOW-6010] Remove cyclic imports and pylint hacks (#6601)`
5c4cfea8c0	2019-11-15	`[AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator (#6393)`
44a8c37a9a	2019-11-13	`[AIRFLOW-XXX] Fix the docstring for Dataproc get_job method (#6581)`
d633d3ac44	2019-11-13	`[AIRFLOW-5691] Rewrite Dataproc operators to use python library (#6371)`
d985c02d9f	2019-11-05	`[AIRFLOW-XXX] Add How-To-Guide to GCP PubSub (#6497)`
a296cdabdb	2019-11-04	`[AIRFLOW-5743] Move Google PubSub to providers package (#6476)`
470b2a779d	2019-10-30	`[AIRFLOW-5741] Move Cloud Natural Language to providers (#6421)`
f2caa451fc	2019-10-27	`[AIRFLOW-5742] Move Google Cloud Vision to providers package (#6424)`
16d7accb22	2019-10-22	`[AIRFLOW-4971] Add Google Display & Video 360 integration (#6170)`
4e661f535d	2019-10-22	`[AIRFLOW-5379] Add Google Search Ads 360 operators (#6228)`
19e32b4e2c	2019-10-18	`[AIRFLOW-5656] Rename provider to providers module (#6333)`