Status of testing Providers that were prepared on April 07, 2022

Body

I have a kind request for all the contributors to the latest provider packages release. Could you please help us to test the RC versions of the providers?

Let us know in the comment, whether the issue is addressed.

Those are providers that require testing as there were some substantial changes introduced:

Provider amazon: 3.3.0rc1

• Pass custom headers through in SES email backend (#22667): @repl-mike-roest
• Update secrets backends to use get_conn_value instead of get_conn_uri (#22348): @dstandish
• Add doc and sample dag for SqlToS3Operator (#22603): @vincbeck
• Adds HiveToDynamoDB Transfer Sample DAG and Docs (#22517): @ferruzzi
• Add doc and sample dag for MongoToS3Operator (#22575): @vincbeck
• Add doc for LocalFilesystemToS3Operator (#22574): @vincbeck
• Add doc and example dag for AWS CloudFormation Operators (#22533): @o-nikolas
• Add doc and sample dag for S3ToFTPOperator and FTPToS3Operator (#22534): @vincbeck
• GoogleApiToS3Operator: update sample dag and doc (#22507): @vincbeck
• SalesforceToS3Operator: update sample dag and doc (#22489): @vincbeck

Provider apache.livy: 2.2.3rc1

• Fix: Add extra headers to all livy API requests instead of only to post_batch (#22510): @cheelio

Provider celery: 2.1.4rc1

• Update our approach for executor-bound dependencies (#22573): @potiuk

Provider cncf.kubernetes: 4.0.0rc1

• Log traceback only on DEBUG for KPO logs read interruption (#22595): @dstandish
• Update our approach for executor-bound dependencies (#22573): @potiuk
• Optionally not follow logs in KPO pod_manager (#22412): @dstandish
• Stop crashing when empty logs are received from kubernetes client (#22566): @potiuk

Provider databricks: 2.6.0rc1

• More operators for Databricks Repos (#22422): @alexott
• Add an UI link to Databricks Job Run (#22541): @alexott
• Refactor DatabricksJobRunLink to not create ad hoc TaskInstances (#22571): @josh-fell

Provider discord: 2.1.4rc1

• DiscordWebhookOperator - add webhook_endpoint to templated fields (#22570): @ttomasz

Provider docker: 2.6.0rc1

• Add timeout parameter to DockerOperator (#22502): @Bowrna

Provider elasticsearch: 3.0.3rc1

• Make ElasticSearch Provider compatible for Airflow<2.3 (#22814): @kaxil

Provider google: 6.8.0rc1

• Add autodetect arg in BQCreateExternalTable Operator (#22710): @hankehly
• Add links for BigQuery Data Transfer (#22280): @wojsamjan
• Modify transfer operators to handle more data (#22495): @mwallace582
• Create Endpoint and Model Service, Batch Prediction and Hyperparameter Tuning Jobs operators for Vertex AI service (#22088): @MaksYermak
• PostgresToGoogleCloudStorageOperator - BigQuery schema type for time zone naive fields (#22536): @pierrejeambrun
• Update secrets backends to use get_conn_value instead of get_conn_uri (#22348): @dstandish
• Fix the docstrings (#22497): @mai-nakagawa
• Fix download_media url in GoogleDisplayVideo360SDFtoGCSOperator (#22479): @pierrejeambrun
• Fixed bug where CloudBuildRunBuildTriggerOperator fail to find build id. (#22419): @stephenoken
• Fail LocalFilesystemToGCSOperator if src does not exist (#22772): @pankajastro
• Remove coerce_datetime usage from GCSTimeSpanFileTransformOperator (#22501): @lwyszomi
• Refactor: BigQuery to GCS Operator (#22506): @shuhoy
• Remove references to deprecated operators/params in PubSub operators (#22519): @josh-fell
• New design of system tests (#22311): @mnojek

Provider hashicorp: 2.2.0rc1

• Update secrets backends to use get_conn_value instead of get_conn_uri (#22348): @dstandish

Provider jenkins: 2.1.0rc1

• Add JenkinsBuildSensor (#22421): @SasanAhmadi
• extra condition to check returned object not None (#22608): @SasanAhmadi

Provider microsoft.azure: 3.8.0rc1

• Update secrets backends to use get_conn_value instead of get_conn_uri (#22348): @dstandish
• Docs: Fix example usage for AzureCosmosDocumentSensor (#22735): @kaxil

Provider microsoft.psrp: 1.1.4rc1

• PowerShell Remoting fail on non-zero exitcode (#22503): @malthe

Provider presto: 2.2.0rc1

• Pass X-Presto-Client-Info in presto hook (#22416): @pingzh

Provider sftp: 2.6.0rc1

• Sftp Sensor Newer Than Parameter (#22377): @AdamPaslawski

Provider trino: 2.2.0rc1

• Pass X-Trino-Client-Info in trino hook (#22535): @pingzh

The guidelines on how to test providers can be found in

Verify providers by contributors

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[potiuk]

BTW. As a learning - in the future we might bundle K8s Executor with the provider, but that will require Airflow 3 and breaking changes I am afraid.

[potiuk]

Thanks for testing everyone!

I proceed with the release of all providers except the Databricks one. RC2 for databricks follows.