Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
Status of testing Providers that were prepared on September 30, 2021
See original GitHub issueBody
I have a kind request for all the contributors to the latest provider packages release. Could you help us to test the RC versions of the providers and let us know in the comment, if the issue is addressed there.
Providers that need testing
Those are providers that require testing as there were some substantial changes introduced:
Provider amazon: 2.3.0rc1
- Add IAM Role Credentials to S3ToRedshiftTransfer and RedshiftToS3Transfer (#18156): @john-jac
- Adding missing
replaceparam directive in docstring of SalesforceToS3Operator (#18241): @josh-fell - Added upsert method on S3ToRedshift operator (#18027): @mariotaddeucci
- Add Spark to the EMR cluster for the job flow examples (#17563): @snolan-amount
- Update s3_list.py (#18561): @Xilorole
- ECSOperator realtime logging (#17626): @codenamestif
- Deprecate default pod name in EKSPodOperator (#18036): @mik-laj
- Aws secrets manager backend (#17448): @JavierLopezT
- sftp_to_s3 stream file option (#17609): @john-jac
- AwsBaseHook make
client_type&resource_typeoptional params forget_client_type&get_resource_type(#17987): @eladkal - Delete unnecessary parameters in EKSPodOperator (#17960): @mik-laj
- ECSOperator returns last logs when ECS task fails (#17209): @pmalafosse
- Refresh credentials for long-running pods on EKS (#17951): @mik-laj
Provider apache.cassandra: 2.1.0rc1
Provider apache.hdfs: 2.1.1rc1
Provider cncf.kubernetes: 2.0.3rc1
- Fix KubernetesPodOperator reattach when not deleting pods (#18070): @jedcunningham
- Make Kubernetes job description fit on one log line (#18377): @collinmcnulty
- Do not fail KubernetesPodOperator tasks if log following fails (#17649): @baryluk
Provider databricks: 2.0.2rc1
Provider docker: 2.2.0rc1
Provider google: 6.0.0rc1
- Migrate Google Cloud Build from Discovery API to Python SDK (#18184): @ryanyuan
- Add index to the dataset name to have separate dataset for each DAG (#18459): @deedmitrij
- Add missing init.py files for some test packages (#18142): @potiuk
- Add possibility to run DAGs from system tests and see DAGs logs (#17868): @deedmitrij
- Rename AzureDataLakeStorage to ADLS (#18493): @eladkal
- Make next_dagrun_info take a data interval (#18088): @uranusjr
- Use parameters instead of params (#18143): @msumit
- New google operator: SQLToGoogleSheetsOperator (#17887): @mariotaddeucci
- Fix part of Google system tests (#18494): @mnojek
- Fix kubernetes engine system test (#18548): @deedmitrij
- Fix BigQuery system test (#18373): @deedmitrij
- Fix error when create external table using table resource (#17998): @tnyz
- Fix BigQuery data extraction in BigQueryToMySqlOperator (#18073): @wolfier
- Fix providers tests in main branch with eager upgrades (#18040): @potiuk
- fix(CloudSqlProxyRunner): don't query connections from Airflow DB (#18006): @m1racoli
- Remove check for at least one schema in GCSToBigquery (#18150): @c-nuro
- deduplicate running jobs on BigQueryInsertJobOperator (#17496): @blcksrx
Provider hashicorp: 2.1.1rc1
Provider microsoft.azure: 3.2.0rc1
- Rename AzureDataLakeStorage to ADLS (#18493): @eladkal
- Creating ADF pipeline run operator, sensor + ADF custom conn fields (#17885): @josh-fell
- Rename LocalToAzureDataLakeStorageOperator to LocalFilesystemToADLSOperator (#18168): @eladkal
- Rename FileToWasbOperator to LocalFilesystemToWasbOperator (#18109): @eladkal
- Fixed wasb hook attempting to create container when getting a blob client (#18287): @ignaski
- Removing redundant relabeling of ADX conn field (#18386): @josh-fell
- Proper handling of Account URL custom conn field in AzureBatchHook (#18456): @josh-fell
Provider microsoft.psrp: 1.0.1rc1
Provider neo4j: 2.0.2rc1
Provider papermill: 2.1.0rc1
- Add support for templated fields in PapermillOperator (#18357): @eladkal
- Fix usage of
range(len())toenumerate(#18174): @kaxil
Provider postgres: 2.3.0rc1
- Added upsert method on S3ToRedshift operator (#18027): @mariotaddeucci
- Fix example dag of PostgresOperator (#18236): @eladkal
Provider slack: 4.1.0rc1
Provider snowflake: 2.2.0rc1
Provider ssh: 2.2.0rc1
- [Airflow 16364] Add conn_timeout and cmd_timeout params to SSHOperator; add conn_timeout param to SSHHook (#17236): @fatmumuhomer
New Providers:
- Provider influxdb: 1.0.0rc1: @subkanthi
Providers that do not need testing
We have a number of providers that had doc-only changes so they are not released.
Committer
- I acknowledge that I am a maintainer/committer of the Apache Airflow project.
Issue Analytics
- State:
- Created 2 years ago
- Reactions:3
- Comments:23 (23 by maintainers)
Top Results From Across the Web
Oregon Enacts Temporary Rule Requiring Healthcare Worker ...
“Healthcare providers and healthcare staff” and their employers have until September 30, 2021, to comply with the rule.
Read more >COVID-19: FDA Took Steps to Help Make Tests Available
As of September 30, 2021, FDA had exercised its enforcement discretion for 370 tests. Test developers had submitted EUA requests for these tests...
Read more >Justice Department's False Claims Act Settlements and ...
The Justice Department obtained more than $5.6 billion in settlements and judgments from civil cases involving fraud and false claims ...
Read more >H.R.1319 - 117th Congress (2021-2022): American Rescue ...
This bill has the status Became Law. Here are the steps for Status of Legislation: Introduced. Array ( [actionDate] => 2021-02-24 [displayText] =>...
Read more >Reporting & Auditing - Provider Relief - HRSA
Providers who were required to report during Reporting Period 3: ... in RP3 on payments received between January 1, 2021 and June 30,...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
#17609 works as expected
From: Jarek Potiuk @.> Reply-To: apache/airflow @.> Date: Thursday, September 30, 2021 at 6:26 AM To: apache/airflow @.> Cc: “Jackson, John” @.>, Mention @.***> Subject: [apache/airflow] Status of testing Providers that were prepared on September 30, 2021 (#18638)
Body
I have a kind request for all the contributors to the latest provider packages release. Could you help us to test the RC versions of the providers and let us know in the comment, if the issue is addressed there.
Providers that need testing
Those are providers that require testing as there were some substantial changes introduced:
Provider amazon: 2.3.0rc1https://pypi.org/project/apache-airflow-providers-amazon/2.3.0rc1
Provider apache.cassandra: 2.1.0rc1https://pypi.org/project/apache-airflow-providers-apache-cassandra/2.1.0rc1
Provider apache.hdfs: 2.1.1rc1https://pypi.org/project/apache-airflow-providers-apache-hdfs/2.1.1rc1
Provider apache.hive: 2.0.2rc1https://pypi.org/project/apache-airflow-providers-apache-hive/2.0.2rc1
Provider apache.livy: 2.1.0rc1https://pypi.org/project/apache-airflow-providers-apache-livy/2.1.0rc1
Provider asana: 1.1.0rc1https://pypi.org/project/apache-airflow-providers-asana/1.1.0rc1
Provider cncf.kubernetes: 2.0.3rc1https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/2.0.3rc1
Provider databricks: 2.0.2rc1https://pypi.org/project/apache-airflow-providers-databricks/2.0.2rc1
Provider docker: 2.2.0rc1https://pypi.org/project/apache-airflow-providers-docker/2.2.0rc1
Provider elasticsearch: 2.0.3rc1https://pypi.org/project/apache-airflow-providers-elasticsearch/2.0.3rc1
Provider exasol: 2.0.1rc1https://pypi.org/project/apache-airflow-providers-exasol/2.0.1rc1
Provider google: 6.0.0rc1https://pypi.org/project/apache-airflow-providers-google/6.0.0rc1
Provider hashicorp: 2.1.1rc1https://pypi.org/project/apache-airflow-providers-hashicorp/2.1.1rc1
Provider jdbc: 2.0.1rc1https://pypi.org/project/apache-airflow-providers-jdbc/2.0.1rc1
Provider microsoft.azure: 3.2.0rc1https://pypi.org/project/apache-airflow-providers-microsoft-azure/3.2.0rc1
Provider microsoft.psrp: 1.0.1rc1https://pypi.org/project/apache-airflow-providers-microsoft-psrp/1.0.1rc1
Provider mongo: 2.1.0rc1https://pypi.org/project/apache-airflow-providers-mongo/2.1.0rc1
Provider neo4j: 2.0.2rc1https://pypi.org/project/apache-airflow-providers-neo4j/2.0.2rc1
Provider openfaas: 2.0.0rc1https://pypi.org/project/apache-airflow-providers-openfaas/2.0.0rc1
Provider papermill: 2.1.0rc1https://pypi.org/project/apache-airflow-providers-papermill/2.1.0rc1
Provider postgres: 2.3.0rc1https://pypi.org/project/apache-airflow-providers-postgres/2.3.0rc1
Provider salesforce: 3.2.0rc1https://pypi.org/project/apache-airflow-providers-salesforce/3.2.0rc1
Provider samba: 3.0.0rc1https://pypi.org/project/apache-airflow-providers-samba/3.0.0rc1
Provider slack: 4.1.0rc1https://pypi.org/project/apache-airflow-providers-slack/4.1.0rc1
Provider snowflake: 2.2.0rc1https://pypi.org/project/apache-airflow-providers-snowflake/2.2.0rc1
Provider sqlite: 2.0.1rc1https://pypi.org/project/apache-airflow-providers-sqlite/2.0.1rc1
Provider ssh: 2.2.0rc1https://pypi.org/project/apache-airflow-providers-ssh/2.2.0rc1
Provider yandex: 2.1.0rc1https://pypi.org/project/apache-airflow-providers-yandex/2.1.0rc1
Providers that do not need testing
We have a number of providers that had doc-only changes so they are not released.
Committer
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/apache/airflow/issues/18638, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AR7SQOMM3YGGUHNSX5ZPBM3UERQOBANCNFSM5FCKXUEA. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
#17448 Has at least one important bug, so can’t be included in this release