SQL Syntax errors on startup
See original GitHub issueApache Airflow version: 2.0.0
What happened:
While investigating issues relating to task getting stuck, I saw this sql error in postgres logs. I am not entirely sure of what it impacts but I thought of letting you know.
ERROR: column "connection.password" must appear in the GROUP BY clause or be used in an aggregate function at character 8
STATEMENT: SELECT connection.password AS connection_password, connection.extra AS connection_extra, connection.id AS connection_id, connection.conn_id AS connection_conn_id, connection.conn_type AS connection_conn_type, connection.description AS connection_description, connection.host AS connection_host, connection.schema AS connection_schema, connection.login AS connection_login, connection.port AS connection_port, connection.is_encrypted AS connection_is_encrypted, connection.is_extra_encrypted AS connection_is_extra_encrypted, count(connection.conn_id) AS count_1
FROM connection GROUP BY connection.conn_id
HAVING count(connection.conn_id) > 1
ERROR: current transaction is aborted, commands ignored until end of transaction block
STATEMENT: SELECT connection.password AS connection_password, connection.extra AS connection_extra, connection.id AS connection_id, connection.conn_id AS connection_conn_id, connection.conn_type AS connection_conn_type, connection.description AS connection_description, connection.host AS connection_host, connection.schema AS connection_schema, connection.login AS connection_login, connection.port AS connection_port, connection.is_encrypted AS connection_is_encrypted, connection.is_extra_encrypted AS connection_is_extra_encrypted
FROM connection
WHERE connection.conn_type IS NULL
How to reproduce it:
- Run
docker-compose run initdb
- Run
docker-compose run upgradedb
Here's my docker-compose
version: "3.2"
networks:
airflow:
services:
postgres:
container_name: af_postgres
image: postgres:9.6
environment:
- POSTGRES_USER=airflow
- POSTGRES_DB=airflow
- POSTGRES_PASSWORD=airflow
volumes:
- ./postgresql/data:/var/lib/postgresql/data
command: >
postgres
-c listen_addresses=*
-c logging_collector=on
-c log_destination=stderr
networks:
- airflow
initdb:
container_name: af_initdb
image: docker.io/apache/airflow:2.0.0-python3.7
environment:
- AIRFLOW__CORE__SQL_ALCHEMY_CONN=postgresql+psycopg2://airflow:airflow@postgres:5432/airflow
depends_on:
- postgres
entrypoint: /bin/bash
command: -c "airflow db init"
networks:
- airflow
upgradedb:
container_name: af_upgradedb
image: docker.io/apache/airflow:2.0.0-python3.7
environment:
- AIRFLOW__CORE__SQL_ALCHEMY_CONN=postgresql+psycopg2://airflow:airflow@postgres:5432/airflow
depends_on:
- postgres
entrypoint: /bin/bash
command: -c "airflow db upgrade"
networks:
- airflow
Anything else we need to know:
Upon looking the code, I believe having Connection.conn_id
here will resolve the sql syntax error.
Issue Analytics
- State:
- Created 3 years ago
- Reactions:2
- Comments:12 (10 by maintainers)
Top Results From Across the Web
Debugging SQL syntax errors - Metabase
Reading an error message shouldn't feel like solving a riddle. This debugging guide explains what you can do about stubborn queries that refuse...
Read more >Syntax error in SQL statement after upgrading spring-boot ...
I've tested both syntaxes (with and without final comma ",") and both work just fine, as a standalone SQL query, in an SQL...
Read more >Common SQL syntax errors and how to resolve them
In this article, we are going to describe some of the most common SQL syntax errors, and explains how you can resolve these...
Read more >Database Engine events and errors - SQL Server
Consult this MSSQL error code list to find explanations for error messages for SQL Server database engine events.
Read more >The Fastest Way To Locate Errors In Your SQL Query
In about 60 seconds you will never debug error messages in SQL Server ... relative to the batch starting point of the erroneous...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Hello @kaxil , I am still getting this error,
You are right – https://github.com/apache/airflow/pull/13783 should fix it