question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

airflow 2.0.0 sqlite3.OperationalError syntax error

See original GitHub issue

Why I keep got this error when scheduler run my task?

[2020-12-31 03:05:22,716] {taskinstance.py:1396} ERROR - (sqlite3.OperationalError) near ",": syntax error
[SQL: DELETE FROM rendered_task_instance_fields WHERE rendered_task_instance_fields.dag_id = ? AND rendered_task_instance_fields.task_id = ? AND (rendered_task_instance_fields.dag_id, rendered_task_instance_fields.task_id, rendered_task_instance_fields.execution_date) NOT IN (SELECT rendered_task_instance_fields.dag_id, rendered_task_instance_fields.task_id, rendered_task_instance_fields.execution_date 
FROM rendered_task_instance_fields 
WHERE rendered_task_instance_fields.dag_id = ? AND rendered_task_instance_fields.task_id = ? ORDER BY rendered_task_instance_fields.execution_date DESC
 LIMIT ? OFFSET ?)]
[parameters: ('comic_app_v1', 'superman_task', 'comic_app_v1', 'superman_task', 30, 0)]
(Background on this error at: http://sqlalche.me/e/13/e3q8)
Traceback (most recent call last):
  File "/home/user/py37/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1277, in _execute_context
    cursor, statement, parameters, context
  File "/home/user/py37/lib/python3.7/site-packages/sqlalchemy/engine/default.py", line 593, in do_execute
    cursor.execute(statement, parameters)
sqlite3.OperationalError: near ",": syntax error

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Reactions:1
  • Comments:23 (13 by maintainers)

github_iconTop GitHub Comments

4reactions
potiukcommented, Dec 31, 2020

You have a very old sqlite3 version. Please upgrade to latest version.

2reactions
potiukcommented, Jan 5, 2021

FYI. 3.15.0 is the minimum version that works. I am adding it to the docs and Airflow will fail hard if sqlite3 version is less than that (PR is coming for #13493)

Read more comments on GitHub >

github_iconTop Results From Across the Web

sqlite syntax error with simple task on apache airflow-2.0
Try update sqlite3 · i tried sudo pip install --upgrade pysqlite but got: pysqlite is not supported on Python 3. · Try these...
Read more >
[GitHub] [airflow] potiuk commented on issue #13397: airflow 2.0.0 ...
OperationalError syntax error ... If you are running some old system (RHE7 for sure has this problem) the sqlite3 vrersion there might be...
Read more >
sqlite3.operationalerror: near "order": syntax error - You.com
Some users testing Airlfow 2.0 with sqlite noticed that for old versions of sqlite, Airflow does not run tasks and fails with 'sqlite3.OperationalError:...
Read more >
Changelog — Airflow Documentation
Add Airflow 2.0.0 to requirements table (#13140) ... Fix syntax error in Dockerfile 'maintainer' Label (#10899). The entrypoints in Docker Image should be ......
Read more >
org.apache.airflow.commits - 2021 January - 5819 ... - MarkMail
[GitHub] [airflow] venezianluis commented on issue #13397: airflow 2.0.0 sqlite3.OperationalError syntax error - GitBox. [jira] [Commented] (AIRFLOW-6786) ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found