question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

JupyterLab/Local pipeline execution fails with "Expected token < in JSON ..." for long running tasks

See original GitHub issue

Describe the issue See steps below. I was only able to always reproduce this on ODH, but not locally.

To Reproduce Steps to reproduce the behavior:

  1. In ODH launch JupyterHub and choose in the spawner dialog the s2i-lab-elyra:vX.Y.Z image
  2. Git clone https://github.com/elyra-ai/examples.git
  3. Open the NOAA pipeline.
  4. Run the pipeline locally.

image

There is no error logged in the Jupyter console. The web browser indicates that the POST https://jupyterhub-1-0-9-test.ptitzler-odh-442dbba0442be6c8c50f31ed96b00601-0000.sjc04.containers.appdomain.cloud/user/iam%23ptitzler@us.ibm.com/elyra/pipeline/schedule?1618515969761 request fails with status code 504, returning this message text:

<html><body><h1>504 Gateway Time-out</h1>
The server didn't respond in time.
</body></html>`

which causes the JSON parser error.

Expected behavior A clear and concise description of what you expected to happen.

  • The front end should catch processing errors.
  • Not sure to what extend the front end can provide a meaningful message since it doesn’t know whether the back-end sent “garbage”, whether the backend timed out and the long running request is still processing.
  • Insights why this always happens on ODH/JupyterHub/JupyterLab but not locally. The “long running job” completed within a few minutes and didn’t seem to be taking longer than usual.

Deployment information Describe what you’ve deployed and how:

  • Elyra version: 2.2.1
  • Installation source: official container image s2i-lab-elyra:v0.0.7
  • Deployment type: Open Data Hub

Issue Analytics

  • State:open
  • Created 2 years ago
  • Comments:10 (9 by maintainers)

github_iconTop GitHub Comments

2reactions
akchinSTCcommented, Apr 19, 2021

the deployment on openshift doesn’t appear to have any ingresses or routes configured in the odh project/namespace, so it’s probably using some global default. Short term, going to see if a quick config change will do the trick, but agree with

We should try to find a way to better handle long running submissions/runs

0reactions
usmcamp0811commented, Jul 7, 2022

I am seeing this error when I attempt to run in our Kubernetes Z2JH environment. If run the container that has Elyra installed (same thats used in the k8s cluster) it works. I am seeing a 403 error in the browser console at the elyra/pipeline/schedule?1657211511533 endpoint.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Backlog Long Term Milestone - GitHub
Backlog Long Term Milestone · elyra-ai/elyra. ... 1 of 2 tasks ... JupyterLab/Local pipeline execution fails with "Expected token < in JSON ..."...
Read more >
How to fix "SyntaxError: Unexpected token < in JSON at ...
This error occurs when you are trying to parse a string to JSON and the string ... Try executing the following code in...
Read more >
SyntaxError: Unexpected token < in JSON at position 0
Since it looks like the error seems to have something to do with pulling JSON data from the server, I tried starting from...
Read more >
Vlocity Deployment Returns Error Unexpected Token in JSON ...
The Vlocity Build Tool process all the Datapack.json files in that folder to find dependencies of the components that are going to be...
Read more >
What Is JSON and How to Handle an “Unexpected Token” Error
Learn what JSON is and how you can deal with errors occurring when parsing JSON data, such as "Unexpected Token < in JSON...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found