Pipelines no longer working in dev server after updating to latest cloud sdk
See original GitHub issueI have a mapreduce pipeline that worked in SDK 122 that now fails in the dev server with the following error after updating to SDK 126:
Traceback (most recent call last):
File "/vl/local/google-cloud-sdk/platform/google_appengine/lib/webapp2-2.5.2/webapp2.py", line 570, in dispatch
return method(*args, **kwargs)
File "/Users/stanton/src/vlshare/appserver/src/vl/base.py", line 645, in wrapper
return handler(*args, **kwargs)
File "/Users/stanton/src/vlshare/appserver/src/vlops/handlers.py", line 319, in any
result = func(self.request)
File "/Users/stanton/src/vlshare/appserver/src/vlops/admin/files.py", line 301, in _getZone
result = launchPipeline(GetZonePipeline(zone.key.urlsafe()))
File "/Users/stanton/src/vlshare/appserver/src/vl/pipe_utils.py", line 62, in launchPipeline
pipeline.start(base_path='/ops/pipeline')
File "/Users/stanton/src/vlshare/appserver/src/lib/pipeline/pipeline.py", line 673, in start
self, idempotence_key, str(e)))
PipelineSetupError: Error starting vlops.admin.files.GetZonePipeline(*('aghkZXZ-Tm9uZXIXCxIKWm9uZUVudGl0eRiAgICAgMCvCgyiAQZnbG9iYWw',), **{})#342c4ceab7084adfb389b35b45960fdd:
As far as I can tell the pipeline is having problems submitting tasks to the task queue. Note that the pipeline is not running in the default service. Also, everything works as expected in the production environment, so this is specifically a problem with the dev server.
Any ideas? What additional logging would be helpful here?
Issue Analytics
- State:
- Created 7 years ago
- Reactions:3
- Comments:9
Top Results From Across the Web
cloud sdk 123 causes PipelineSetupError in dev server #72
I have a mapreduce pipeline that worked in SDK 122 that now fails in the dev server with the following error after updating...
Read more >Troubleshoot pipeline runs - Azure DevOps - Microsoft Learn
Learn how to troubleshoot pipeline runs in Azure Pipelines and Team Foundation Server.
Read more >Pipeline troubleshooting and debugging | Cloud Dataflow
This page provides troubleshooting tips and debugging strategies that you might find helpful if you're having trouble building or running your Dataflow ...
Read more >FAQs and troubleshooting - Acquia Docs
After you fix any detected issues with any pipeline jobs, run the start command again to restart the build. Script failures¶. By default,...
Read more >Pipelines API - GitLab Docs
scope, string, no, The scope of pipelines, one of: running , pending ... updated_after, datetime, no, Return pipelines updated after the specified date....
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
This is fixed by: https://github.com/GoogleCloudPlatform/appengine-pipelines/commit/2f1930b0be21a40077676c6fc19a6b95801caa9e
Indeed this is happening, and changing version to
default
works. (GoogleAppEnginePipeline version 1.9.22.1)What would a definite solution to this problem would look like so I can make a PR?