Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

BeamDagRunner, Transform deadlock with Python 3.6

See original GitHub issue

Hi everyone,

Running the taxi_pipeline_beam example fails with

  from tensorflow_transform.output_wrapper import TFTransformOutput
  File "/srv/hops/anaconda/anaconda/envs/python36/lib/python3.6/site-packages/tensorflow_transform/output_wrapper.py", line 29, in <module>
    from tensorflow_transform.tf_metadata import metadata_io
  File "<frozen importlib._bootstrap>", line 968, in _find_and_load
  File "<frozen importlib._bootstrap>", line 149, in __enter__
  File "<frozen importlib._bootstrap>", line 94, in acquire
_frozen_importlib._DeadlockError: deadlock detected by _ModuleLock('tensorflow_transform.tf_metadata.metadata_io') at 139642620901192

while running Transform https://github.com/tensorflow/tfx/blob/0.14.0/tfx/examples/chicago_taxi_pipeline/taxi_pipeline_beam.py#L85

TFX version is 0.14, Beam is 2.15 and running on Flink 1.8.1.

All works well with Python 2.7. Has anyone encountered this issue before?

Thank you, Theo

Issue Analytics

State:
Created 4 years ago
Comments:18

Top GitHub Comments

1reaction

tvalentyncommented, Nov 20, 2019

All errors observed here should be fixed with https://github.com/apache/beam/pull/10167. Feel free to patch this PR. We plan to cherrypick this fix into Beam 2.17.0 that is in the works.

0reactions

google-ml-butler[bot]commented, Nov 22, 2019

Are you satisfied with the resolution of your issue? Yes No