Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Can't load >5 Audio summaries, Broken pipe error

See original GitHub issue

Migrated from https://github.com/tensorflow/tensorflow/issues/8055.

There’s a bunch more discussion on the original thread, plus some repro files from @lemonzi

Possibly related: https://github.com/tensorflow/tensorflow/issues/4207 Setup: OSX 10.10, TF nightly build of 2017-03-02 without GPU, Python 2.7.13. Affects both Chrome 56.0 and Safari 10.0. I think the official 1.0.0 release also had this issue.

My model logs relatively long audio summaries (~3 minutes long at 16 kHz), and created around 60 of them overnight. The issue also appears with fewer summaries created, at least on Chrome.

When using Chrome, they only load upon playback. Only the first 5 or so that I play will work; after that (even if I pause them) I can’t get the others to play unless I restart TensorBoard. When using Safari, all of them try to load at once and nothing works.

On the TensorBoard side, I see a bunch of error: [Errno 32] Broken pipe, which could mean the browser tries to manage the incoming streams and TensorBoard doesn’t know how to defer the transfers (see this post).

For Chrome, there is a limit of 6 concurrent audio downloads. I think in my case the audio keeps the connection open even after I pause it, and instead of downloading the whole file it streams it, so it never closes and I can’t play other files. I may need to restart TensorBoard to clear the browser cache, or maybe TensorBoard itself has a limit on the concurrent streams and they don’t close even after a page reload. For Safari, I think it doesn’t wait until playback to download the files, so all 60 players start the download concurrently and only the first ones survive.

If it’s not a bug on the TensorBoard server and the summaries can’t be prevented from keeping the connection open on pause or stop, I guess a possible solution could be to have a global player and load the audio files to it on-demand when requesting a summary, rather than each summary having its own player.