question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

tensorflow beta0 or 1, tensorboard: Windows fatal exception: access violation

See original GitHub issue

Environment information (required)

Windows 10 RTX 2080 Ti tensortlow-gpu== 2.0.0beta1 CUDA 10.0, CUDNN cudnn-10.0-windows10-x64-v7.4.2.24

Issue description

When I update my tensorflow-gpu==alpha0 to tensorflow-gpu== 2.0.0beta1,I open tensorboard to view my training process,

I:\Tensorflow\pix2pix\train_logs\20190628-100842>tensorboard --logdir train
TensorBoard 1.14.0a20190603 at http://DESKTOP-K1IS85B:6006/ (Press CTRL+C to quit)

However, when I open the chrome and visit the site, a mistake arised as follows:

`Windows fatal exception: access violation

Thread 0x00004044 (most recent call first):
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorflow\python\lib\io\file_io.py", line 596 in is_directory_v2
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorflow\python\lib\io\file_io.py", line 582 in is_directory
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorflow\python\lib\io\file_io.py", line 634 in list_directory_v2
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\backend\event_processing\plugin_asset_util.py", line 76 in ListAssets
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\backend\event_processing\plugin_event_accumulator.py", line 191 in PluginAssets
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\backend\event_processing\plugin_event_multiplexer.py", line 263 in <dictcomp>
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\backend\event_processing\plugin_event_multiplexer.py", line 263 in PluginAssets
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\plugins\profile\profile_plugin.py", line 251 in generate_run_to_tools
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\plugins\profile\profile_plugin.py", line 130 in compute_is_active
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 864 in run
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 916 in _bootstrap_inner
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 884 in _bootstrap

Thread 0x000015f4 (most recent call first):
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socket.py", line 586 in readinto
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\werkzeug\serving.py", line 324 in handle_one_request
  File "c:\users\admin\appdata\local\programs\python\python36\lib\http\server.py", line 418 in handle
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\werkzeug\serving.py", line 293 in handle
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socketserver.py", line 721 in __init__
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socketserver.py", line 361 in finish_request
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socketserver.py", line 651 in process_request_thread
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 864 in run
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 916 in _bootstrap_inner
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 884 in _bootstrap

Thread 0x00003f70 (most recent call first):
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socket.py", line 586 in readinto
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\werkzeug\serving.py", line 324 in handle_one_request
  File "c:\users\admin\appdata\local\programs\python\python36\lib\http\server.py", line 418 in handle
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\werkzeug\serving.py", line 293 in handle
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socketserver.py", line 721 in __init__
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socketserver.py", line 361 in finish_request
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socketserver.py", line 651 in process_request_thread
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 864 in run
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 916 in _bootstrap_inner
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 884 in _bootstrap

Current thread 0x00001284 (most recent call first):
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorflow\python\lib\io\file_io.py", line 84 in _preread_check
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorflow\python\lib\io\file_io.py", line 122 in read
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorflow\python\lib\io\file_io.py", line 333 in read_file_to_string
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorflow\python\training\checkpoint_management.py", line 273 in get_checkpoint_state
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorflow\python\training\checkpoint_management.py", line 336 in latest_checkpoint
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\plugins\projector\projector_plugin.py", line 663 in _find_latest_checkpoint
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\plugins\projector\projector_plugin.py", line 403 in _read_latest_config_files
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\plugins\projector\projector_plugin.py", line 323 in configs
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\plugins\projector\projector_plugin.py", line 306 in _determine_is_active
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 864 in run
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 916 in _bootstrap_inner
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 884 in _bootstrap

Thread 0x000014e0 (most recent call first):
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socket.py", line 586 in readinto
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\werkzeug\serving.py", line 324 in handle_one_request
  File "c:\users\admin\appdata\local\programs\python\python36\lib\http\server.py", line 420 in handle
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\werkzeug\serving.py", line 293 in handle
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socketserver.py", line 721 in __init__
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socketserver.py", line 361 in finish_request
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socketserver.py", line 651 in process_request_thread
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 864 in run
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 916 in _bootstrap_inner
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 884 in _bootstrap

Thread 0x00001428 (most recent call first):
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 295 in wait
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 551 in wait
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 851 in start
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\plugins\profile\profile_plugin.py", line 135 in is_active
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\backend\application.py", line 286 in _serve_plugins_listing
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\werkzeug\wrappers.py", line 308 in application
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\backend\application.py", line 317 in __call__
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\werkzeug\serving.py", line 258 in execute
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\werkzeug\serving.py", line 270 in run_wsgi
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\werkzeug\serving.py", line 328 in handle_one_request
  File "c:\users\admin\appdata\local\programs\python\python36\lib\http\server.py", line 420 in handle
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\werkzeug\serving.py", line 293 in handle
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socketserver.py", line 721 in __init__
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socketserver.py", line 361 in finish_request
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socketserver.py", line 651 in process_request_thread
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 864 in run
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 916 in _bootstrap_inner
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 884 in _bootstrap

Thread 0x00000acc (most recent call first):
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\backend\application.py", line 404 in _reload
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 864 in run
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 916 in _bootstrap_inner
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 884 in _bootstrap

Thread 0x00003698 (most recent call first):
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 295 in wait
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 551 in wait
  File "c:\users\admin\appdata\local\programs\python\python36\lib\threading.py", line 851 in start
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socketserver.py", line 666 in process_request
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socketserver.py", line 317 in _handle_request_noblock
  File "c:\users\admin\appdata\local\programs\python\python36\lib\socketserver.py", line 238 in serve_forever
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\werkzeug\serving.py", line 612 in serve_forever
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\program.py", line 233 in main
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\absl\app.py", line 251 in _run_main
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\absl\app.py", line 300 in run
  File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorboard\main.py", line 64 in run_main
  File "C:\Users\Admin\AppData\Local\Programs\Python\Python36\Scripts\tensorboard.exe\__main__.py", line 9 in <module>
  File "c:\users\admin\appdata\local\programs\python\python36\lib\runpy.py", line 85 in _run_code
  File "c:\users\admin\appdata\local\programs\python\python36\lib\runpy.py", line 193 in _run_module_as_main

Therefore, I re-install the tensorflow-gpu==2.0.0alpha0, everything is all right.

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:13 (1 by maintainers)

github_iconTop GitHub Comments

2reactions
WuJundecommented, Jul 6, 2019

I meet the similar problem and reinstalling doesn’t work

`Windows fatal exception: access violation

Current thread 0x00001548 (most recent call first): File “c:\programdata\anaconda3\lib\site-packages\tensorflow\python\lib\io\file_io.py”, line 384 in get_matching_files_v2 File “c:\programdata\anaconda3\lib\site-packages\tensorflow\python\lib\io\file_io.py”, line 363 in get_matching_files File “c:\programdata\anaconda3\lib\site-packages\magenta\models\image_stylization\image_stylization_create_dataset.py”, line 45 in _parse_style_files File “c:\programdata\anaconda3\lib\site-packages\magenta\models\image_stylization\image_stylization_create_dataset.py”, line 68 in main File “c:\programdata\anaconda3\lib\site-packages\absl\app.py”, line 251 in run_main File “c:\programdata\anaconda3\lib\site-packages\absl\app.py”, line 300 in run File “c:\programdata\anaconda3\lib\site-packages\tensorflow\python\platform\app.py”, line 40 in run File “c:\programdata\anaconda3\lib\site-packages\magenta\models\image_stylization\image_stylization_create_dataset.py”, line 100 in console_entry_point File "C:\ProgramData\Anaconda3\Scripts\image_stylization_create_dataset.exe_main.py", line 9 in <module> File “c:\programdata\anaconda3\lib\runpy.py”, line 85 in _run_code File “c:\programdata\anaconda3\lib\runpy.py”, line 193 in _run_module_as_main`

Some more information: It may seem have nothing to do with tensorboard, but wirely, just before it happened I met the error: https://github.com/tensorflow/tensorboard/issues/1433 I upgraded my absl under this environment, and it didn’t work. I then find the file actually linked to the absl in an another environment (don’t know why) . So I upgraded absl in all my environments. Then I re-run it and this error occured.

Does anyone have any advice? thank you

1reaction
dasmehdixcommented, Aug 19, 2019

I had same problem and solved it.Problem was occured when I tried to transfer learning with faster_rcnn_inception_v2_coco model.

As far as I understand the problem about the config file of the model you try to use.First check the path of config file correct or wrong.Then, check the paths given in the config file.I solved the problem by correct the paths.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Windows fatal exception: access violation with tensorboard
I installed tensorflow in the following steps 1, Install anaconda in win 10 2, conda install -c anaconda tensorflow-gpu=1.14
Read more >
Windows fatal exception: access violation - Python Help
If an attempt to access an address in memory fails because the address isn't allocated or because the type of access isn't allowed...
Read more >
Package List — Spack 0.20.0.dev0 documentation
Versions: 2.0.1, 2.0.0, 1.9.3, 1.9.2; Build Dependencies: java, maven ... conmon, squashfs, go, uuid, libgpg-error, libseccomp, git, cryptsetup ...
Read more >
Debugging Numerical Issues in TensorFlow Programs Using ...
Catastrophic events involving NaNs can sometimes occur during a TensorFlow program, crippling the model training processes.
Read more >
Windows fatal exception: access violation_执道者的博客
windows 访问冲突出现这种错误,而没有明确提示代码中哪里出错。方法:逐步调试。程序中设置断点,查看运行到哪一步才出现这个错误。
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found