question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[ALBERT]: LookupError: gradient registry has no entry for: AddV2

See original GitHub issue

When run run_classifier_with_tfhub.py, but the training crashed. The error is:

LookupError: No gradient defined for operation 'module_apply_tokens/bert/encoder/transformer/group_0_11/layer_11/inner_group_0/LayerNorm_1/batchnorm/add_1' (op type: AddV2)

My tensorflow-gpu version is 1.14.0

Anyone knows the reason, pls help… Thanks

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:8

github_iconTop GitHub Comments

1reaction
0x0539commented, Jan 8, 2020

Duplicate of #94

Can you try using the TF-Hub modules with “/3” suffix? We regenerated them using TF 1.15 (see Jan 7 update in the readme).

1reaction
np-2019commented, Oct 30, 2019

I tried upgrading the version of Tensorflow to 1.15 and that helped me bypass the issue.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Tensorflow RandomContrast Layer Error "LookupError: ...
Tensorflow RandomContrast Layer Error "LookupError: gradient registry has no entry for: AdjustContrastv2" · Ask Question. Asked 10 months ago.
Read more >
LookupError: gradient registry has no entry for
Hi guys,. with the new `raw_rnn`, I was able to implement a dynamic rnn decoder (thanks to ebrevdo).
Read more >
tf.RegisterGradient | TensorFlow v2.11.0
For an op with m inputs and n outputs, the gradient function is a function that takes the original Operation and n Tensor...
Read more >
No gradient defined for operation 'CudnnRNN' (op type
LookupError : gradient registry has no entry for CudnnRNN. During handling of the above exception, another exception occurred:enter code here.
Read more >
No gradient defined for operation 'inference/sample/FloorMod ...
So, once I have the Cartesian coordinates (for instance a multivariate ... _name, name)) LookupError: gradient registry has no entry for: ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found