MyGrad operations need a constant=False keyword arg
See original GitHub issueCurrently, involving a non-constant Tensor in repeated operations without ever calling null_gradients
results in an ever-growing list of ops. This is a problem when using a model for evaluation.
One solution to this, and a desirable option to have otherwise, is to let each function be called with a constant=False
keyword argument, which controls whether or not the output is a constant.
Issue Analytics
- State:
- Created 5 years ago
- Reactions:1
- Comments:6 (3 by maintainers)
Top Results From Across the Web
MyGrad Documentation
MyGrad's primary goal is to make automatic differentiation accessible and easy to use across the Python/NumPy ecosystem.
Read more >Full API Documentation — iminuit 1.0.6-dev documentation
Builtin Keyword Arguments: throw_nan: fcn can be set to raise RuntimeError when it encounters nan. (Default False). pedantic: warns about parameters that do ......
Read more >NEP 18 — A dispatch mechanism for NumPy's high level array ...
We propose the __array_function__ protocol, to allow arguments of NumPy functions to define how that function operates on them. This will allow ...
Read more >https://heasarc.gsfc.nasa.gov/ftools/fhelp/cfortra...
C programmers need not embed FORTRAN argument passing mechanisms into. their code. ... representation of TRUE and FALSE on all machines. cfortran.h does...
Read more >jams_fortran/cfortran.doc at master · mcuntz/jams_fortran · GitHub
HP9000> # Depending on the compiler version, you may need to include the ... AbsoftUNIX> # Absoft Fortran for all UNIX based operating...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Oh… I need to remember why I put that ValueError there. That is a relic from mygrad one year ago!
I am pretty sure that constant Tensors can safely support setitem. I will check it our tonight.