question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

has_aux for forward-mode differentiation functions

See original GitHub issue

Related to PR https://github.com/google/jax/pull/484

We should have corresponding has_aux implementation of passing side-information for the forward-mode functions like jvp, jacfwd etc.

My use case is under a scenario that forward-mode is much more efficient than the reverse-mode.

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Comments:7 (5 by maintainers)

github_iconTop GitHub Comments

3reactions
mtthsscommented, Apr 3, 2019

It would indeed be very useful if jacfwd and jacrev had the has_aux option

1reaction
mtthsscommented, Mar 5, 2020

Can we bump this up?

Read more comments on GitHub >

github_iconTop Results From Across the Web

Forward Mode Automatic Differentiation & Dual Numbers
While forward mode AD computes the derivative at the same time as the variable evaluation, backprop does so in the separate backward phase. ......
Read more >
Forward-Mode Differentiation of Maxwell's Equations - arXiv
We present a previously unexplored forward-mode differentiation method for Maxwell's equations, with applications in the field of sensitivity ...
Read more >
3.4 Automatic Differentiation - the forward mode
Since our variable w (our MyTuple object) keeps track of both the function and derivative values, all we need to do in order...
Read more >
Automatic Differentiation: Forward and Reverse - Jingnan Shi
In the rest of this post, I introduce the definition of evaluation traces, and the two modes of AD: forward and reverse.
Read more >
Unraveling Automatic Differentiation | Analytics Vidhya - Medium
Most ML/DL libraries use AD to calculate gradients and derivatives. It has two modes: Forward mode and Reverse mode.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found