Consider opening a GH discussions

Hi Patrick,

First I would like to thank you and everyone involved in this package and related research 🎉 ! I’ve been trying to use it, but I’m seeing some nans and I would really appreciate your (and/or others) insights on this. Therefore I would like to know your thoughts about opening a GH discussions tab for non-issues related conversations, which is basically a forum inside GH.

Best regards,

[darleybarreto]

Are you normalising your input data? (You should be.)

I wasn’t 😞 . That did solve my problem! Thank you so much for you attention and help with this!

[patrick-kidger]

To be clear, I don’t suggest making all activations tanh. Rather, parameterising your vector field as something like tanh(mlp(...)), where mlp is some MLP using e.g. a softplus activation.

It’s certainly possible for this kind of thing to happen due to the data dynamics. Are you normalising your input data? (You should be.)

I’d also suggest trying a fixed solver with a small time step, and just making sure that the output values you get then seem sane. If not, then that’s an indication of a possible problem independent of anything to do with the numerical integration.