Using Special type activation function

Hi,

I am pretty new to neurodiffeq, thank you very much for an excellent library. I want to use special type activation function in particular f(x)= cos(1.75 x)* exp (-x**2/2) so how I will define the class for using this activation function? and how to call this function in this line fcnn=FCNN(hidden_units=(50,50, ), actv=nn.Tanh) Thank you in advance

[shuheng-liu]

I haven’t heard of the butterfly optimization algorithm. If you really want to try it out, you probably have to implement your own Optimizer. Here is an article.

Can you be a little bit more specific as to “Loss and validation graph”? In general, you can inject behavior, including custom plotting and logging using the callback feature.

[shuheng-liu]

exp(0.5) is just a constant. You can use np.exp or math.exp instead of torch.exp, which only works for pytorch tensors (similar to numpy arrays)