Add Tanh shrink activation function
See original GitHub issueThe TanhShrinkactivation function is missed in KotlinDL.
The desired PR addressing this issue should include:
- Implementation of activation class named as
TanhShrinkActivation(you can take inspiration from the implementation ofHardSigmoidas reference) added to theActivations.ktfile - Documentation of activation function
- JUnit tests in
apimodule - Support for export of activation function to JSON (see ModelSaver.kt)
- Support for import of activation function from JSON (see ModelLoader.kt)
P.S. If you want to take this ticket, please leave the comment below P.P.S Read the Contributing Guidelines.
The reference implementation could be taken from tensorflow-addons
Issue Analytics
- State:
- Created 2 years ago
- Comments:5 (3 by maintainers)
Top Results From Across the Web
Tanhshrink Activation Function - GM-RKB
A Tanhshrink Activation Function is a Hyperbolic Tangent-based Activation Function that is defined as [math] f(x)=x-Tanh(x)[/math]. Context:.
Read more >Addition of hardtanh and tanhshrink activation functions #2228
Hey everyone, I was thinking we have tanh activation function so why not add hardtanh annd tanhshrink functions too.
Read more >BNNS.ActivationFunction.tanhShrink - Apple Developer
An activation function that returns its input clamped to beta when that is greater than or equal to zero, otherwise it returns its...
Read more >Why is tanh almost always better than sigmoid as an activation ...
This makes the tanh function almost always better as an activation function (for hidden layers) rather than the sigmoid function.
Read more >What is PyTorch tanh with Examples? - eduCBA
Tanh Activation Function Benefits It could be used to convert the outputs of a neuron to a negative number because its output varies...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found

@zaleslaw sure, its Big Sur version 11.5.2 (M1 2020), I’ll try another machine then and get back to you.
I would like to work on this one, can you please send me a slack invite so I can discuss a few things, thanks in advance.