A New Class of Activation Functions Based on the Correcting Amendments |
Author(s): |
| Nikolay Kyurkchiev , University of Plovdiv Paisii Hilendarski |
Keywords: |
| Parametric activation function based on "amendments" of "Gompertz - type" and "Hyperbolic Tangent - type" - (PGHAF), Sign function, Hausdorff distance, Upper and lower bounds |
Abstract |
|
We will explore the interesting methodological task for constructing new activation functions using "correcting amendments" for example from a combination of amendment of "Gompertz - type" and "Hyperbolic Tangent - type". We prove upper and lower estimates for the Hausdorff approximation of the sign function by means of this new class of parametric activation functions - (PGHAF). Numerical examples, illustrating our results are given. |
Other Details |
|
Paper ID: IJSRDV6I20203 Published in: Volume : 6, Issue : 2 Publication Date: 01/05/2018 Page(s): 565-568 |
Article Preview |
|
|
|
|
