Improving Neural Network Efficiency Using Piecewise Linear Approximation of Activation Functions
Activation functions play a pivotal role in Neural Networks by enabling the modeling of complex non-linear relationships within data. However, the computational cost associated with certain activation functions, such as the hyperbolic tangent (tanh) and
Pavan Reddy, Aditya Sanjay Gujral
doaj +2 more sources
Stochastic piecewise linear function fitting with application to ultrasound shear wave imaging. [PDF]
Ingle A+3 more
europepmc +3 more sources
Data‐driven performance metrics for neural network learning
Summary Effectiveness of data‐driven neural learning in terms of both local mimima trapping and convergence rate is addressed. Such issues are investigated in a case study involving the training of one‐hidden‐layer feedforward neural networks with the extended Kalman filter, which reduces the search for the optimal network parameters to a state ...
Angelo Alessandri+2 more
wiley +1 more source
The aim of this paper is to develop an accurate symmetric collocation scheme for a class of linear stationary singular perturbation problems with two boundary layers.
F. Z. Geng
doaj +1 more source
Proliferation of non-linear excitations in the piecewise-linear perceptron
We investigate the properties of local minima of the energy landscape of a continuous non-convex optimization problem, the spherical perceptron with piecewise linear cost function and show that they are critical, marginally stable and displaying a set of
Antonio Sclocchi, Pierfrancesco Urbani
doaj +1 more source
Parameter-dependent PWQ Lyapunov function stability criteria for uncertain piecewise linear systems [PDF]
The calculation of piecewise quadratic (PWQ) Lyapunov functions is addressed in view of stability analysis of uncertain piecewise linear dynamics. As main contribution, the linear matrix inequality (LMI) approach proposed in (Johansson and Rantzer, 1998)
Morten Hovd, Sorin Olaru
doaj +1 more source
Stability Analysis of Switched Linear Singular Systems with Unstable and Stable Modes
In this paper, stability is studied for a class of switched singular systems containing both stable and unstable modes. By introducing a time-varying piecewise Lyapunov function (TVPLF) and a mode-dependent average dwell time (ADT) switching rule, the ...
Jiandong Xiong+3 more
doaj +1 more source
Dynamic programming network for point target detection
To improve the efficiency of the dim point target detection based on dynamic programming (DP), this paper proposes a multi-frame target detection method based on a DP ring network (DPRN).
Jingneng Fu, Hongyan Wei
doaj +1 more source
Piecewise Linear and Nonlinear Window Functions for Modelling of Nanostructured Memristor Device [PDF]
The present paper reports two new window functions viz. piecewise linear window function and nonlinear window function for modelling of the nanostructured memristor device.
T.D. Dongale+7 more
doaj
Two‐step, piecewise‐linear SAR ADC with programmable transfer function
A 7‐bit successive approximation register (SAR) analogue‐to‐digital converter (ADC) with programmable transfer functions is presented. Building upon prior art, a two‐step successive approximation technique is used to implement a piecewise‐linear ...
S. Sengupta, M.L. Johnston
doaj +1 more source