Multi-step learning rule for recurrent neural models: an application to time series forecasting [PDF]
Multi-step prediction is a difficult task that has attracted increasing interest in recent years. It tries to achieve predictions several steps ahead into the future starting from current information.
Galván, Inés M. +3 more
core +1 more source
Traffic Graph Convolutional Recurrent Neural Network: A Deep Learning Framework for Network-Scale Traffic Learning and Forecasting [PDF]
Traffic forecasting is a particularly challenging application of spatiotemporal forecasting, due to the time-varying traffic patterns and the complicated spatial dependencies on road networks.
Zhiyong Cui +4 more
semanticscholar +1 more source
Recurrent Neural Network Regularization
We present a simple regularization technique for Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units. Dropout, the most successful technique for regularizing neural networks, does not work well with RNNs and LSTMs. In this paper, we show how to correctly apply dropout to LSTMs, and show that it substantially reduces overfitting on
Wojciech Zaremba +2 more
openaire +3 more sources
Applications of recurrent neural networks in batch reactors. Part I: NARMA modelling of the dynamic behaviour of the heat transfer fluid [PDF]
This paper is focused on the development of nonlinear models, using artificial neural networks, able to provide appropriate predictions when acting as process simulators. The dynamic behaviour of the heat transfer fluid temperature in a jacketed chemical
J.M. Zaldı́var +3 more
core +1 more source
General Recurrent Neural Network for Solving Generalized Linear Matrix Equation
This brief proposes a general framework of the nonlinear recurrent neural network for solving online the generalized linear matrix equation (GLME) with global convergence property. If the linear activation function is utilized, the neural state matrix of
Zhan Li, Hong Cheng, Hongliang Guo
doaj +1 more source
Clustering Based on Continuous Hopfield Network
Clustering aims to group n data samples into k clusters. In this paper, we reformulate the clustering problem into an integer optimization problem and propose a recurrent neural network with n×k neurons to solve it. We prove the stability and convergence
Yao Xiao +3 more
doaj +1 more source
Bayesian Recurrent Neural Networks
In this work we explore a straightforward variational Bayes scheme for Recurrent Neural Networks. Firstly, we show that a simple adaptation of truncated backpropagation through time can yield good quality uncertainty estimates and superior regularisation at only a small extra computational cost during training, also reducing the amount of parameters by
Meire Fortunato +2 more
openaire +3 more sources
Restricted Recurrent Neural Networks [PDF]
Recurrent Neural Network (RNN) and its variations such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU), have become standard building blocks for learning online data of sequential nature in many research areas, including natural language processing and speech data analysis.
Enmao Diao, Jie Ding 0002, Vahid Tarokh
openaire +2 more sources
Exponential stability of delayed recurrent neural networks with Markovian jumping parameters [PDF]
This is the post print version of the article. The official published version can be obtained from the link below - Copyright 2006 Elsevier Ltd.In this Letter, the global exponential stability analysis problem is considered for a class of recurrent ...
Liu, Y, Yu, L, Wang, Z, Iu, X
core +1 more source
Detection of Shoplifting on Video Using a Hybrid Network
Shoplifting is a major problem for shop owners and many other parties, including the police. Video surveillance generates huge amounts of information that staff cannot process in real time.
Lyudmyla Kirichenko +3 more
doaj +1 more source

