A Survey of the Usages of Deep Learning for Natural Language Processing | IEEE Journals & Magazine | IEEE Xplore

A Survey of the Usages of Deep Learning for Natural Language Processing


Abstract:

Over the last several years, the field of natural language processing has been propelled forward by an explosion in the use of deep learning models. This article provides...Show More

Abstract:

Over the last several years, the field of natural language processing has been propelled forward by an explosion in the use of deep learning models. This article provides a brief introduction to the field and a quick overview of deep learning architectures and methods. It then sifts through the plethora of recent studies and summarizes a large assortment of relevant contributions. Analyzed research areas include several core linguistic processing issues in addition to many applications of computational linguistics. A discussion of the current state of the art is then provided along with recommendations for future research in the field.
Published in: IEEE Transactions on Neural Networks and Learning Systems ( Volume: 32, Issue: 2, February 2021)
Page(s): 604 - 624
Date of Publication: 21 April 2020

ISSN Information:

PubMed ID: 32324570

Funding Agency:


I. Introduction

The field of natural language processing (NLP) encompasses a variety of topics, which involves the computational processing and understanding of human languages. Since the 1980s, the field has increasingly relied on data-driven computation involving statistics, probability, and machine learning [1], [2]. Recent increases in computational power and parallelization, harnessed by graphical processing units (GPUs) [3], [4], now allow for “deep learning,” which utilizes artificial neural networks (ANNs), sometimes with billions of trainable parameters [5]. In addition, the contemporary availability of large data sets, facilitated by sophisticated data collection processes, enables the training of such deep architectures [6]–[8].

Contact IEEE to Subscribe

References

References is not available for this document.