Results 11 to 20 of about 2,554,377 (251)

Natural language processing [PDF]

Annual Review of Information Science and Technology, 2003
Beginning with the basic issues of NLP, this chapter aims to chart the major research activities in this area since the last ARIST Chapter in 1996 (Haas, 1996), including: (i) natural language text processing systems - text summarization, information ...
Adams, Amsler, Bangalore, Barker, Benoît, Bian, Bondale, Carrick, Ceric, Chandrasekar, Chang, Charniak, Chen, Chowdhury, Chowdhury, Costantino, Cowie, Craven, Craven, Craven, Dogru, Evans, Feldman, Fernandez, Gaizauskas, Glasgow, Haas, Hayes, Hayes, Hedlund, Herath, Ide, Isahara, Jelinek, Jeong, Jurafsky, Kazakov, Kehler, Khoo, Kim, King, Lange, Lee, Lehmam, Lehtokangas, Lewis, Liddy, Liddy, Lovis, Ma, Magnini, Mani, Manning, Marquez, Martinez, Martinez, McMurchie, Meyer, Mihalcea, Mock, Moens, Morin, Narita, Nerbonne, Oard, Ogura, Oudet, Owei, Paris, Pasero, Pedersen, Perez-Carballo, Petreley, Pirkola, Poesio, Rosenfield, Roux, Say, Scarlett, Schenker, Silber, Smeaton, Smeaton, Smith, Sokol, Song, Sparck Jones, Staab, Stock, Tolle, Trybula, Tsuda, Vickery, Waldrop, Warner, Weigard, Wilks, Wong, Yang, Yang, Zadrozny, Zweigenbaum   +101 more
core   +5 more sources

Revisiting Pre-Trained Models for Chinese Natural Language Processing [PDF]

Findings, 2020
Bidirectional Encoder Representations from Transformers (BERT) has shown marvelous improvements across various NLP tasks, and consecutive variants have been proposed to further improve the performance of the pre-trained language models. In this paper, we
Che, Wanxiang, Cui, Yiming, Hu, Guoping, Liu, Ting, Qin, Bing, Wang, Shijin   +5 more
core   +2 more sources

Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing [PDF]

ACM Computing Surveys, 2021
This article surveys and organizes research works in a new paradigm in natural language processing, which we dub “prompt-based learning.” Unlike traditional supervised learning, which trains a model to take in an input x and predict an output y as P(y|x),
Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, Graham Neubig   +5 more
semanticscholar   +1 more source

Natural Language Processing [PDF]

International Journal of Advances in Scientific Research and Engineering, 2018
Natural language processing (NLP) refers to the field of study that focuses on the interactions between human language and computers. It is a computational approach to text analysis. It is the application of a wide range of computational techniques for the understanding, automatic analysis, and representation of human language.
Yu Zhou, Matthew N. O. Sadiku, Sarhan M. Musa   +2 more
  +8 more sources

Is ChatGPT a General-Purpose Natural Language Processing Task Solver? [PDF]

Conference on Empirical Methods in Natural Language Processing, 2023
Spurred by advancements in scale, large language models (LLMs) have demonstrated the ability to perform a variety of natural language processing (NLP) tasks zero-shot -- i.e., without adaptation on downstream data.
Chengwei Qin, Aston Zhang, Zhuosheng Zhang, Jiaao Chen, Michihiro Yasunaga, Diyi Yang   +5 more
semanticscholar   +1 more source

Attention in Natural Language Processing [PDF]

IEEE Transactions on Neural Networks and Learning Systems, 2021
Attention is an increasingly popular mechanism used in a wide range of neural architectures. The mechanism itself has been realized in a variety of formats. However, because of the fast-paced advances in this domain, a systematic overview of attention is still missing.
Andrea Galassi, Marco Lippi, Paolo Torroni   +2 more
openaire   +4 more sources

Organizing an in-class hackathon to correct PDF-to-text conversion errors of 1.0 [PDF]

Genomics & Informatics, 2020
This paper describes a community effort to improve earlier versions of the full-text corpus of Genomics & Informatics by semi-automatically detecting and correcting PDF-to-text conversion errors and optical character recognition errors during the first ...
Sunho Kim, Royoung Kim, Hee-Jo Nam, Ryeo-Gyeong Kim, Enjin Ko, Han-Su Kim, Jihye Shin, Daeun Cho, Yurhee Jin, Soyeon Bae, Ye Won Jo, San Ah Jeong, Yena Kim, Seoyeon Ahn, Bomi Jang, Jiheyon Seong, Yujin Lee, Si Eun Seo, Yujin Kim, Ha-Jeong Kim, Hyeji Kim, Hye-Lynn Sung, Hyoyoung Lho, Jaywon Koo, Jion Chu, Juwon Lim, Youngju Kim, Kyungyeon Lee, Yuri Lim, Meongeun Kim, Seonjeong Hwang, Shinhye Han, Sohyeun Bae, Sua Kim, Suhyeon Yoo, Yeonjeong Seo, Yerim Shin, Yonsoo Kim, You-Jung Ko, Jihee Baek, Hyejin Hyun, Hyemin Choi, Ji-Hye Oh, Da-Young Kim, Hyun-Seok Park   +44 more
doaj   +1 more source

Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey [PDF]

ACM Computing Surveys, 2021
Large, pre-trained language models (PLMs) such as BERT and GPT have drastically changed the Natural Language Processing (NLP) field. For numerous NLP tasks, approaches leveraging PLMs have achieved state-of-the-art performance. The key idea is to learn a
Bonan Min, Hayley Ross, Elior Sulem, Amir Pouran Ben Veyseh, Thien Huu Nguyen, Oscar Sainz, Eneko Agirre, Ilana Heinz, D. Roth   +8 more
semanticscholar   +1 more source

Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing [PDF]

ACM Trans. Comput. Heal., 2020
Pretraining large neural language models, such as BERT, has led to impressive gains on many natural language processing (NLP) tasks. However, most pretraining efforts focus on general domain corpora, such as newswire and Web.
Yu Gu, Robert Tinn, Hao Cheng, Michael R. Lucas, N. Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon   +8 more
semanticscholar   +1 more source

RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases

Computational Linguistics, 2021
Text-to-SQL is the problem of converting a user question into an SQL query, when the question and database are given. In this article, we present a neural network approach called RYANSQL (Recursively Yielding Annotation Network for SQL) to solve complex ...
DongHyun Choi, Myeong Cheol Shin, EungGyun Kim, Dong Ryeol Shin   +3 more
doaj   +1 more source