research
∙
09/19/2023
NusaWrites: Constructing High-Quality Corpora for Underrepresented and Extremely Low-Resource Languages
Democratizing access to natural language processing (NLP) technology is ...
share
research
∙
07/06/2023
Style Over Substance: Evaluation Biases for Large Language Models
As large language models (LLMs) continue to advance, accurately and comp...
research
∙
06/07/2023
Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answering
Large Language Models (LLMs) are capable of performing zero-shot closed-...
research
∙
06/05/2023
On "Scientific Debt" in NLP: A Case for More Rigour in Language Model Pre-Training Research
This evidence-based position paper critiques current research practices ...
research
∙
05/25/2023
Multi-lingual and Multi-cultural Figurative Language Understanding
Figurative language permeates human communication, but at the same time ...
research
∙
05/24/2023
Bactrian-X : A Multilingual Replicable Instruction-Following Model with Low-Rank Adaptation
Instruction tuning has shown great promise in the field of natural langu...
research
∙
05/24/2023
GlobalBench: A Benchmark for Global Progress in Natural Language Processing
Despite the major advances in NLP, significant disparities in NLP system...
research
∙
05/23/2023
WebIE: Faithful and Robust Information Extraction on the Web
Extracting structured and grounded fact triples from raw text is a funda...
research
∙
05/23/2023
LLM-powered Data Augmentation for Enhanced Crosslingual Performance
This paper aims to explore the potential of leveraging Large Language Mo...
research
∙
05/23/2023
Multilingual Large Language Models Are Not (Yet) Code-Switchers
Multilingual Large Language Models (LLMs) have recently shown great capa...
research
∙
05/21/2023
Direct Fact Retrieval from Knowledge Graphs without Entity Linking
There has been a surge of interest in utilizing Knowledge Graphs (KGs) f...
research
∙
04/27/2023
LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
Large language models (LLMs) with instruction finetuning demonstrate sup...
research
∙
03/23/2023
Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languages
While code-mixing is a common linguistic practice in many parts of the w...
research
∙
12/19/2022
The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges
Code-Switching, a common phenomenon in written text and conversation, ha...
research
∙
12/19/2022
NusaCrowd: Open Source Initiative for Indonesian NLP Resources
We present NusaCrowd, a collaborative initiative to collect and unite ex...
research
∙
12/19/2022
BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting
The BLOOM model is a large open-source multilingual language model capab...
research
∙
11/03/2022
Crosslingual Generalization through Multitask Finetuning
Multitask prompted finetuning (MTF) has been shown to help large languag...
research
∙
10/04/2022
Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering
We introduce Mintaka, a complex, natural, and multilingual dataset desig...
research
∙
07/21/2022
NusaCrowd: A Call for Open and Reproducible NLP Research in Indonesian Languages
At the center of the underlying issues that halt Indonesian natural lang...
research
∙
05/31/2022
NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages
Natural language processing (NLP) has a significant impact on society vi...
research
∙
05/10/2022
ParaCotta: Synthetic Multilingual Paraphrase Corpora from the Most Diverse Translation Sample Pair
We release our synthetic parallel paraphrase corpus across 17 languages:...
research
∙
03/29/2022
Nix-TTS: An Incredibly Lightweight End-to-End Text-to-Speech Model via Non End-to-End Distillation
We propose Nix-TTS, a lightweight neural TTS (Text-to-Speech) model achi...
research
∙
03/24/2022
One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia
NLP research is impeded by a lack of resources and awareness of the chal...
research
∙
01/25/2022
Documenting Geographically and Contextually Diverse Data Sources: The BigScience Catalogue of Language Data and Resources
In recent years, large-scale data collection efforts have prioritized th...
research
∙
01/03/2022
Which Student is Best? A Comprehensive Knowledge Distillation Exam for Task-Specific BERT Models
We perform knowledge distillation (KD) benchmark from task-specific BERT...
research
∙
10/27/2021
IndoNLI: A Natural Language Inference Dataset for Indonesian
We present IndoNLI, the first human-elicited NLI dataset for Indonesian....
research
∙
12/31/2020
Exploring Monolingual Data for Neural Machine Translation with Knowledge Distillation
We explore two types of monolingual data that can be included in knowled...
research
∙
12/30/2020
Synthetic Source Language Augmentation for Colloquial Neural Machine Translation
Neural machine translation (NMT) is typically domain-dependent and style...
research
∙
12/16/2020
No Budget? Don't Flex! Cost Consideration when Planning to Adopt NLP for Your Business
Recent advances in Natural Language Processing (NLP) have largely pushed...
research
∙
11/06/2020
Semi-Supervised Low-Resource Style Transfer of Indonesian Informal to Formal Language with Iterative Forward-Translation
In its daily use, the Indonesian language is riddled with informality, t...
research
∙
09/13/2019
Neural Machine Translation with 4-Bit Precision and Beyond
Neural Machine Translation (NMT) is resource intensive. We design a quan...
research
∙
06/08/2019
Making Asynchronous Stochastic Gradient Descent Work for Transformers
Asynchronous stochastic gradient descent (SGD) is attractive from a spee...
research
∙
09/10/2018
Toward a Standardized and More Accurate Indonesian Part-of-Speech Tagging
Previous work in Indonesian part-of-speech (POS) tagging are hard to com...
research
∙
08/27/2018
Accelerating Asynchronous Stochastic Gradient Descent for Neural Machine Translation
In order to extract the best possible performance from asynchronous stoc...
research
∙
04/01/2018
Marian: Fast Neural Machine Translation in C++
We present Marian, an efficient and self-contained Neural Machine Transl...
research
∙
04/17/2017