research
∙
08/18/2023
Scope is all you need: Transforming LLMs for HPC Code
With easier access to powerful compute resources, there is a growing tre...
share
research
∙
08/15/2023
Quantifying OpenMP: Statistical Insights into Usage and Adoption
In high-performance computing (HPC), the demand for efficient parallel p...
research
∙
05/16/2023
Advising OpenMP Parallelization via a Graph-Based Approach with Transformers
There is an ever-present need for shared memory parallelization schemes ...
research
∙
05/16/2023
MPI-rical: Data-Driven MPI Distributed Parallelism Assistance with Transformers
Automatic source-to-source parallelization of serial code for shared and...
research
∙
10/13/2022
Incorporating Context into Subword Vocabularies
Most current popular subword tokenizers are trained based on word freque...
research
∙
08/02/2022
Lost in Space Marking
We look at a decision taken early in training a subword tokenizer, namel...
research
∙
05/07/2022
UniMorph 4.0: Universal Morphology
The Universal Morphology (UniMorph) project is a collaborative effort pr...
research
∙
04/27/2022
Learning to Parallelize in a Shared-Memory Environment with Transformers
In past years, the world has switched to many-core and multi-core shared...
research
∙
09/10/2021
Integrating Approaches to Word Representation
The problem of representing the atomic elements of language in modern ne...
research
∙
08/01/2021
Learning to Look Inside: Augmenting Token-Based Encoders with Character-Level Information
Commonly-used transformer language models depend on a tokenization schem...
research
∙
05/11/2021
Restoring Hebrew Diacritics Without a Dictionary
We demonstrate that it is feasible to diacritize Hebrew script without a...
research
∙
09/18/2020
Will it Unblend?
Natural language processing systems often struggle with out-of-vocabular...
research
∙
04/30/2020
Learning to Faithfully Rationalize by Construction
In many settings it is important for one to be able to understand why a ...
research
∙
03/06/2020
NYTWIT: A Dataset of Novel Words in the New York Times
We present the New York Times Word Innovation Types dataset, or NYTWIT, ...
research
∙
12/14/2019
Attending Form and Context to Generate Specialized Out-of-VocabularyWords Representations
We propose a new contextual-compositional neural network layer that hand...
research
∙
08/13/2019
Attention is not not Explanation
Attention mechanisms play a central role in NLP systems, especially with...
research
∙
03/12/2019
Character Eyes: Seeing Language through Character-Level Taggers
Character-level models have been used extensively in recent years in NLP...
research
∙
08/27/2018
Predicting Semantic Relations using Global Graph Properties
Semantic graphs, such as WordNet, are resources which curate natural lan...
research
∙
04/13/2018
Sí o no, què penses? Catalonian Independence and Linguistic Identity on Social Media
Political identity is often manifested in language variation, but the re...
research
∙
07/21/2017
Mimicking Word Embeddings using Subword RNNs
Word embeddings improve generalization over lexical features by placing ...
research
∙
05/10/2016