research
∙
08/17/2023
Never-ending Learning of User Interfaces
Machine learning models have been trained to predict semantic informatio...
share
research
∙
06/08/2023
Latent Phrase Matching for Dysarthric Speech
Many consumer speech recognition systems are not tuned for people with s...
research
∙
05/23/2023
USB: A Unified Summarization Benchmark Across Tasks and Domains
An abundance of datasets exist for training and evaluating models on the...
research
∙
02/17/2023
From User Perceptions to Technical Improvement: Enabling People Who Stutter to Better Use Speech Recognition
Consumer speech recognition systems do not work as well for many people ...
research
∙
01/30/2023
WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics
Modeling user interfaces (UIs) from visual information allows systems to...
research
∙
01/20/2023
Screen Correspondence: Mapping Interchangeable Elements between UIs
Understanding user interface (UI) functionality is a useful yet challeng...
research
∙
09/28/2022
Downstream Datasets Make Surprisingly Good Pretraining Corpora
For most natural language processing tasks, the dominant practice is to ...
research
∙
07/15/2022
Reflow: Automatically Improving Touch Interactions in Mobile Applications through Pixel-based Refinements
Touch is the primary way that users interact with smartphones. However, ...
research
∙
05/25/2022
Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning
Instruction tuning is an emergent paradigm in NLP wherein natural langua...
research
∙
05/19/2022
Target-Guided Dialogue Response Generation Using Commonsense and Data Augmentation
Target-guided response generation enables dialogue systems to smoothly t...
research
∙
02/15/2022
Nonverbal Sound Detection for Disordered Speech
Voice assistants have become an essential tool for people with various d...
research
∙
12/17/2021
It's Time to Do Something: Mitigating the Negative Impacts of Computing Through a Change to the Peer Review Process
The computing research community needs to work much harder to address th...
research
∙
09/17/2021
Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots
Automated understanding of user interfaces (UIs) from their pixels can i...
research
∙
06/10/2021
Synthesizing Adversarial Negative Responses for Robust Response Ranking and Evaluation
Open-domain neural dialogue models have achieved high performance in res...
research
∙
05/04/2021
When Can Accessibility Help?: An Exploration of Accessibility Feature Recommendation on Mobile Devices
Numerous accessibility features have been developed and included in cons...
research
∙
03/26/2021
Say It All: Feedback for Improving Non-Visual Presentation Accessibility
Presenters commonly use slides as visual aids for informative talks. Whe...
research
∙
02/24/2021
SEP-28k: A Dataset for Stuttering Event Detection From Podcasts With People Who Stutter
The ability to automatically detect stuttering events in speech could he...
research
∙
01/13/2021
Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels
Many accessibility features available on mobile platforms require applic...
research
∙
10/12/2020
Making Mobile Augmented Reality Applications Accessible
Augmented Reality (AR) technology creates new immersive experiences in e...
research
∙
10/07/2020
Rescribe: Authoring and Automatically Editing Audio Descriptions
Audio descriptions make videos accessible to those who cannot see them b...
research
∙
08/20/2020
Controlling Dialogue Generation with Semantic Exemplars
Dialogue systems pretrained with large language models generate locally ...
research
∙
07/14/2020
Extracting Structured Data from Physician-Patient Conversations By Predicting Noteworthy Utterances
Despite diverse efforts to mine various modalities of medical data, the ...
research
∙
05/04/2020
Generating SOAP Notes from Doctor-Patient Conversations
Following each patient visit, physicians must draft detailed clinical su...
research
∙
09/12/2019
InstructableCrowd: Creating IF-THEN Rules for Smartphones via Conversations with the Crowd
Natural language interfaces have become a common part of modern digital ...
research
∙
08/20/2019
StateLens: A Reverse Engineering Solution for Making Existing Dynamic Touchscreens Accessible
Blind people frequently encounter inaccessible dynamic touchscreens in t...
research
∙
07/24/2019
Investigating Evaluation of Open-Domain Dialogue Systems With Human Generated Multiple References
The aim of this paper is to mitigate the shortcomings of automatic evalu...
research
∙
06/07/2019
Predicting risk of dyslexia with an online gamified test
Dyslexia is a specific learning disorder related to school failure. Dete...
research
∙
02/22/2018
VizWiz Grand Challenge: Answering Visual Questions from Blind People
The study of algorithms to automatically answer visual questions current...
research
∙
01/08/2018
Evorus: A Crowd-powered Conversational Assistant Built to Automate Itself Over Time
Crowd-powered conversational assistants have been shown to be more robus...
research
∙
08/10/2017
"Is there anything else I can help you with?": Challenges in Deploying an On-Demand Crowd-Powered Conversational Agent
Intelligent conversational assistants, such as Apple's Siri, Microsoft's...
research
∙
04/12/2017