research
∙
08/17/2023
Never-ending Learning of User Interfaces
Machine learning models have been trained to predict semantic informatio...
share
research
∙
01/30/2023
WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics
Modeling user interfaces (UIs) from visual information allows systems to...
research
∙
01/20/2023
Screen Correspondence: Mapping Interchangeable Elements between UIs
Understanding user interface (UI) functionality is a useful yet challeng...
research
∙
07/15/2022
Reflow: Automatically Improving Touch Interactions in Mobile Applications through Pixel-based Refinements
Touch is the primary way that users interact with smartphones. However, ...
research
∙
07/09/2022
Extracting Replayable Interactions from Videos of Mobile App Usage
Screen recordings of mobile apps are a popular and readily available way...
research
∙
11/19/2021
Sketch-based Creativity Support Tools using Deep Learning
Sketching is a natural and effective visual communication medium commonl...
research
∙
01/13/2021
Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels
Many accessibility features available on mobile platforms require applic...
research
∙
07/11/2018
A Computational Method for Evaluating UI Patterns
UI design languages, such as Google's Material Design, make applications...
research
∙
05/16/2018