ColorA11Y: Enhancing Creative Design Workflows with Just-in-Time Color Accessibility Recommendations

Alexa Siu, Rajiv Jain, Abhinav Kannan, Jose Echevarria, Mary Ann (MJ) Jawili, Yalpi Shiva Prasad, Rick Treitman, Garreth W. Tigwell, Jonathan Lazar

Proceedings of the 28th International ACM SIGACCESS Conference on Computers and Accessibility, 2026

★ Social Impact Nominee

Interview-Informed Generative Agents for Product Discovery: A Validation Study

Zichao Wang, Alexa Siu

Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems, 2026

★ Best Paper Honorable Mention

From Conversation to Human-AI Common Ground: Extracting Cognitive Workflows for Reuse in Sense-making Tasks

Xinyue Chen, Varun Manjunatha, Xu Wang, Alexa Siu

Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems, 2026

Science and Technology for Augmenting Reading (STAR)

Tal August, Andrew Head, Alexa Siu, Elena L Glassman, Jonathan K Kummerfeld, Joseph Chee Chang, Lucy Lu Wang, Marti A Hearst

Proceedings of the Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems, 2026

AnalystBench: Benchmarking professional long-form report generation with web-mined multimodal tasks

Chau Minh Pham, Zichao Wang, Puneet Mathur, Alexa Siu, Akriti Jain, Aparna Garimella, Ananya B Sai, Nedim Lipka, Mohit Iyyer, Varun Manjunatha

Findings of the Association for Computational Linguistics: ACL 2026, 2026

A Survey on LLM-based Conversational User Simulation

Bo Ni, Yu Wang, Leyao Wang, Branislav Kveton, Franck Dernoncourt, Yu Xia, Hongjie Chen, Reuben Luera, Samyadeep Basu, Subhojyoti Mukherjee, Puneet Mathur, Nesreen K Ahmed, Junda Wu, Li Li, Huixin Zhang, Ruiyi Zhang, Tong Yu, Sungchul Kim, Jiuxiang Gu, Zhengzhong Tu, Alexa Siu, Zichao Wang, Seunghyun Yoon, Nedim Lipka, Namyong Park, Zihao Lin, Trung Bui, Yue Zhao, Tyler Derr, Ryan A Rossi

Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), 2026

Augmenting Expert Cognition in the Age of Generative AI: Insights from Document-Centric Knowledge Work

Alexa Siu, Raymond Fok

Tools for Thought CHI 2026 Workshop, 2025

MoDS: Moderating a mixture of document speakers to summarize debatable queries in document collections

Nishant Balepur, Alexa Siu, Nedim Lipka, Franck Dernoncourt, Tong Sun, Jordan Lee Boyd-Graber, Puneet Mathur

Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2025

Standardizing the Measurement of Text Diversity: A Tool and Comparative Analysis

Chantal Shaib, Venkata S Govindarajan, Joe Barrow, Jiuding Sun, Alexa Siu, Byron C Wallace, Ani Nenkova

Proceedings of The 14th International Joint Conference on Natural Language Processing and The 4th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics: System Demonstrations, 2025

Toward living narrative reviews: An empirical study of the processes and challenges in updating survey articles in computing research

Raymond Fok, Alexa Siu, Daniel S Weld

Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, 2025

Imprinto: Enhancing Infrared Inkjet Watermarking for Human and Machine Perception

Martin Feick, Xuxin Tang, Raul Garcia-Martin, Alexandru Luchianov, Roderick Wei Xiao Huang, Chang Xiao, Alexa Siu, Mustafa Doga Dogan

Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, 2025

Docvoyager: anticipating user's information needs and guiding document reading through question answering

Yoonjoo Lee, Nedim Lipka, Zichao Wang, Ryan Rossi, Puneet Mathur, Tong Sun, Alexa Siu

Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, 2025

Personalizing Data Delivery: Investigating User Characteristics and Enhancing LLM Predictions

Reuben Luera, Ryan Rossi, Franck Dernoncourt, Alexa Siu, Sungchul Kim, Tong Yu, Ruiyi Zhang, Xiang Chen, Nedim Lipka, Zhehao Zhang, Seon Gyeom Kim, Tak Yeon Lee

Companion Proceedings of the ACM on Web Conference 2025, 2025

LLM-as-a-Judge Failures at Automating the Identification of Poor Quality Outputs in Free-Form Texts

Zongxia Li, Xiyang Wu, Ishani Mondal, Alexa Siu, Jordan Lee Boyd-Graber, Ani Nenkova

Proceedings of The 5th New Frontiers in Summarization Workshop, 2025

Knowledge graph prompting for multi-document question answering

Yu Wang, Nedim Lipka, Ryan A Rossi, Alexa Siu, Ruiyi Zhang, Tyler Derr

Proceedings of the AAAI conference on artificial intelligence, 2024

Pdftriage: Question answering over long, structured documents

Jon Saad-Falcon, Joe Barrow, Alexa Siu, Ani Nenkova, Seunghyun Yoon, Ryan A Rossi, Franck Dernoncourt

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track, 2024

How Much Annotation is Needed to Compare Summarization Models?

Chantal Shaib, Joe Barrow, Alexa Siu, Byron C Wallace, Ani Nenkova

Proceedings of the Third Workshop on Bridging Human--Computer Interaction and Natural Language Processing, 2024

MoiréWidgets: High-Precision, Passive Tangible Interfaces via Moiré Effect

Daniel Campos Zamora, Mustafa Doga Dogan, Alexa Siu, Eunyee Koh, Chang Xiao

Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, 2024

Marco: Supporting business document workflows via collection-centric information foraging with large language models

Raymond Fok, Nedim Lipka, Tong Sun, Alexa Siu

Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, 2024

Thinking Outside the Box: Non-Designer Perspectives and Recommendations for Template-Based Graphic Design Tools

Farnaz Nouraei, Alexa Siu, Ryan Rossi, Nedim Lipka

Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, 2024

ATLAS: A System for PDF-centric Human Interaction Data Collection

Alexa Siu, Zichao Wang, Joshua Hoeflich, Naman Kapasi, Ani Nenkova, Tong Sun

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 3: System Demonstrations), 2024

DocPilot: Copilot for automating pdf edit workflows in documents

Puneet Mathur, Alexa Siu, Varun Manjunatha, Tong Sun

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations), 2024

Topology-aware retrieval augmentation for text generation

Yu Wang, Nedim Lipka, Ruiyi Zhang, Alexa Siu, Yuying Zhao, Bo Ni, Xin Wang, Ryan Rossi, Tyler Derr

Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, 2024

Matsa: Multi-agent table structure attribution

Puneet Mathur, Alexa Siu, Nedim Lipka, Tong Sun

Proceedings of the 2024 conference on empirical methods in natural language processing: system demonstrations, 2024

Experts prefer text but videos help novices: an analysis of the utility of multi-media content

Hayeong Song, Jennifer Healey, Alexa Siu, Curtis Wigington, John Stasko

Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, 2023

StandARone: Infrared-watermarked documents as portable containers of AR interaction and personalization

Mustafa Doga Dogan, Alexa Siu, Jennifer Healey, Curtis Wigington, Chang Xiao, Tong Sun

Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, 2023

TaleStream: Supporting story ideation with trope knowledge

Jean-Peïc Chou, Alexa Siu, Nedim Lipka, Ryan Rossi, Franck Dernoncourt, Maneesh Agrawala

Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, 2023

Computable contracts by extracting obligation logic graphs

Sergio Servantez, Nedim Lipka, Alexa Siu, Milan Aggarwal, Balaji Krishnamurthy, Aparna Garimella, Kristian Hammond, Rajiv Jain

Proceedings of the Nineteenth International Conference on Artificial Intelligence and Law, 2023

How Small Businesses Transform PDF Agreements into Action

Jianna So, Nedim Lipka, Alexa Siu, Ryan Rossi, Franck Dernoncourt

Companion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing, 2023

Understanding experiences, attitudes and perspectives towards designing interactive creative tools for teachers of visually impaired students

Abena Boadi-Agyemang, Elizabeth Jeanne Carter, Alexa Siu, Aaron Steinfeld, Melisa Orta Martinez

Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility, 2023

ShapeSonic: sonifying fingertip interactions for non-visual virtual shape perception

Jialin Huang, Alexa Siu, Rana Hanocka, Yotam Gingold

SIGGRAPH Asia 2023 Conference Papers, 2023

Supporting accessible data visualization through audio data narratives

Alexa Siu, Gene SH Kim, Sile O'Modhrain, Sean Follmer

Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, 2022

Slide-tone and tilt-tone: 1-DOF haptic techniques for conveying shape characteristics of graphs to blind users

Danyang Fan, Alexa Siu, Wing-Sum Adrienne Law, Raymond Ruihong Zhen, Sile O'Modhrain, Sean Follmer

Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, 2022

COVID-19 highlights the issues facing blind and visually impaired people in accessing data on the web

Alexa Siu, Danyang Fan, Gene SH Kim, Hrishikesh V Rao, Xavier Vazquez, Sile O'Modhrain, Sean Follmer

Proceedings of the 18th International Web for All Conference, 2021

★ Best Paper Honorable Mention

Virtual reality without vision: A haptic and auditory white cane to navigate complex virtual worlds

Alexa Siu, Mike Sinclair, Robert Kovacs, Eyal Ofek, Christian Holz, Edward Cutrell

Proceedings of the 2020 CHI conference on human factors in computing systems, 2020

Haptic pivot: On-demand handhelds in vr

Robert Kovacs, Eyal Ofek, Mar Gonzalez Franco, Alexa Siu, Sebastian Marwecki, Christian Holz, Mike Sinclair

Proceedings of the 33rd annual ACM symposium on user interface software and technology, 2020

PantoGuide: A haptic and audio guidance system to support tactile graphics exploration

Elyse DZ Chase, Alexa Siu, Abena Boadi-Agyemang, Gene SH Kim, Eric J Gonzalez, Sean Follmer

Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility, 2020

When to add human narration to photo-sharing social media

Lawrence H Kim, Abena Boadi-Agyemang, Alexa Siu, John Tang

Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility, 2020

Constructive visualization to inform the design and exploration of tactile data representations

Danyang Fan, Alexa Siu, Sile O'Modhrain, Sean Follmer

Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility, 2020

Advancing accessible 3D design for the blind and visually-impaired via tactile shape displays

Alexa Siu

Adjunct Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, 2019

Making nonvisually: Lessons from the field

Cynthia L Bennett, Abigale Stangl, Alexa Siu, Joshua A Miele

Proceedings of the 21st international ACM SIGACCESS conference on computers and accessibility, 2019

Tactile code skimmer: A tool to help blind programmers feel the structure of code

Olutayo Falase, Alexa Siu, Sean Follmer

Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility, 2019

shapeCAD: An accessible 3D modelling workflow for the blind and visually-impaired via 2.5 D shape displays

Alexa Siu, Son Kim, Joshua A Miele, Sean Follmer

Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility, 2019

★ Best Paper Honorable Mention

Shapeshift: 2D spatial manipulation and self-actuation of tabletop shape displays for tangible and haptic interaction

Alexa Siu, Eric J Gonzalez, Shenli Yuan, Jason B Ginsberg, Sean Follmer

Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 2018

An Accessible CAD Workflow Using Programming of 3D Models and Preview Rendering in A 2.5 D Shape Display

Alexa Siu, Joshua Miele, Sean Follmer

Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility, 2018

shapeShift: A mobile tabletop shape display for tangible and haptic interaction

Alexa Siu, Eric J Gonzalez, Shenli Yuan, Jason Ginsberg, Allen Zhao, Sean Follmer

Adjunct Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, 2017

★ Best Demo Honorable Mention

Born-accessible design: moving from theory to developing a pragmatic methodological framework

Jonathan Lazar, Rachel Wood, Abhinav Kannan, Jinjuan Heidi Feng, Garreth W Tigwell, Mary Ann (MJ) Jawili, Alexa Siu, Rajiv Jain

Interacting with Computers, 2026

Survey on user interface design and interactions for generative AI applications

Reuben Luera, Ryan Rossi, Alexa Siu, Franck Dernoncourt, Tong Yu, Sungchul Kim, Ruiyi Zhang, Xiang Chen, Hanieh Salehy, Nedim Lipka, Samyadeep Basu, Puneet Mathur, Jian Zhao

Foundations and Trends in Human-Computer Interaction, 2026

FormA11y—Research and Development of a Tool for Remediating PDF Forms for Accessibility

Sparsh Paliwal, Joshua Hoeflich, J Bern Jordan, Rajiv Jain, Vlad I Morariu, Alexa Siu, Jonathan Lazar

ACM Transactions on Computer-Human Interaction, 2025

SweeperBot: Making 3D Browsing Accessible Through View Analysis and Visual Question Answering

Chen Chen, Cuong Nguyen, Alexa Siu, Dingzeyu Li, Nadir Weibel

International Journal of Human--Computer Interaction, 2025

Toward an Optimized Human-AI Reviewing Strategy for Contract Inspection

Melanie Bancilhon, Alexa Siu, Ryan Rossi, Nedim Lipka

The New Era of Business Intelligence (IntechOpen), 2024

The accessibility of data visualizations on the web for screen reader users: Practices and experiences during covid-19

Danyang Fan, Alexa Siu, Hrishikesh Rao, Gene Sung-Ho Kim, Xavier Vazquez, Lucy Greco, Sile O'Modhrain, Sean Follmer

ACM Transactions on Accessible Computing, 2023

HoloNeedle: augmented reality guidance system for needle placement investigating the advantages of three-dimensional needle shape reconstruction

Michael A Lin, Alexa Siu, Jung Hwa Bae, Mark R Cutkosky, Bruce L Daniel

IEEE Robotics and Automation Letters, 2018

Rendered and characterized closed-loop accuracy of impedance-type haptic displays

Nick Colonnese, Alexa Siu, Caroline M Abbott, Allison M Okamura

IEEE Transactions on Haptics, 2015

Disposable platform provides visual and color-based point-of-care anemia self-testing

Erika A Tyburski, Scott E Gillespie, William A Stoy, Robert G Mannino, Alexander J Weiss, Alexa Siu, Rayford H Bulloch, Karthik Thota, Anyela Cardenas, Wilena Session, Hanna J Khoury, Siobhán O'Connor, Silvia T Bunting, Jeanne Boudreaux, Craig R Forest, Manila Gaddh, Traci Leong, L Andrew Lyon, Wilbur A Lam

The Journal of clinical investigation, 2014

Learning to Reason in LLMs by Expectation Maximization

Junghyun Lee, Branislav Kveton, Anup Rao, Subhojyoti Mukherjee, Ryan A Rossi, Sunav Choudhary, Alexa Siu

arXiv preprint, 2025

An Opportunity to Use AI to Support Content Creators in Creating Born-Accessible Documents

Jonathan Lazar, Abhinav Kannan, Garreth W Tigwell, Rajiv Jain, Mary Ann (MJ) Jawili, Yalpi Shiva Prasad, Alexa Siu, Rick Treitman

Beyond Tech Fixes: Towards an AI Future Where Disability Justice Thrives, 2025

Remote co-design in the digital age

Brandon Biggs, Alexa Siu, Nida Aziz, Tony Stockman

Handbook of disability: Critical thought and social change in a globalizing world, 2024

Haptic guidance to support design education and collaboration for blind and visually impaired people

Alexa Siu, Elyse DZ Chase, Gene S-H Kim, Abena Boadi-Agyemang, Eric J Gonzalez, Sean Follmer

Design Thinking Research: Translation, Prototyping, and Measurement, 2021

Investigating tangible collaboration for design towards augmented physical telepresence

Alexa Siu, Shenli Yuan, Hieu Pham, Eric Gonzalez, Lawrence H Kim, Mathieu Le Goc, Sean Follmer

Design thinking research: making distinctions: collaboration versus cooperation, 2017

Generating and self-correcting workflows for editing digital files using language machine learning models

Puneet Mathur, Varun Manjunatha, Tong Sun, Alexa Siu

, 2026 — US Patent App. 18/795,882

Generating virtual objects from embedded code

Alexa Siu, Tong Sun, Mustafa Doga Dogan, Jennifer Anne Healey, Curtis Michael Wigington

, 2025 — US Patent 12,430,813

Executing an action using extracted information from a document

Nedim Lipka, Ryan Rossi, Jianna Audrey Reyes So, Franck Dernoncourt, Alexa Siu

, 2025 — US Patent App. 18/344,203

Fine-grained attribution for document question answering

Nedim Lipka, Varun Manjunatha, Surabhi Bhargava, Sruthi Madapoosi Ravi, Koustava Goswami, Joseph Barrow, Inderjeet Nair, Christopher Tensmeyer, Balaji Vasan Srinivasan, Ashutosh Mehra, Animesh Kumar, Ani Nenkova, Alexa Siu, Abhilasha Sancheti

, 2025 — US Patent App. 18/528,618

Responding to a user query using machine learning

Jon Saad-Falcon, Joseph D Barrow, Varun Manjunatha, Anusha Prakash, Ryan A Rossi, Franck Dernoncourt, Alexa Siu, Ani Nenkova, Seunghyun Yoon

, 2025 — US Patent App. 18/667,690

Data extraction and analysis from unstructured documents

Arpit Narechania, Fan Du, Atanu Sinha, Nedim Lipka, Alexa Siu, Jane Elizabeth Hoffswell, Eunyee Koh, Vasanthi Holtcamp

, 2024 — US Patent App. 18/482,754

Spatial document system and method

Jennifer Healey, Tong Sun, Nicholas Rewkowski, Nedim Lipka, Curtis Wigington, Alexa Siu

, 2024 — US Patent App. 18/317,851