What we do
AI is powerful, but it can make objective errors, generate contextually inappropriate outputs, and offer disliked options. We defined and build AI-resilient interfaces that help people use AI while being resilient to AI choices that are not right, or not right for them. This is critical during context- and preference-dominated open-ended tasks, like ideating, searching, sensemaking, and reading or writing text and code at scale. AI-resilient interfaces improve AI safety, usability, and utility by working with, not against, human perception, attention, and cognition. To achieve this, we derive design implications from cognitive science, even when they fly in the face of common usability guidelines.
What success looks like
A vibrant, supportive community of undergraduates, masters, PhD students, Postdoctoral Scholars, and collaborators who are creating tools that augment human sensemaking and human-computer collaboration.
How we’re getting there
- Frequent feedback from each other
- Reflecting on our personal and community practices
- Getting enough sleep so we can bring our best selves to our work
- An AI-Resilient Text Rendering Technique for Reading and Skimming Documents [Pre-print]
CHI 2024
Ziwei Gu, Ian Arawjo, Kenneth Li, Jonathan K. Kummerfeld, Elena L. Glassman
- Supporting Sensemaking of Large Language Model Outputs at Scale [Pre-print]
CHI 2024 Honorable Mention Award
Katy Ilonka Gero, Chelse Swoopes, Ziwei Gu, Jonathan K. Kummerfeld, Elena L. Glassman
- [Demo temporarily experiencing issues] Try it out! Demo
- Try our novel algorithm, Positional Diction Clustering, here: [ObservableHQ notebook]
- ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testing [Pre-print]
CHI 2024 Honorable Mention Award
Ian Arawjo, Chelse Swoopes*, Priyan Vaithilingam*, Martin Wattenberg, Elena L. Glassman
*indicates equal contributions
- DynaVis: Dynamically Synthesized UI Widgets for Visualization Editing [Pre-print]
CHI 2024 Best Paper Award
Priyan Vaithilingam, Elena L. Glassman, Jeevana Priya Inala, Chenglong Wang
- Imagining a Future of Designing with AI: Dynamic Grounding, Constructive Negotiation, and Sustainable Motivation [Pre-print]
DIS 2024
Priyan Vaithilingam*, Ian Arawjo*, Elena L. Glassman
*indicates equal contributions
- Amortizing Pragmatic Program Synthesis with Rankings [Pre-print]
ICML 2024
Yewen Pu, Saujas Vaduguru, Priyan Vaithilingam, Elena L. Glassman, Daniel Fried
HCI + AI
- Stanford CS Seminar On People, Computers, and Design Jan 20th 2023
Systems for Supporting Intent Formation and Human-AI Communication [YouTube]
- Radcliffe Institute Fellowship Public Lecture Oct 13th 2021
Novel Interfaces to Support Human Intent Formation and Communication to Humans and Computers Alike (for the general public)
HCI + PL
- ACM SIGPLAN International Conference on Functional Programming (ICFP) Keynote August 24th 2021
Building PL-Powered Systems for Humans
- ACM SIGPLAN conference on Systems, Programming, Languages, and Applications: Software for Humanity (SPLASH REBASE) Speaker Nov 20th, 2020
PL and HCI: Better Together
HCI + AI
- PaTAT: Human-AI Collaborative Qualitative Coding with Explainable Interactive Rule Synthesis [PDF]
CHI 2023
Simret Araya Gebreegziabher, Zheng Zhang, Xiaohang Tang, Yihao Meng, Elena L. Glassman, and Toby Jia-Jun Li
Pre-recorded conference talk (10 min)
- Human-Computer Interaction and AI: What practitioners need to know to design and build effective AI system from a human perspective [PDF]
Course @ CHI 2023
Daniel Russell, Q. Vera Liao, Chinmay Kulkarni, Elena L. Glassman and Nikolas Martelaro
Course website with videos and hand-outs
- Sensemaking Interfaces for Human Evaluation of Language Model Outputs [PDF]
Human Evaluation of Generative Models Workshop @ NeurIPS 2022
Katy Ilonka Gero, Jonathan K. Kummerfeld, Elena L. Glassman
- Varying How We Teach: Adding Contrast Helps Humans Learn about Robot Motions [PDF]
Human-Interactive Robot Learning (HIRL) @ HRI 2023
Tiffany Horter, Elena L. Glassman, Julie Shah, and Serena Booth
- A Selective Summary of Where to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence [PDF]
Workshop on Intelligent and Interactive Writing Assistants (In2Writing 2022) @ ACL 2022
Nikhil Singh*, Guillermo Bernal*, Daria Savchenko*, Elena L. Glassman
*indicates equal contributions
- Where to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence
TOCHI 2022
Nikhil Singh*, Guillermo Bernal*, Daria Savchenko*, Elena L. Glassman
*indicates equal contributions
Preview (30 sec)
Pre-recorded conference talk (7 min)
- Revisiting Human-Robot Teaching and Learning Through the Lens of Human Concept Learning Theory [PDF]
HRI 2022 (ACM/IEEE International Conference on Human-Robot Interaction)
Serena Booth, Sanjana Sharma, Sarah Chung, Julie Shah, Elena L. Glassman
- Do explanations increase the effectiveness of AI-crowd generated fake news warnings? [PDF]
ICWSM 2022 (International AAAI Conference on Web and Social Media)
Ziv Epstein*, Nicolo Foppiani*, Sophie Hilgard*, Sanjana Sharma*, Elena L. Glassman, David Rand
*indicates equal contributions
- Loopholes: a Window into Value Alignment and the Learning of Meaning [PDF]
Meaning in Context: Pragmatic Communication in Humans and Machines (MiC) Workshop @ NeurIPS 2021
Sophie Bridgers, Elena L. Glassman, Laura Schulz, Tomer Ullman
- Interactive Cohort Analysis and Hypothesis Discovery by Exploring Temporal Patterns in Population-Level Health Records [PDF]
12th Workshop on Visual Analytics in Healthcare (VAHC) @ IEEE VIS 2021
Honorable Mention Award
Tianyi Zhang, Thomas H. McCoy Jr., Roy H. Perlis, Finale Doshi-Velez, Elena L. Glassman
- Visualizing Examples of Deep Neural Networks at Scale [PDF]
CHI 2021 Honorable Mention Award
Litao Yan, Elena L. Glassman, Tianyi Zhang
Preview (30 sec)
Conference Talk (5 min)
- Evaluating the Interpretability of Generative Models by Interactive Reconstruction [PDF]
CHI 2021 Honorable Mention Award
Andrew Slavin Ross, Nina Chen, Elisa Zhao Hang, Elena L. Glassman, Finale Doshi-Velez
Conference Talk (5 min)
- Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating XAI Systems [PDF]
IUI 2020 Best Paper Award
Zana Bucinca*, Phoebe Lin*, Krzysztof Gajos, Elena L. Glassman *indicates equal contributions
HCI + Program Synthesis
- ASSUAGE: Assembly Synthesis Using A Guided Exploration [PDF]
UIST 2021
Jingmei Hu, Priyan Vaithilingam, Stephen Chong, Margo Seltzer, Elena L. Glassman
Conference Talk (5 min)
Conference Talk (10 min)
- PL and HCI: Better Together [PDF] [HTML]
CACM 2021
Sarah E. Chasins, Elena L. Glassman, Joshua Sunshine
Seminar Talk (55 min)
- Interpretable Program Synthesis [PDF]
CHI 2021
Tianyi Zhang, Zhiyang Chen, Yuanli Zhu, Priyan Vaithilingam, Xinyu Wang, Elena L. Glassman
Preview (30 sec)
Conference Talk (5 min)
- Interactive Program Synthesis by Augmented Examples [PDF]
UIST 2020
Tianyi Zhang, London Lowmanstone, Xinyu Wang, Elena L. Glassman
Preview (30 sec)
Conference Talk (5 min)
- Characterizing Developer Use of Automatically Generated Patches [PDF]
VL/HCC 2019
José Pablo Cambronero, Jiasi Shen, Jürgen Cito, Elena L. Glassman, Martin Rinard
- Writing Reusable Code Feedback at Scale with Mixed-Initiative Program Synthesis [PDF]
Learning @ Scale (L@S) 2017
Andrew Head*, Elena L. Glassman*, Gustavo Soares*, Ryo Suzuki, Lucas Figueredo, Loris D'Antoni and Björn Hartmann
*indicates equal contributions
HCI + Software Engineering
- Towards More Effective AI-Assisted Programming: A Systematic Design Exploration to Improve Visual Studio IntelliCode’s User Experience [PDF]
International Conference on Software Engineering (ICSE) Software Engineering in Practice (SEIP) Track 2023
Priyan Vaithilingam, Elena L. Glassman, Peter Groenwegen, Sumit Gulwani, Austin Z Henley, Rohan Malpani, David Pugh, Arjun Radhakrishna, Gustavo Soares, Joey Wang, and Aaron Yim
- Expectation vs. Experience: Evaluating the Usability of Code Generation Tools Powered by Large Language Models [PDF]
Late Breaking Work @ CHI 2022
Priyan Vaithilingam, Tianyi Zhang, Elena L. Glassman
- Concept-Annotated Examples for Library Comparison [PDF]
UIST 2022
Litao Yan, Miryung Kim, Björn Hartmann, Tianyi Zhang, Elena L. Glassman
- Exempla Gratis (E.G.): Code Examples for Free [PDF]
FSE Industry Track 2020
Celeste Barnaby, Koushik Sen, Tianyi Zhang, Elena L. Glassman, Satish Chandra
- Enabling Data-Driven API Design with Community Usage Data: A Need-Finding Study [PDF]
CHI 2020
Tianyi Zhang, Björn Hartmann, Miryung Kim, and Elena L. Glassman
Conference Talk (13 min)
- Visualizing API Usage Examples at Scale [PDF]
CHI 2018
Elena L. Glassman*, Tianyi Zhang*, Björn Hartmann, Miryung Kim *indicates equal contributions
Preview (30 sec)
- Foobaz: Variable Name Feedback for Student Code at Scale [PDF]
UIST 2015
Elena L. Glassman, Lyla J Fischer, Jeremy Scott, Robert C. Miller
Preview (30 sec)
Conference Talk (16 min)
- OverCode: Visualizing Variation in Student Solutions to Programming
Problems at Scale [PDF]
TOCHI 2015
Elena L. Glassman, Jeremy Scott, Rishabh Singh, Philip Guo, Robert C. Miller
Preview (30 sec)
HCI + Online Information
HCI + Reading
Additional Working Drafts
Bio
Elena L. Glassman is an Assistant Professor of Computer Science at the Harvard John A. Paulson School of Engineering & Applied Sciences, specializing in human-computer interaction. From 2018-22, she was the Stanley A. Marks & William H. Marks Professor at the Radcliffe Institute for Advanced Study, and, more recently, she was named as a 2023 Sloan Research Fellow. At MIT, she earned a PhD and MEng in Electrical Engineering and Computer Science and a BS in Electrical Science and Engineering, supported by the NSF Graduate Research Fellowship and the NDSEG Graduate Fellowship. Before joining Harvard, she was a postdoctoral scholar in Electrical Engineering and Computer Science at the University of California, Berkeley, where she received the Berkeley Institute for Data Science Moore/Sloan Data Science Fellowship.
Curriculum Vitae
Administrative Support
Mark Peterson ([email protected])
Archive of Faculty Application Materials
|
|
Assistant Professor of Computer Science, SEAS, specializing in human-computer interaction
Postdoctoral Scholar, who is on the faculty job market this year!
PhD student, Computer Science
Tyler Holloway
PhD student, Computer Science
co-advised by Nada Amin (PL)
PhD student, Computer Science
Chelse Swoopes
PhD student, Computer Science
Recent Alumni
Postdoctoral Scholar, now Assistant Professor of Human-Computer Interaction at the University of Montréal in the Department of Computer Science and Operations Research (DIRO)
(New!) CS 178: Engineering Usable Interactive Systems
- Public course website forthcoming
CS 179: Design of Useful and Usable Interactive Systems
When we're actively recruiting, instructions will be linked here.
|