AI-Augmented Reading Interfaces

12 papers in this research thread

This thread of research develops AI-powered interactive reading interfaces that augment scholarly documents to improve how researchers discover, read, comprehend, and synthesize scientific literature. The Semantic Reader Project provides an overview of this collaborative effort, organizing contributions around discovery, efficiency, comprehension, synthesis, and accessibility. For discovery, CiteSee personalizes inline citation augmentations using reading history, while PaperWeaver contextualizes paper recommendations against user-collected libraries. For efficiency and comprehension, Qlarify introduces recursively expandable abstracts that let readers drill into papers on demand, and Papeos fuses talk video segments with paper passages to reduce cognitive load and scaffold navigation. For synthesis, Relatedly scaffolds literature exploration through related work paragraphs with progress-tracking and diversity-ranking, while Threddy and Synergi support clipping and organizing research threads across papers — Synergi extending this with mixed-initiative LLM-powered thread generation that produces higher-quality outlines. Most recently, this line of work has expanded into literature-based ideation support: IdeaSynth helps researchers iteratively develop research ideas through a faceted canvas with literature-grounded LLM feedback, and LitPivot introduces literature-initiated pivots where dynamic engagement with relevant literature prompts concrete revisions to a developing research idea.

Papers

CiteSee: Augmenting Citations in Scientific Papers with Persistent and Personalized Historical Context

Joseph Chee Chang·Amy X. Zhang·Jonathan Bragg
CHI·2023·61 citations🏆 Best PaperPDF + AI Q&A

TLDRCiteSee is a paper reading tool that leverages a user’s publishing, reading, and saving activities to provide personalized visual augmentations and context around citations to help users prioritize their exploration.

PaperMage: A Unified Toolkit for Processing, Representing, and Manipulating Visually-Rich Scientific Documents

Kyle Lo·Shannon Zejiang Shen·Benjamin Newman·Joseph Chee Chang
EMNLP·2023·25 citations🏆 Best DemoPDF + AI Q&A

AbstractDespite growing interest in applying natural language processing (NLP) and computer vision (CV) models to the scholarly domain, scientific documents remain challenging to work with. They’re often in difficult-to-use PDF formats, and the ecosystem of ...

LitPivot: Developing Well-Situated Research Ideas Through Dynamic Contextualization and Critique within the Literature Landscape

H. Kambhamettu·Bhavana Dalvi·Andrew Head
UIST·2026PDF + AI Q&A

AbstractDeveloping a novel research idea is hard. It must be distinct enough from prior work to claim a contribution while also building on it. This requires iteratively reviewing literature and refining an idea based on what a researcher reads; yet when an ...

IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedback

Kevin Pu·K. Feng·Tovi Grossman...Joseph Chee Chang...
CHI·2025·64 citationsPDF + AI Q&A

TLDRIt is demonstrated that participants effectively used IdeaSynth for real-world research projects at various ideation stages from developing initial ideas to revising framings of mature manuscripts, highlighting the possibilities to adopt IdeaSynth in researcher’s workflows.

The Semantic Reader Project

Kyle Lo·Joseph Chee Chang·Andrew Head
Communications of the ACM·2024·24 citationsPDF + AI Q&AVideo

TLDRThe Semantic Reader Project is described, a collaborative effort across multiple institutions to explore automatic creation of dynamic reading interfaces for research papers, and a collection of novel reading interfaces are developed and evaluated and evaluated them with study participants and real-world users to show improved reading experiences for scholars.

PaperWeaver: Enriching Topical Paper Alerts by Contextualizing Recommended Papers with User-collected Papers

Yoonjoo Lee·Hyeonsu B Kang·Matt Latzke...Joseph Chee Chang...
CHI·2024·39 citationsPDF + AI Q&A

TLDRIt was shown that participants using PaperWeaver were able to better understand the relevance of recommended papers and triage them more confidently when compared to a baseline that presented the related work sections from recommended papers.

Synergi: A Mixed-Initiative System for Scholarly Synthesis and Sensemaking

Hyeonsu B Kang·Sherry Wu·Joseph Chee Chang
UIST·2023·70 citationsPDF + AI Q&A

TLDRA novel computational pipeline is developed that ties together user input of relevant seed threads with citation graphs and LLMs, to expand and structure them, respectively, and is found to help scholars efficiently make sense of relevant threads, broaden their perspectives, and increases their curiosity.

Qlarify: Recursively Expandable Abstracts for Dynamic Information Retrieval over Scientific Papers

Raymond Fok·Joseph Chee Chang·Tal August
UIST·2023·22 citationsPDF + AI Q&A

TLDRRecursively expandable abstracts are introduced, a novel interaction paradigm that dynamically expands abstracts by progressively incorporating additional information from the papers’ full text during their dive into the full text.

Papeos: Augmenting Research Papers with Talk Videos

Tae Soo Kim·Matt Latzke·Jonathan Bragg...Joseph Chee Chang
UIST·2023·23 citationsPDF + AI Q&A

TLDRPapeos is presented, a novel reading and authoring interface that allow authors to augment their papers by segmenting and localizing talk videos alongside relevant paper passages with automatically generated suggestions.

Relatedly: Scaffolding Literature Reviews with Existing Related Work Sections

Srishti Palani·Aakanksha Naik·Doug Downey...Joseph Chee Chang
CHI·2023·55 citationsPDF + AI Q&A

TLDRThis work designs a system, Relatedly, that scaffolds exploring and reading multiple related work paragraphs on a topic, with features including dynamic re-ranking and highlighting to spotlight unexplored dissimilar information, auto-generated descriptive paragraph headings, and low-lighting of redundant information.

Personalized Jargon Identification for Enhanced Interdisciplinary Communication

Yue Guo·Joseph Chee Chang·Maria Antoniak
NAACL·2023·26 citationsPDF + AI Q&A

TLDRThis research investigates features representing domain, subdomain, and individual knowledge to predict individual jargon familiarity and compares supervised and prompt-based approaches, finding that prompt-based methods yield the highest accuracy, though the task remains difficult and supervised approaches have lower false positive rates.

Threddy: An Interactive System for Personalized Thread-based Exploration and Organization of Scientific Literature

Hyeonsu B Kang·Joseph Chee Chang·Yongsung Kim
UIST·2022·62 citationsPDF + AI Q&A

TLDRA tool integrated into users’ reading process that helps them with leveraging authors’ existing summarization of threads, typically in introduction or related work sections, in order to situate their own work’s contributions is developed.