IUI 2019 - ACM OpenTOC

Access to IUI 2019 Conference Proceedings

The ACM OpenTOC is a unique service that enables Special Interest Groups to open the content from recently held conferences enabling visitors to download the definitive version of the contents from the ACM Digital Library at no charge for a one year period starting from the conference start date.
Downloads of these articles are captured in official ACM statistics, improving the accuracy of usage and impact measurements.

IUI 2019 - Conference Program

March 16th, Saturday

5-6pm SC
(for Student Consortium students to meet only)
6-9pm Reception
at University of Southern California, Information Sciences Institute

March 17th, Sunday

Sierra I & II
7:30-9am Registration
9-9:30am Welcome and Opening Plenary


Getting Virtually Personal:
Making Responsible and Empathetic “Her” for Everyone

Michelle Zhou, Juji, Inc
Michelle Zhou

Juji, Inc

10:45-11:15am Coffee Break
11:15-12:15pm Panel -- Fostering Women Entrepreneurship
12:15-2pm Lunch (on your own) + Fostering Women Entrepreneurship Lunch (location: Sinder, outdoor patio)
Sierra I & II Pacific I & II Pacific III

Explainable AI I

Chair: Tsvika Kuflik

What can AI do for me: Evaluating Machine Learning Interpretations in Cooperative Play (long)

I can do better than your AI: Expertise and Explanations (long)

Explainability Scenarios: Towards Scenario-based XAI Design (short)

Best Short Paper Award The Effects of Example-Based Explanations in a Machine Learning Interface (short)

Automated Rationale Generation: a Technique for Explainable AI and its Effects on Human Perceptions (long)

Agent-based IUIs

Chair: Oliver Brdiczka

Digital Survivor of Sexual Assault (long)

Induction of an active attitude by short speech reaction time toward interaction for decision-making with multiple agents (short)

Intelligent Assistants for Mediation Analysis in Visual Analytics (short)

Who Should Be My Teammates: Using A Conversational Agent to Understand Individual Differences and Help Teaming (long)

BigBlueBot: Teaching Strategies for Successful Human-Agent Interactions (long)

Automated Driving

Chair: Polo Chau

Improving Take-Over Quality in Automated Driving By Interrupting Non-Driving Tasks (long)

Assessing Public Perception of Self-Driving Cars: the Autonomous Vehicle Acceptance Model (long)

A Context-Dependent Analysis of Automated Driving to Elaborate Requirements for Intelligent User Interfaces (long)

S(C)ENTINEL - Monitoring Automated Vehicles with Olfactory Reliability Displays (long)

3:30-4:00pm Coffee Break

Explainable AI II

Chair: Tsvika Kuflik

Outstanding Paper Award Explaining Models: An Empirical Study of How Explanations Impact Fairness Judgment (long)

What Data Should I Protect? A Recommender and Impact Analysis Design to Assist Decision Making (long)

Decision Making Strategies Differ in the Presence of Collaborative Explanations: Two Conjoint Studies (long)

Multi-Modal Interfaces & Experience Transfer

Chair: Fred Hohman

MyoSign: Enabling End-to-End Sign Language Recognition with Wearables (long)

Discovering Natural Language Commands in Multimodal Interfaces (long)

Inspiration Driven Experience Transfer (long)

Assistive IUIs

Chair: Polo Chau

Scene Text Access: A Comparison of Mobile OCR Modalities for Blind Users (long) Guided Play: Digital Sensing and Coaching for Stereotypical Play Behavior in Children with Autism (long) Learning to Assess the Quality of Stroke Rehabilitation Exercises (long)

5-5:15pm Break

Student Consortium

SC 1
Health-related aspects

Chair: Tsvika Kuflik
SC 2
Human feedback and interaction-based design

Chair: Ilaria Torre
SC 3
Novel UIs for recommenders and for the ubiquitous environment

Chair: Jeff Nichols

March 18th, Monday

Sierra I & II
7:30-8:30am Registration


DARPA’s Explainable Artificial Intelligence (XAI) Program

Dave Gunning, DARPA I2O
Dave Gunning


9:45-10:15 Coffee Break
10:15-11:30am Most Impact Paper Award
11:30-1:15pm Lunch (on your own)
Sierra I & II Pacific I & II Pacific III

Explanations in Recommender Systems

Chair: Peter Brusilovsky

TiiS: Crowdsourcing Ground Truth for Medical Relation Extraction

Explaining Recommendations in an Interactive Hybrid Social Recommender (short)

To Explain or not to Explain: the Effects of Personal Characteristics when Explaining Music Recommendations (long)

Outstanding Paper Award The Effect of Explanations and Algorithmic Accuracy on Visual Recommender Systems of Artistic Images (long)

User-Adaptive IUIs

Chair: Jeff Nichols

RL-KLM: Automating Keystroke-level Modeling with Reinforcement Learning (short)

TiiS: Proactive Information Retrieval by Inferring Search Intent from Primary Task Context

Transformer: A Database-Driven Approach to Generating Forms for Constrained Interaction (long)

SearchLens: Composing and Capturing Complex User Interests for Exploratory Search (long)

Trust in Automation

Chair: Simone Stumpf

TiiS: A Classification Model for Sensing Human Trust in Machines Using EEG and GSR

TiiS: The Effect of Culture on Trust in Automation: Reliability and Workload

Do I Trust My Machine Teammate? An Investigation from Perception to Decision (long)

Effects of the Source of Advice and Decision Task on Decisions to Request Expert Advice (long)

2:35-3:05pm Coffee Break

Affective & Aesthetic IUIs

Chair: Marko Tkalcic

Paralinguistic Recommendations for Affective Word Clouds (long)

Does Emotion Influence the Use of Auto-suggest during Smartphone Typing? (short)

Prediction of Music Pairwise Preferences from Facial Expressions (long)

Piano Genie (short)

Recommender Systems

Chair: John O'Donovan

Evaluating Narrative-Driven Movie Recommendations on Reddit (long)

Intelligently Recommending Key Bindings on Physical Keyboards with Demonstrations in Emacs (short)

Rasch-based Tailored Goals for Nutrition Assistance Systems (long)

SAM: A Modular Framework for Self-Adapting Web Menus (short)

IUIs for Wearable/Mobile

Chair: Fabio Paternò

Background Perception and Comprehension of Symbols Conveyed through Vibrotactile Wearable Displays (long)

Outstanding Paper Award Smell Pittsburgh: Community-Empowered Mobile Smell Reporting System (long)

Towards a Generalizable Method for Detecting Fluid Intake with Wrist-Mounted Sensors and Adaptive Segmentation (short)

ShopEye: Fusing RFID and Smartwatch for Multi-relation Excavation in Physical stores (long)

4:20-4:35pm Break
4:35-5:00pm Poster Madness
5:00-5:30pm Townhall Meeting
6:15-8pm Poster and Demo Reception

March 19th, Tuesday

Sierra I & II
7:30-9:00am Registration


Innovating with AI

Ashwin Ram, Google Cloud
Ashwin Ram

Google Cloud

10:15-10:45 Coffee Break
10:45-11:45am Panel -- Hype or Hope: AI Meets Humans in the Real World
11:45-1:30pm Lunch (on your own)+ Steering committee lunch (location: Venice/Peninsula)
Sierra I & II Pacific I & II Pacific III

Interactive Machine Learning I

Chair: Simone Stumpf

Towards Rapid Interactive Machine Learning: Evaluating Tradeoffs of Classification without Representation (long)

Where can my career take me? Harnessing Dialogue for Interactive Career Goal Recommendations (long)

Towards Human-Guided Machine Learning (long)

TiiS: A Review of User Interface Design for Interactive Machine Learning

Intelligent Visualization

Chair: Polo Chau

StoryPrint: an Interactive Visualization of Stories (long)

Vulnerable to Misinformation? Verifi! (long)

Visualizing authorship and contribution of collaborative writing in e-learning environments (short)

The Role of User Differences in Customization: A Case Study in Personalization for Infovis-Based Content (long)

Augmented & Mixed Reality

Chair: Fabio Paternò

Analyzing User’s Task-Driven Interaction in Mixed Reality (short)

PATI: A Projection-based Augmented Table-Top Interface for Robot Programming (long)

Walking with Adaptive Augmented Reality Workspaces: Design and Usage Patterns (long)

Cross-Platform Immersive Web Browsing for Online 3D Neuron Database Exploration (long)

2:50-3:20pm Coffee Break

Interactive Machine Learning II

Chair: Oliver Brdiczka

TiiS: A Visual Approach for Interactive Keyterm-based Clustering

TiiS: A Human-in-the-loop System for Sound Event Detection and Annotation

Peripheral Vision: A New Killer App for Smart Glasses (long)

Investigating the Feasibility of Finger Identification on Capacitive Touchscreens using Deep Learning (long)

Collaborative Interfaces I

Chair: Tsvi Kuflik

Best Long Paper Award Photo Sleuth: Combining Human Expertise and Face Recognition to Identify Historical Portraits (long)

Popup: Reconstructing 3D Video Using Particle Filtering to Aggregate Crowd Responses (long)

Assisting Group Activity Analysis through Hand Detection and Identification in Multiple Egocentric Videos (short)

Explainable Modeling of Annotations in Crowdsourcing (short)

Evaluation of IUIs

Chair: Aaron Springer

Outstanding Paper Award When People and Algorithms Meet: Assessing User-reported Problems to Inform Support in Intelligent Everyday Applications (long)

Progressive Disclosure: Designing for Effective Transparency (long)

Supporting job mediator and job seeker through an actionable dashboard (long)

TiiS: Seven Metrics that Matter when Modeling Expert Sketching Ability

4:40-5:10pm Coffee Break

Natural Language & Speech

Chair: Ilaria Torre

Vajra: Step-by-step programming with natural language (long)

Inferencing Underspecified Natural Language Utterances in Visual Analysis (long)

Empathic Dialogue System based on Emotions Extracted from Tweets (short)

Collaborative Interfaces II

Chair: Amy Zhang

Outstanding Paper Award Personalized Explanations for Hybrid Recommender Systems (long)

TiiS: Evaluation and Refinement of Clustered Search Results with the Crowd

CoSummary: Adaptive Fast-Forwarding for Surgical Videos by Detecting Collaborative Scenes Using Hand Regions and Gaze Positions (long)

Big Data and Analytics

Chair: Arjun Srinivasan

Atlas: Local Graph Exploration in a Global Context (long)

Flux Capacitors for JavaScript DeLoreans: Approximate Caching for Physics-based Data Interaction (long)

Avoiding Drill-down Fallacies with VisPilot: Assisted Exploration of Data Subsets (long)

Walk to Banquet Room
6:30-9 PM Award Ceremony and Conference Banquet

March 20th, Wednesday

Workshop Day


Full day

Half day

9:00 - 10:30
Session 1
Intelligent Music Interfaces for Listening and Creation
(Pacific 2)

Exploratory Search and Interactive Data Analytics
(Pacific 1)

Explainable Smart Systems
Theory-Informed User Modeling for Tailoring and Personalizing Interfaces

Intelligent User Interfaces for IoT

User Interactions for Building Knowledge

User Interfaces for Spatial-Temporal Data Analysis
(Pacific 3)

Intelligent User Interfaces for Algorithmic Transparency in Emerging Technologies
10:30 - 11:00
Coffee break
(provided by conference organzation
11:00 - 13:00
Session 2
13:00 - 14:00
Lunch break
14:00 - 15:30
Session 3
User-Aware Conversational Agents
15:30 - 16:00
Coffee break
(provided by conference organzation
16:00 - 18:00
Session 4


March 17th, Sunday

Student Consortium

SC 1
Health-related aspects

Sierra I & II

Chair: Tsvika Kuflik
Conversational Technology and Affective Computing for Cognitive Disability
Fabio Catania
Post-laryngectomy interaction restoration system
Konrad Zieliński, Ryszard Szamburski, Ewa Machnacz
Augmented reality simulation toward improving therapeutic healthcare communication techniques
Matthew Bonham
Training self-sufficiency and social skills with embodied conversational agent for children with autism
Micol Spitale
SC 2
Human feedback and interaction-based design

Pacific I & II

Chair: Ilaria Torre
Adaptive Suggestions to Increase Learnability for Voice User Interfaces
Chelsea Myers
Online Virtual Standardized Patient for Communication Skills Training
Ali, Mohammad Rafayet
End User Programing of Intelligent Agents Using Demonstrations and Natural Language Instructions
Toby Li
A Modular Framework for Collaborative Multimodal Annotation and Visualization
Chris Kim
SC 3
Novel UIs for recommenders and for the ubiquitous environment

Pacific III

Chair: Jeff Nichols
Recommending Privacy Settings for IoT
Yangyang He
Personal User Interfaces for Recommender Systems
Martijn Millecamp
A Pedestrian Perspective on Autonomous Vehicles
Kai Hollaender
How is Siri Different than GUIs?
James Simpson

March 18th, Monday


1 Real-Time Collaborative System Based on Distributed Data Sharing Method
Chen Bin, Kenji Nakajima, Koki Hatada, Junichi Yura, Masashi Uyama, Keiju Okabayashi
2 Engagement Estimation Based on Synchrony of Head Movements: Application to Actual E-learning Scenarios
Ryosuke Kawamura, Yushi Toyoda, Koichiro Niinuma
3 Cognitive Load during Gaze Typing
Tanya Bafna, John Paulin Hansen
4 An interface for explaining the automatic classification of runners' trainings
Federico Maria Cau, Mattia Samuel Mancosu, Paolo Pilloni, Fabrizio Mulas, Lucio Davide Spano
5 Propagating Vibration Analysis of Leg Towards Ankle Joint Angle Estimation
Atsutoshi Ikeda, Shinichi Kosugi, Yasuhiro Tanaka
6 Metrics based Content Layouting
Balaji Vasan Srinivasan, Vishwa Vinay, Niyati Chhaya
7 Point-of-Interest Category Recommendation Based on Group Mobility Modeling
Xingxin Liu, Xingyu Huang, Yue Wang, Lin Zhang
8 Movie Trailer Analysis based on Editing Features of Movies
by Honoka Kakimoto, Yuanyuan Wang, Yukiko Kawai, Kazutoshi Sumiya
9 Mobile Device Interaction using Projector Metaphor
Hyocheol Ro, Yoon Jung Park, Jung-Hyun Byun, Tack-Don Han
10 Effects of Correctness and Suggestive Feedback on Learning with an Autonomous Virtual Trainer
Xiumin Shang, Ahmed Arif, Marcelo Kallmann
11 An Exploratory Study of Augmented Embodiment for Computational Thinking
Cheng-Yu Chung, Sharon I-Han Hsiao
12 Adaptive Projection Augmented Reality with Object Recognition based on Deep Learning
Yoon Jung Park, Hyocheol Ro, Jung-Hyun Byun, Tack-Don Han
13 A Case for a Richer, Bi-directional Interface between Augmented Reality Applications and the Network
Tooba Ahsen, Fahad Dogar
14 Mining Human Activity and Smartphone Position from Motion Sensors
Zhiqiang Gao, Dawei Liu
15 NeuroPose - Geriatric rehabilitation in the home using a web cam and pose estimation
Steven Rick, Shubha Bhaskaran, Yajie Sun, Sarah McEwen, Nadir Weibel
16 Programming-by-Example for Data Transformation to Improve Machine Learning Performance
Minori Narita, Takeo Igarashi
17 WIYE: building a corpus of children’s audio and video recordings with a story-based app
Micol Spitale, Fabio Catania, Mirko Gelsomini, Giulia Cosentino
18 GENIEL: An auto-Generative Intelligent Interface to Empower Learning in a Multisensory Environment
Giulia Cosentino, Giulia Leonardi, Micol Spitale, Mirko Gelsomini
19 Relaxation “sweet spot” exploration in pantophonicmusical soundscape using reinforcement learning
Isuru Jayarathne, Michael Cohen, Michael Frishkopf, Gregory Mulyk
20 Evaluation of Intelligent Input Interface for Entering Equations on Smartphone
Shizuka Shirai, Tetsuo Fukui
21 Emotify: an Emotional Game for Children with Autism Spectrum Disorder based-on Machine Learning
Amirreza Rouhi, Micol Spitale, Fabio Catania, Giulia Cosentino, Mirko Gelsomini
22 Geotagging Tweets to Landmarks using Convolutional Neural Networks with Text and Posting Time
Kwan Hui Lim, Shanika Karunasekera, Aaron Harwood, Yasmeen George
23 HuManIC: Human Machine Interpretive Control
Phillip Odom, Raymond Hebard, Stephen Lee-Urban
24 A preliminary study on the use of emotional recurrence analysis to identify coordination in collaborative learning
Yugo Hayashi
25 Supporting Peer Assessment in Education with Conversational Agents
26 Identifying Useful Documents in the Workplace from Web Browsing and Working Logs
Wataru Uno, Ryota Ozaki, Noriji Kato
27 The Effect of Subjective Speech on Product Recommendation Virtual Agent
Tetsuya Matsui, Seiji Yamada
28 Explainable Recommender System that Maximizes Exploration
Homanga Bharadhwaj
29 Visualising Module Dependencies in Academic Recommendations
Nina Hagemann, Michael O'Mahony, Barry Smyth
30 Enhancing Explainability of Social Recommendation Using 2D Graphs and Word Cloud Visualizations
Saeed Amal, Tsvi Kuflik, Einat Minkov, Peter Brusilovsky, Mustafa Adam
31 A Proposal of Spatial Operators for a Collaborative Map Search System
Yuanyuan Wang, Panote Siriaraya, Yukiko Kawai, Keishi Tajima
32 Identifying “Horse Race” Stories in Election News
Miriam Boon, Larry Birnbaum
33 Integrating Declarative Models and HMMs for Online Gesture Recognition
Alessandro Carcangiu, Lucio Davide Spano
34 PAC-PAC: intelligent storytelling for point-and-click games on the web
Filippo Fanni, Angelo Mereu, Martina Senis, Alessandro Tola, Lucio Davide Spano, Fabio Murru, Marco Romoli, Ivan Blecic, Giuseppe Trunfio
35 SleepBot - Encouraging Sleep Hygiene Using an Intelligent Chat Bot
Steven Rick, Aaron Goldberg, Nadir Weibel
36 Exploring Autonomy in the Design of an Intelligent Health Assistant for Older Adults
Jamie Sanders, Aqueasha Martin-Hammond
37 Collaborative Lifelogging through the Integration of Machine and Human Computation
Mousa Ahmadi, Cristian Borcea, Quentin Jones
38 Evaluating Expressiveness of a Voice-guided Speech Re-synthesis System using Vocal Prosodic Parameters
Yuan-Yi Fan, Soyoung Shin, Vids Samanta
39 Evaluating the Efficacy of Traditional Fitness Tracker Recommendations
Fabio Gasparetti, Luca Maria Aiello, Daniele Quercia
40 With Respect to What: Simultaneous Interaction with Dimension Reduction and Clustering Projections
John Wenskovitch, Michelle Dowling, Chris North
41 Field study as a method to assess effectiveness of post-laryngectomy communication assistive interfaces
Konrad Zieliński, Ryszard Szamburski, Joanna Rączaszek-Leonardi
42 Sequence learning using Content and Consumption Patterns for User Path Prediction
Kushal Chawla, Niyati Chhaya, Aman Deep Singh, Soumya Vadlamannati, Aarushi Agrawal
43 Quantification of gracefulness from hand trajectory in classical dance motion
Takumi Nakamura, Kenichi IIDA, Etsuko Ueda


44 Automatic Exam Grading by a Mobile Camera
Ben Wagstaff, Chiao Lu, Xiang Anthony Chen
45 Landscape Freestyle: restyling site plans for landscape architecture with machine learning
Qiaoyu Zheng
46 DL-Dashboard : User-friendly Deep Learning Model Development Environment
Yoomi Park Eun-Ji Lim Shinyoung Ahn Wan Choi Taewoo Kim
47 Getting Virtually Personal: Chatbots That Actively Listen to You and Infer Your Personality
Michelle Zhou, Wenxi Chen, Ziang Xiao, Huahai Yang, Changyan Chi, Ransom Williams
48 Garuda: A Deep Learning Based Solution for Capturing Selfies Safely
Jitender Virk, Abhinav Dhall
49 An Automatic Drum Machine with Touch UI Based on a Generative Neural Network
Richard Vogl, Hamid Eghbal-zadeh, Peter Knees
50 PARLEY: A Transparent Virtual Social Agent Training Interface
Tanja Schneeberger, Patrick Gebhard, Tobias Baur, Elisabeth Andre
51 Adding Intelligence to a Data Security Analysis System: Recommendation and Planning Support
Tianyi Li, Gregorio Convertino, Ranjeet Kumar Tayi, Shima Kazerooni
52 Reflex: Adaptive Learning beyond the Screen
Mirko Gelsomini, Micol Spitale, Eleonora Beccaluva, Leonardo Viola, Giulia Cosentino
53 Explaining Educational Recommendations through a Concept-Level Knowledge Visualization
Jordan Barria-Pineda, Peter Brusilovsky
54 Universal Voice-Enabled User Interfaces using JavaScript
Jaejun Lee, Raphael Tang, Jimmy Lin
55 Coverage-scalable Instant Tabletop Positioning System with Self-localizable Anchor Nodes
Pei Hao Chen, Ryo Shirai, Masanori Hashimoto
56 Autocomplete Vocal-fo Annotation of Songs Using Musical Repetitions
Tomoyasu Nakano, Yuki Koyama, Masahiro Hamasaki, Masataka Goto
57 Computer-Supported Form Design using Keystroke-Level Modeling with Reinforcement Learning
Katri Leino, Kashyap Todi, Antti Oulasvirta, Mikko Kurimo
58 SAM: Self-Adapting Menus on the Web
Camille Gobert, Kashyap Todi, Gilles Bailly, Antti Oulasvirta
59 VIRTUE - A Virtual Reality Museum Experience
Ivan Giangreco, Loris Sauter, Mahnaz Amiri, Parian Ralph Gasser, Silvan Heller, Heiko Schuldt
60 A Demonstration of Automated Database Application Development
by H. Paul Zellweger
61 An Intelligent Interface for Integrating Climate, Hydrology, Agriculture, and Socioeconomic Models
by Daniel Garijo, Deborah Khider, Varun Ratnakar, Yolanda Gil, Kelly Cobourn, Ewa Deelman, Chris Duffy, Rafael Ferreira da Silva, Armen Kemanian, Craig Knoblock, Vipin Kumar, Scott Peckham, Yao-Yi Chiang, Ankush Khandelwal, Minh Pahm, Jay Pujara, Maria Stoica, Kshitij Tayal, Binh Vu, Anna Dabrowski, Daniel Hardesty-Lewis, Suzanne Pierce
62 User-Controlled Hybrid Recommendation for Academic Papers
Behnam Rahdari, Peter Brusilovsky