My research interest is in user interfaces for ubiquitous computing applications. The ubiquitous computing vision is a world in which computers are embedded in everyday objects and become part of everyday activities. Within ubicomp, my primary focus is on mobile interfaces for users who are also involved in an eyes-busy, hands-busy task, such as operating a vehicle. I explore approaches towards creating interfaces that do not unduly increase the user’s cognitive load. My major hypothesis in this exploration is that we can use human-human interaction as inspiration for creating advanced human-computer interfaces.
Cognitive load of HCI. Cognitive load is commonly defined as the relationship between the cognitive demands placed on a user by a task, and the cognitive resources of the user . My colleagues and I have explored the performance, physiological and subjective measures of cognitive load of a number of in-vehicle tasks, such as operating a police radio  and interacting with personal navigation devices [3, 4]. Currently I’m particularly interested in using pupil diameter as a physiological measure of cognitive load . My work focuses on estimating cognitive load in driving simulator-based experiments [6, 7], as well as under varying levels of illumination [8, 9].
HCI inspired by human-human interaction. I am fascinated by the fact that drivers with passengers have a lower probability of getting into an accident than those who drive alone [10, 11]. This fact is the basis of hypothesizing that human-human interaction can indeed provide inspiration for safe and effective HCI, even in complex environments such as a vehicle. My work is currently focused on identifying behaviors in human spoken interactions that might serve as inspiration for HCI [12-17].
Project54. I am the principal investigator of the Project54 effort at UNH, which addresses ubicomp in the law enforcement setting. This multi-million dollar effort started in 1999, and it resulted in the design and deployment of the Project54 system. The Project54 system integrates in-car devices, provides a single user interface for interaction with these devices and allows the integration of mobile police units into an agency-wide data network. Over the last decade the Project54 system was deployed in over 1,000 law enforcement vehicles, primarily in New Hampshire.
- Steering Committee: AutomotiveUI conference series
- Reviewer: NSF, TOCHI, Transportation Research Part D: Transport and Environment, Human-Computer Interaction, Interacting with Computers, Computer Speech and Language, NordiCHI
- Advisory Board Member: UNH Interoperability Lab
- Associate chair: MobileHCI 2013
- Co-organizer: “Automotive User Interface Research Moves into the Fast Lane” SIG at CHI ’13
- Program committee: MobiCASE 2013
- Reviewer: IEEE Pervasive Computing, Int. J. of Human-Computer Studies, Int. J. of Psychophysiology, Driving Assessment 2013, UIST 2013
- General chair: AutomotiveUI 2012
- Co-organizer: Cognitive Load and In-Vehicle Human-Machine Interaction workshop at AutomotiveUI 2012
- Program committee: TEI 2013
- Reviewer: NSF, ETRA 2012, MobileHCI 2012, NordiCHI 2012, CHI 2013, IUI 2013, Int. J. of Vehicular Technology
- Co-editor: Theme Issue of the Springer Journal Personal and Ubiquitous Computing on Automotive User Interfaces and Interactive Applications in the Car
- Co-organizer: Cognitive Load and In-Vehicle Human-Machine Interaction workshop at AutomotiveUI 2011
- Co-organizer: User Experience in Cars workshop at Interact 2011
- Co-organizer: 5th Workshop on Speech in Mobile and Pervasive Environments at MobileHCI 2011
- Program committee: Industrial Case Studies at MobileHCI 2011, TEI 2011
- Reviewer: IEEE Computer, Interact 2011, MobileHCI 2011, UIST 2011, AutomotiveUI 2011, IUI 2012, NIJ
- Technical program co-chair: AutomotiveUI 2010
- Co-organizer: Automotive User Interfaces: Human Computer Interaction in the Car CHI 2010 SIG
- Co-organizer: 4th Workshop on Speech in Mobile and Pervasive Environments at MobileHCI 2010
- Organizer: First Responder Technology Workshop at UNH
- Program committee: IEEE IV 2010
- Reviewer: IEEE Pervasive Computing, International Journal of ITS Research, NSF, CHI 2011
- Peter Heeman – Peter and I are interested in creating advanced spoken dialogue systems. We believe this design can be inspired by behaviors observed in human dialogues. Peter and I have recently completed an NSF project on multi-threaded spoken dialogues.
- Tom Miller – Tom is the co-PI of the Project54 effort at UNH. We collaborate on various aspects of this effort, from work on handheld computers, to multi-touch surfaces to in-car user interfaces.
- Tim Paek – Tim and I worked on exploring in-car speech user interfaces.
- Zeljko Medenica – Zeljko received his PhD with me in 2012. He explored in-car user interfaces and their effects on driving.
- Alexander Shyrokov – Alex received his PhD with me in 2010. He worked with me and Peter on multi-threaded dialogues.
 C. D.Wickens. Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3(2):159–177, 2002.
 Zeljko Medenica, Andrew L. Kun, “Comparing the Influence of Two User Interfaces for Mobile Radios on Driving Performance,” Driving Assessment 2007
 Andrew L. Kun, Tim Paek, Zeljko Medenica, Nemanja Memarovic, Oskar Palinko, “Glancing at Personal Navigation Devices Can Affect Driving: Experimental Results and Design Implications,” Automotive UI 2009
 Zeljko Medenica, Andrew L. Kun, Tim Paek, Oskar Palinko, “Augmented Reality vs. Street Views: A Driving Simulator Study Comparing Two Emerging Navigation Aids,” MobileHCI 2011
 Jackson Beatty, “Task-Evoked Pupillary Responses, Processing Load, and the Structure of Processing Resources,” Psychological Bulletin, 276-292, 91(2)
 Oskar Palinko, Andrew L. Kun, Alexander Shyrokov, Peter Heeman, “Estimating Cognitive Load Using Remote Eye Tracking in a Driving Simulator,” ETRA 2010
 Andrew L. Kun, Zeljko Medenica, Oskar Palinko, Peter A. Heeman, “Utilizing Pupil Diameter to Estimate Cognitive Load Changes During Human Dialogue: A Preliminary Study,” AutomotiveUI 2011 Adjunct Proceedings
 Oskar Palinko, Andrew L. Kun, “Exploring the Influence of Light and Cognitive Load on Pupil Diameter in Driving Simulator Studies,” Driving Assessment 2011
 Oskar Palinko, Andrew L. Kun, “Exploring the Effects of Visual Cognitive Load and Illumination on Pupil Diameter in Driving Simulators,” ETRA 2012
 Trinidad Rueda-Domingoa, Pablo Lardelli-Claret, Juan de Dios Luna-del Castillo, Jose Juan Jimenez-Moleon, Miguel Garcia-Martin, and Aurora Bueno-Cavanillas. The influence of passengers on the risk of the driver causing a car collision in Spain: Analysis of collisions from 1990 to 1999. Accident Analysis & Prevention, 36(3):481–489, 2004.
 Mark Vollrath, Tobias Meilinger, and Hans-Peter Kr ¨uger. How the presence of passengers influences the risk of a collision with another vehicle. Accident Analysis & Prevention, 34:649–654, 2002.
 Andrew L. Kun, Alexander Shyrokov, and Peter A. Heeman, “Interactions between Human-Human Multi-Threaded Dialogues and Driving,” PUC Online First, to appear in PUC, 2012
 Andrew L. Kun, Zeljko Medenica, “Video Call, or Not, that is the Question,” CHI ’12 Extended Abstracts
 Fan Yang, Peter A. Heeman, Andrew L. Kun, “An Investigation of Interruptions and Resumptions in Multi-Tasking Dialogues,” Computational Linguistics, 37, 1, 2011
 Andrew L. Kun, Alexander Shyrokov, Peter A. Heeman, “Spoken Tasks for Human-Human Experiments: Towards In-Car Speech User Interfaces for Multi-Threaded Dialogue,” Automotive UI 2010
 Fan Yang, Peter A. Heeman, Andrew L. Kun, “Switching to Real-Time Tasks in Multi-Tasking Dialogue,” Coling 2008
 Alexander Shyrokov, Andrew L. Kun, Peter Heeman, “Experimental modeling of human-human multi-threaded dialogues in the presence of a manual-visual task,” SigDial 2007