Research

My research interest is in user interfaces for ubiquitous computing applications. The ubiquitous computing vision is a world in which computers are embedded in everyday objects and become part of everyday activities. Within ubicomp, my primary focus is on mobile interfaces for users who are also involved in an eyes-busy, hands-busy task, such as operating a vehicle. I explore approaches towards creating interfaces that do not unduly increase the user’s cognitive load. My major hypothesis in this exploration is that we can use human-human interaction as inspiration for creating advanced human-computer interfaces.

Cognitive load of HCI. Cognitive load is commonly defined as the relationship between the cognitive demands placed on a user by a task, and the cognitive resources of the user [1]. My colleagues and I have explored the performance, physiological and subjective measures of cognitive load of a number of in-vehicle tasks, such as operating a police radio [2] and interacting with personal navigation devices [3, 4]. Currently I’m particularly interested in using pupil diameter as a physiological measure of cognitive load [5]. My work focuses on estimating cognitive load in driving simulator-based experiments [6, 7], as well as under varying levels of illumination [8, 9].

HCI inspired by human-human interaction. I am fascinated by the fact that drivers with passengers have a lower probability of getting into an accident than those who drive alone [10, 11]. This fact is the basis of hypothesizing that human-human interaction can indeed provide inspiration for safe and effective HCI, even in complex environments such as a vehicle. My work is currently focused on identifying behaviors in human spoken interactions that might serve as inspiration for HCI [12-17].

Project54. I am the principal investigator of the Project54 effort at UNH, which addresses ubicomp in the law enforcement setting. This multi-million dollar effort started in 1999, and it resulted in the design and deployment of the Project54 system. The Project54 system integrates in-car devices, provides a single user interface for interaction with these devices and allows the integration of mobile police units into an agency-wide data network. Over the last decade the Project54 system was deployed in over 1,000 law enforcement vehicles, primarily in New Hampshire.

Service:

Ongoing:

2014

  • Reviewer: NSF, TOCHI, Transportation Research Part D: Transport and Environment, Human-Computer Interaction, Interacting with Computers, Computer Speech and Language, NordiCHI

2013

  • Advisory Board Member: UNH Interoperability Lab
  • Associate chair: MobileHCI 2013
  • Co-organizer: “Automotive User Interface Research Moves into the Fast Lane” SIG at CHI ’13
  • Program committee: MobiCASE 2013
  • Reviewer:  IEEE Pervasive Computing, Int. J. of Human-Computer Studies, Int. J. of Psychophysiology, Driving Assessment 2013, UIST 2013

2012

2011

2010

My collaborators:

  • Peter Heeman – Peter and I are interested in creating advanced spoken dialogue systems. We believe this design can be inspired by behaviors observed in human dialogues. Peter and I have recently completed an NSF project on multi-threaded spoken dialogues.
  • Tom Miller – Tom is the co-PI of the Project54 effort at UNH. We collaborate on various aspects of this effort, from work on handheld computers, to multi-touch surfaces to in-car user interfaces.
  • Tim Paek – Tim and I worked on exploring in-car speech user interfaces.
  • Zeljko Medenica – Zeljko received his PhD with me in 2012. He explored in-car user interfaces and their effects on driving.
  • Alexander Shyrokov – Alex received his PhD with me in 2010. He worked with me and Peter on multi-threaded dialogues.

 

References

[1] C. D.Wickens. Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3(2):159–177, 2002.

[2] Zeljko Medenica, Andrew L. Kun, “Comparing the Influence of Two User Interfaces for Mobile Radios on Driving Performance,” Driving Assessment 2007

[3] Andrew L. Kun, Tim Paek, Zeljko Medenica, Nemanja Memarovic, Oskar Palinko, “Glancing at Personal Navigation Devices Can Affect Driving: Experimental Results and Design Implications,” Automotive UI 2009

[4] Zeljko Medenica, Andrew L. Kun, Tim Paek, Oskar Palinko, “Augmented Reality vs. Street Views: A Driving Simulator Study Comparing Two Emerging Navigation Aids,” MobileHCI 2011

[5] Jackson Beatty, “Task-Evoked Pupillary Responses, Processing Load, and the Structure of Processing Resources,” Psychological Bulletin, 276-292, 91(2)

[6] Oskar Palinko, Andrew L. Kun, Alexander Shyrokov, Peter Heeman, “Estimating Cognitive Load Using Remote Eye Tracking in a Driving Simulator,” ETRA 2010

[7] Andrew L. Kun, Zeljko Medenica, Oskar Palinko, Peter A. Heeman, “Utilizing Pupil Diameter to Estimate Cognitive Load Changes During Human Dialogue: A Preliminary Study,” AutomotiveUI 2011 Adjunct Proceedings

[8] Oskar Palinko, Andrew L. Kun, “Exploring the Influence of Light and Cognitive Load on Pupil Diameter in Driving Simulator Studies,” Driving Assessment 2011

[9] Oskar Palinko, Andrew L. Kun, “Exploring the Effects of Visual Cognitive Load and Illumination on Pupil Diameter in Driving Simulators,” ETRA 2012

[10] Trinidad Rueda-Domingoa, Pablo Lardelli-Claret, Juan de Dios Luna-del Castillo, Jose Juan Jimenez-Moleon, Miguel Garcia-Martin, and Aurora Bueno-Cavanillas. The influence of passengers on the risk of the driver causing a car collision in Spain: Analysis of collisions from 1990 to 1999. Accident Analysis & Prevention, 36(3):481–489, 2004.

[11] Mark Vollrath, Tobias Meilinger, and Hans-Peter Kr ¨uger. How the presence of passengers influences the risk of a collision with another vehicle. Accident Analysis & Prevention, 34:649–654, 2002.

[12] Andrew L. Kun, Alexander Shyrokov, and Peter A. Heeman, “Interactions between Human-Human Multi-Threaded Dialogues and Driving,” PUC Online First, to appear in PUC, 2012

[13] Andrew L. Kun, Zeljko Medenica, “Video Call, or Not, that is the Question,” CHI ’12 Extended Abstracts

[14] Fan Yang, Peter A. Heeman, Andrew L. Kun, “An Investigation of Interruptions and Resumptions in Multi-Tasking Dialogues,” Computational Linguistics, 37, 1, 2011

[15] Andrew L. Kun, Alexander Shyrokov, Peter A. Heeman, “Spoken Tasks for Human-Human Experiments: Towards In-Car Speech User Interfaces for Multi-Threaded Dialogue,” Automotive UI 2010

[16] Fan Yang, Peter A. Heeman, Andrew L. Kun, “Switching to Real-Time Tasks in Multi-Tasking Dialogue,” Coling 2008

[17] Alexander Shyrokov, Andrew L. Kun, Peter Heeman, “Experimental modeling of human-human multi-threaded dialogues in the presence of a manual-visual task,” SigDial 2007

Associate Professor, Electrical and Computer Engineering, University of New Hampshire