Tag Archives: unh ece

2011 Senior Project topics: multi-touch surface interaction

I am seeking students (individuals or teams) for two senior projects. Both projects would leverage a multi-touch surface to create a natural user interface for pervasive computing applications.

Pervasive computing problems and ideas are often introduced using videos. An excellent exampe is the Microsoft Health Future Vision video (download, watch on YouTube).

Let’s focus on three themes from the video that are relevant to the senior projects: interactions with multi-touch interfaces, interactions with tangible user interfaces, and data manipulation/fusion. Multi-touch surfaces appear throughout the video: in Sabine’s home, in the doctor’s office, and in the hospital lobby. Several of the multi-touch interfaces, such as Sabine’s remote control, and her virtual wallet (used in the lobby), are tangible interfaces. Finally, Dr. Kemp manipulates/fuses data when interacting with Alex (patient in bed) and especially during the meeting with Sabine and Wei Yu.

The two senior projects will leverage Project54’s Microsoft Surface multi-touch table. Here is a video by UNH ECE graduate student Tim April introducing some of the interactions he has explored with the Surface.

With all this in mind, here are the specifics on the two proposed projects.

Project 1: Mobile data fusion

This project will explore fusing data, such as images, video, sounds and outputs from various sensors (temperature, pressure, accelerometers, etc.). Data fusion will require some simple processing, such as setting beginning and end points for sounds, zooming images, etc. It will also require more complex digital signal processing of data, e.g. windowing and filtering (topics covered in ECE 714). Consequently, work on this project will focus on data processing as well as object-oriented programming that is necessary to control the multi-touch table.

This project will be tied to a collaborative effort with WPI on creating a fleet of UAVs. Thus, eventually, the data to process and display on the multi-touch will come from the UAVs. However, as a first step, data will be generated through games, similarly to work done by Jatin Matani and Trupti Telang.

Project 2: IR wallet

The Microsoft Surface uses infrared illumination and cameras to recognize interactions with its surface. It can also recognize 2D barcodes if they are visible in the IR part of the spectrum. The “IR wallet” project would result in a tangible user interface, similar to Sabine’s virtual wallet, that can display 2D barcodes in IR. These in turn will be picked up by the Microsoft Surface. Work on this project will focus on microcontroller-based design (e.g. with an Arduino board) and object-oriented programming for the Surface.

Interested? Have questions, ideas, suggestions? Email me.

Bryan Reimer visit to UNH

It was my great pleasure to host Bryan Reimer at UNH. Bryan is Research Scientist at the MIT Age Lab as well as Associate Director of the New England University Transportation Center. His research focuses on the measurement and understanding of human behavior in dynamic environments, such as in cars.

Bryan spent time in the Project54 lab discussing various aspects of driving simulator and field studies. He then gave a thought-provoking talk reviewing results from multiple studies exploring driver workload and distraction. I expecially enjoyed his discussion of physiological measures that can be used to estimate workload. E.g. Bryan has found that heart rate is a robust estimate of workload and is often more useful than the often-used measure of heart rate variability. Bryan also discussed work on validating driving simulator results through field studies. His data indicate that driving simulator results can be used to predict relative changes in workload measures under different situations in real-life driving. However, the actual values of the measures collected in simulator and field studies often differ significantly.

For more pictures visit Flickr.

2011 CEPS Study Abroad Information Session

UNH’s College of Engineering and Physical Sciences (CEPS) has several exchange programs, one of which allows our students to study a semester at the Budapest University of Technology and Economics (BUTE). On Saturday (3/5/11) I had a chance to introduce the ECE perspective of the Budapest exchange program to an impressively large (80+) group of students and parents. My presentation was part of the CEPS Study Abroad Information Session organized by Bob Henry, CEPS associate dean for academic affairs, and his staff.

My favorite part of the information session was the student panel. Bob Henry invited five students who spent time abroad (three in Budapest and two at Heriot-Watt University in Scotland) last fall to answer questions from the audience. As in panels I’ve seen in the past, the students gave the exchange programs glowing recommendations. However, this year Bob Henry added something I haven’t seen in the past: the parents of a student panelist were on hand to answer questions from their perspective. This strikes me as an excellent way to make the parents of prospective study-abroad students feel comfortable with the program, and prepare them for the inevitable stress of their children moving to another continent for a few months.

Several UNH ECE students were at the information session and I hope they take advantage of the opportunity to study in Budapest. Carol Perkins and four other ECE juniors are currently in Budapest and, according to Carol, they are adjusting very well.

For more pictures from the event visit Flickr.

Pervasive Computing and Communications Group at UNH

Three UNH ECE faculty, Nicholas Kirsch, Tom Miller and me, have formed the Pervasive Computing and Communications Group. Our group investigates a wide range of topics from human-computer interactions to the physical networks that make sharing information effortless.

Nick joined UNH ECE in the fall of 2010. His interest is in spectrally efficient wireless communications systems utilizing software defined radios. Tom and I have been involved with the Project54 system since 1999. Tom’s interest is in embedded system design and application development and on human-computer interaction with mobile devices. My primary interest is in human-computer interaction for mobile devices and for desktop multi-touch devices.

PhD and MS position at the University of New Hampshire exploring in-car human-computer interaction

A PhD and an MS position are available in the Project54 lab at the University of New Hampshire. The lab is part of the Electrical and Computer Engineering department at UNH. Successful applicants will explore human-computer interaction in vehicles.

The Project54 lab was created in 1999 in partnership with the New Hampshire Department of Safety to improve technology for New Hampshire law enforcement. Project54’s in-car system integrates electronic devices in police cruisers into a single voice-activated system. Project54 also integrates cruisers into agency-wide communication networks. The Project54 system has been deployed in over 1000 vehicles in New Hampshire in over 180 state and local law enforcement agencies.

Research focus

Both the PhD and the MS student will focus on the relationship between various in-car user interface characteristics and the cognitive load of interacting with these interfaces, with the goal of designing interfaces that do not significantly increase driver workload. Work will involve developing techniques to estimate cognitive load using performance measures (such as the variance of lane position), physiological measures (such as changes in pupil diameter) and subjective measures (such as the NASA-TLX questionnaire).

The work will utilize experiments in Project54’s world-class driving simulator laboratory which is equipped with two research driving simulators, three eye trackers and a physiological data logger. Laboratory experiments will be complemented by field deployments in law enforcement agencies such as the New Hampshire State Police, which operates over 300 police cruisers. Project54 has deployed a state-wide data update infrastructure for the New Hampshire State Police which allows remote updates to in-car experimental software and remote collection of experimental data.

Appointment

The PhD student will be appointed for four years, and the MS student for two years. Initial appointments will be for one year, starting between June and September 2011. Continuation of funding will be dependent on satisfactory performance. Appointments will be a combination of research and teaching assistantships. Compensation will include tuition, fees, health insurance and academic year and summer stipend.

How to apply

For application instructions, and for general information, email Andrew Kun, Project54 Principal Investigator at andrew.kun@unh.edu. Please attach a current CV.

Report on ECE Graduate Seminar

During the 2009-2010 academic year I taught a new version of the UNH ECE Graduate Seminar (ECE 900), a course I first introduced in the fall of 2002. The primary aim of the previous version of the course was to expose our graduate students to research and development conducted at other institutions. Thus, the course consisted of eight invited talks per semester, given by engineers, scientist and other professionals, and covering a range of topics of interest to ECE students.

Starting with the 2009-2010 academic year the primary aim of the course has become to introduce graduate students to the general tools of scientific research. I championed this new aim for the course and I’m grateful that my faculty colleagues gave me an opportunity to share my excitement about scientific research with our graduate students.

The course had three main aspects:

Lectures on performing scientific research. My lectures introduced students to the steps of scientific research, from formulating problems, to proposing hypotheses and conducting experiments.
Research talks. Each student attended at least 15 talks. Most of these were held at UNH and the speakers were exceptional. At the same time, I encouraged the students to recommend talks that we can attend at other institutions. The result: trips to MIT, BU and WPI.
Research proposal. At the end of the two semester sequence each student submitted a short research proposal and gave a presentation on the same. The proposals were developed over the two semesters, with students working individually and in groups. I provided feedback throughout the year on different segments of the proposal.

In an informal survey at the end of the academic year most students indicated that they liked the new version of the ECE Graduate Seminar and that they thought it was useful. All of the students thought that learning about the tools of science is useful and the majority also indicated that their technical writing skills improved due to this course. These responses are certainly encouraging.

I will be teaching ECE 900 again during the 2010-2011 academic year. Based on my experiences reported here, as well as those with my Fundamentals of Ubicomp course, I plan to implement two changes:

Accelerate proposal development. I will move up the due date for the final research proposal to sometime early in the second semester. The accelerated schedule should help build excitement for learning about science. It will also give us time at the end of the year to discuss how other researchers approach scientific work. Finally, it will help with student participation in the course, which is the subject of the second change I intend to implement.
Increase student participation. While I encouraged student participation throughout the semester, the results were not always stellar. By accelerating the proposal development process I hope to provide students with discussion topics that they feel comfortable talking about. I also intend to ask students to hold multiple formal presentations in class. One assignment that students can expect next semester: create a 15 minute presentation about a research topic of your choice, based on a research video posted online.

Report on Fundamentals of Ubicomp course

During the spring 2010 semester I taught a new course entitled Ubiquitous Computing Fundamentals. The term ubiquitous computing refers to the model of computing in which computers are embedded in everyday objects and become part of everyday activities. As the name implies, this course was designed as an introduction to this exciting field of study.

In this course I used the excellent new ubicomp textbook [1] edited by John Krumm. I highly recommend this book to anyone starting out in the field of ubicomp. Specifically, I like two aspects of the book. First, the team of contributors assembled by John provides a comprehensive introduction to the myriad topics that make up the ubicomp field. The fact that ubicomp is an interdisciplinary field is exciting, but getting an overview of the field may seem like a daunting task. The textbook provides this overview. Second, paraphrasing Aaron Quigley‘s assessment of his chapter [2], the book provides “an entry point” to the world of conducting research in general, and ubicomp research in particular. The contributors discuss the tools used in various aspects of ubicomp research, from prototyping, to user studies, to data processing. The individual chapters help the reader formulate research questions and steps, and provide valuable tips on how to report on results.

The course covered three topic areas:

History of ubicomp. The semester started with Weiser’s seminal paper [3] and with a textbook chapter introducing ubicomp by Roy Want, one of Weiser’s collaborators at Xerox PARC.
Building ubicomp systems. We discussed various aspects of creating ubicomp systems, from writing always-on software, to privacy, to conducting laboratory and field experiments.
The user experience. As this is my research focus, we spent a considerable amount of time discussion user interactions with ubicomp systems, from speech interactions, to multi-touch tables, to tangible user interfaces.

I found that an excellent way to discuss ubicomp topics is to take advantage of research videos posted online. We viewed many such videos and this led to productive discussions. We also benefited from excellent talks by Marko Popovic, Bret Harsham and Albrecht Schmidt.

I felt that the course was a success. Students indicated that they liked the course and thought that it was useful. The course also allowed students to express themselves creatively through the course project. The results were impressive and I’ll end this post with an example. The video below is the work of UNH ECE seniors Amy Schwarzenberg and Kyle Maroney (both graduated in May). Amy and Kyle explored user interactions with a Microsoft Surface multi-touch table.

References

[1] John Krumm (editor), “Ubiquitous Computing Fundamentals,” CRC Press, 2010

[2] Aaron Quigley, “From GUI to UUI: Interfaces for Ubiquitous Computing,” in John Krumm (editor), “Ubiquitous Computing Fundamentals,” CRC Press, 2010

[3] Mark Weiser, “The Computer for the 21st century,” Scientific American, pp. 94-10, September 1991

Return visit to Budapest University of Technology and Economics (BUTE)

On June 7 and 8, 2010 I visited the Budapest University of Technology and Economics (BUTE) for the second time in ten months. As with my last visit I went to discuss the BUTE-CEPS exchange program.

During this visit I met six people who have been involved in organizing different aspects of the exchange program. My host was Eszter Kiss, the Program Director of the Information Center for Engineering Programs in English (ICEPE). For UNH/CEPS students, staff and faculty, she is the Hungarian face of the exchange program. Eszter and I primarily talked about the fact that, starting in 2011, UNH ECE exchange students will spend the spring semester in Budapest. Other CEPS students will remain on the fall-in-Budapest schedule.

Eszter organized two meetings for me with BUTE leaders. The first one was with Dr. Peter Moson, Vice-Rector for International Relations (the Vice-Rector position at BUTE is equivalent to the Vice President position at a US university). Ildiko Varga, the head of the BUTE Erasmus and Exchange Office was also present at this meeting. Dr. Moson expressed his full support for a vibrant relationship between BUTE and CEPS. On a personal note it was great to see Dr. Moson who I met during his visit to UNH last year. It was also nice to talk to Ms. Varga who went to graduate school and taught mathematics at Purdue.

The second meeting organized by Eszter was with Dr. Gabor Stepan. Dr. Stepan, a member of the Hungarian Academy of Sciences (HAS), is the Dean of the BUTE Faculty of Mechanical Engineering, the ICEPE’s parent unit. Dr. Stepan expressed his full support for the BUTE-CEPS exchange program. Again on a personal note, it was exciting for me to visit the BUTE Faculty of ME where my father received his BS ME a long time ago. Dr. Stepan also spent some time telling me about BUTE’s history, including facts and anecdotes about BUTE’s Nobel-prize winning alumni.

While the meetings with Drs Stepan and Moson and with Ms. Varga primarily dealt with the overall BUTE-CEPS relationship, I also had a chance to work on issues related to UNH ECE directly with the BUTE unit that hosts ECE students. Specifically, Dr. Moson introduced me to Dr. Balint Kiss, the person in charge of the English language education at the Faculty of Electrical Engineering and Informatics. This is the BUTE unit that hosts UNH ECE exchange students and Dr. Kiss will be my primary contact in determining courses for our students to take while at BUTE. The meeting with Dr. Kiss was also an opportunity to catch up with Dr. Peter Arato. Dr. Arato, who is also a HAS member, has strong ties to the UNH ECE department having collaborated extensively with UNH ECE professor Andrzej Rucinski.

In addition to all these productive meetings I had a chance to give a talk to BUTE students interested in the exchage program. Seven prospective students attended, several of them interested in coming to the UNH ECE department – I hope we’ll see them here soon.

I would like to thank Eszter Kiss for organizing my visit (on very short notice). I would also like to thank the BUTE faculty, staff and students who took time to meet with me. Finally, I would like to acknowledge the UNH ECE Department and the CEPS Dean’s office who jointly funded this visit.

For pictures about my trips to Budapest visit my Flickr page.

Alex Shyrokov defends PhD

Two weeks ago my student Alex Shyrokov defended his PhD dissertation. Alex was interested in human-computer interaction for cases when the human is engaged in a manual-visual task. In such situations a speech interface appears to be a natural way to communicate with a computer. Alex was especially interested in multi-threaded spoken HCI. In multi-threaded dialogues the conversants switch back and forth between multiple topics.

How should we design a speech interface that will support multi-threaded human-computer dialogues when the human is engaged in a manual-visual task? In order to begin answering this question Alex explored spoken dialogues between two human conversants. The hypothesis is that a successful HCI design can mimic some aspects of human-human interaction.

In Alex’s experiments one of the conversants (the driver) operated a simulated vehicle while the other (an assistant) was only engaged in the spoken dialogue. The conversants were engaged in an ongoing and in an interrupting spoken task. Alex’s dissertation discusses several interesting findings, one of which is that driving performance is worse during and after the interrupting task. Alex proposes that this is due to a shift in the driver’s attention away from driving and to the spoken tasks. The shift in turn is due to the perceived urgency of the spoken tasks – as the perceived urgency increases the driver is more likely to shift her attention away from driving. The lesson for HCI design is to be very careful in managing the driver’s perceived urgency when interacting with devices in the car.

Alex benefited tremendously from the help of my collaborator on this research Peter Heeman. Peter provided excellent guidance throughout Alex’s PhD studies for which I am grateful. Peter and I plan to continue working with Alex’s data. The data includes transcribed dialogues, videos, driving performance as well as eye tracker data. I am especially interested in using the eye tracker’s pupil diameter measurements to estimate cognitive load as we have done in work lead by Oskar Palinko [1].

References

[1] Oskar Palinko, Andrew L. Kun, Alexander Shyrokov, Peter Heeman, “Estimating Cognitive Load Using Remote Eye Tracking in a Driving Simulator,” ETRA 2010

Promoting the CEPS-BUTE Exchange Program

In an effort to promote the CEPS–BUTE exchange program I gave the following presentation to two similar audiences here at UNH. Last Monday Kent Chamberlin hosted me in his ECE 401 class (the introductory ECE course) and I had a chance to talk to about 75 ECE freshmen. Today I gave the presentation to Bob Henry’s TECH 400 students (TECH 400 introduces the CEPS majors to CEPS undeclared students).

Why Spend a Semester Studying in Budapest?

View more presentations from Andrew Kun.

My main point was this: spending a semester abroad gives students a competitive advantage because it proves that they can adapt to change. Of course spending a semester in Europe allows students to travel and I spent some time promoting my favorite travel guide author, Rick Steves 🙂