Keynote by Cecilia Mascolo at Percom2016: Technology and Experiecne in the Physcial World

Cecilia Mascolo presents the keynote at Percom2016. Her opening statement is: “Technology must enhance and not substitute the physical experience”.

Cecilia makes the point that continuous sensing with mobile devices can overcome many issue that are well known with traditional studies (especially the classical problem of psychologist studying psychology students in a dark lab). One of here early papers (EmotionSense, see [1]) shows how we can move studies into the real world. This is not without difficulties, especially when you try to understand emotions.

Putting research apps into android market changes the game, large numbers of users become within reach. Higher numbers of participants require a clear purpose of the applications (Nielse Henze provide in [2] a nice recipe of how to do this). Her experience is that user engagement through gamification really worked. Even if the duration of participation of individuals is limited to weeks or months this generates very useful information. A short introduction to social sensing by Cecilia can be found in [3].

Different sensors have different energy and privacy cost and also different types of contributions. Correlating the accelerometer and happiness is really interesting. Users who are more active (not just movement, “being out and about”) are happier. Clustering accelerometer data and correlating it with other high level data opens exciting questions, e.g. health. Similarly correlating happiness and location leads to more surprising results: less happy at home and work, more when out and active. Looking at people’s personally and demographics shows that gender, age, employment, etc. has a clear correlation with activity and usage of communication.

Physical space matters! Using active badges they looked at how the change of physical space can impact peoples interactions [4]. The sensing approach allowed to understand how changes in physical space changes the behavior on a really fine grained level.

References:
[1] Rachuri, K. K., Musolesi, M., Mascolo, C., Rentfrow, P. J., Longworth, C., & Aucinas, A. (2010, September). EmotionSense: a mobile phones based adaptive platform for experimental social psychology research. In Proceedings of the 12th ACM international conference on Ubiquitous computing (pp. 281-290). ACM. http://csce.uark.edu/~tingxiny/courses/5013sp14/reading/Rachuri2010EMP.pdf
[2] Henze, N., Shirazi, A. S., Schmidt, A., Pielot, M., & Michahelles, F. (2013). Empirical research through ubiquitous data collection. Computer, 46(6), 0074-76. http://doi.ieeecomputersociety.org/10.1109/MC.2013.202
[3] Mascolo, C. (2010). The power of mobile computing in a social era. IEEE Internet Computing, 14(6), 76. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.466.2037&rep=rep1&type=pdf
[4] Brown, C., Efstratiou, C., Leontiadis, I., Quercia, D., Mascolo, C., Scott, J., & Key, P. (2014, September). The architecture of innovation: Tracking face-to-face interactions with ubicomp technologies. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (pp. 811-822). ACM. http://arxiv.org/pdf/1406.6829.pdf

Karin Bee has defended her dissertation.

Karin Bee (nee Leichtenstern) has defended her dissertation at the University of Augsburg. In her dissertation she worked on methods and tools to support a user centered design process for mobile applications that use a variety of modalities. There are some papers that describe her work, e.g. [1] and [2]. To me it was particularly interesting that she revisited the experiment done in her master thesis in a smart home in Essex [3] and reproduced some of it in her hybrid evaluation environment.


It is great to see that now most of our students (HiWis and project students) who worked with us in Munich on the Embedded Interaction Project have finished their PhD (there are some who still need to hand in – Florian? Raphael?, Gregor? You have enough papers – finish it ;-)

In the afternoon I got to see some demos. Elisabeth André has a great team of students. They work on various topics in human computer interaction, including public display interaction, physiological sensing and emotion detection, and gesture interaction. I am looking forward to a joined workshop of both groups. Elisabeth has an impressive set of publications which is always a good starting point for affective user interface technologies.

[1] Karin Leichtenstern, Elisabeth André,and Matthias Rehm. Tool-Supported User-Centred Prototyping of Mobile Applications. IJHCR. 2011, 1-21.

[2] Karin Leichtenstern and Elisabeth André. 2010. MoPeDT: features and evaluation of a user-centred prototyping tool. In Proceedings of the 2nd ACM SIGCHI symposium on Engineering interactive computing systems (EICS '10). ACM, New York, NY, USA, 93-102. DOI=10.1145/1822018.1822033 http://doi.acm.org/10.1145/1822018.1822033

[3] Enrico Rukzio, Karin Leichtenstern, Vic Callaghan, Paul Holleis, Albrecht Schmidt, and Jeannette Chin. 2006. An experimental comparison of physical mobile interaction techniques: touching, pointing and scanning. In Proceedings of the 8th international conference on Ubiquitous Computing (UbiComp'06), Paul Dourish and Adrian Friday (Eds.). Springer-Verlag, Berlin, Heidelberg, 87-104. DOI=10.1007/11853565_6 http://dx.doi.org/10.1007/11853565_6

Opening Keynote at AMI 2011: Margaret Morris

Margaret (Margi) Morris presented the opening keynote at the 2011 conference on ambient intelligence in Amsterdam (AMI2011) with the title “Left to our own devices”.

Margaret brought up an interesting point on motivation: Showing people what they lose is a stronger motivator than the prospective of gain. She made the point in order to implement this the depicted loss has to be very specific. She showed a facebook application “With a little help from my friends”, where this basic concept is applied.   I had recently seen a bill board adverting campaign for safe driving on motorways in Germany using this approach (basically showing the risk of loss of family).

In the talk several examples of devices and applications were presented. To learn more about her work I recommend the following two papers: at tool to improve emotional self-awareness [1] and an investing in social networks and their utility to promote health [2].

Another point that made me think was the question of how we design interventions. One conceptual example was about an obesity campaign. The official UK campaign starts out with the statement that obesity is a problem for 9 million kids. Her alternative is to provide instead of the information a specific hint about an opportunity for action for an individual (e.g. telling the kid when it leaves school in the afternoon: now is probably a good time to play soccer with your friends, as 16 of them like to play soccer). An open research question that relates to this seems to me to investigate the impact of information about the norm, e.g. how will it affect my behavior if I know that 70% of my friends think driving too fast is OK vs. if I know that only 20% find it acceptable. I think this could be further explored in the context of social networks to create interesting persuasive technologies.


There has been an interesting discussion after the talk. Norbert Streitz questioned if it is a good idea to ask people to engage more with digital devices (e.g. self monitoring one’s mood). The question is hinting that the engagement with the digital device keeps us from interaction in the “real” world. I think this separation is disappearing fast – making a phone call, listening to MP3, chatting with friends on facebook is for many of us real, we live in a world that is augmented by technology and the boundaries are bluring...

[1] Morris ME, Kathawala Q, Leen TK, Gorenstein EE, Guilak F, Labhard M, Deleeuw W. Mobile Therapy: Case Study Evaluations of a Cell Phone Application for Emotional Self-Awareness. Journal of Medical Internet Research 2010;12(2):e10. URL: http://www.jmir.org/2010/2/e10/

[2] Margaret E. Morris. 2005. Social Networks as Health Feedback Displays. IEEE Internet Computing 9, 5 (September 2005), 29-37. DOI=10.1109/MIC.2005.109 http://dx.doi.org/10.1109/MIC.2005.109

Lukowicz Consumer Confidence Index

Paul Lukowicz taked in the symposium on Interaction with Smart Artifacts in Tokyo about "Large scale, context aware socio-technical systems". As a number of other talks in our symposium he also pointed out that value of the massive amounts of data that become available by mobile sensing and crowd interaction.

Paul gave one example how such sensing data could be used. I think this is really interesting that is why I share here the Paul "Lukowicz Consumer Confidence Index" (CCIL) which is based on detecting the whereabouts of people. It assumes that we can estimate the number of people shopping at various places based on the use of their mobile devices.

Keynote by Josh Ulm at Mobile HCI 2010

Josh Ulm discussed how branding (and marketing in more general) has evolved and how this is now central to user experience and user interface design. He started out with showing how Nike changed marketing with the "Just Do It" campaign. He suggested that this was a transition from a product focus to a personal usage focus asking "who you become if you use the product".

Moving towards more resent trends he argued that the iPod made the interaction with the product the essential part of the branding. With examples such as eBay and Google he showed that interaction in combination with information presentation becomes that discriminating factor and the way these brands define themselves. Overall this suggests that the user interaction and user experience is the central part for making a brand to stand out.

Standing out is not sufficient however. The experience has to be ownable. Using zappos as an example he showed how such an experience needs to be consistent across all touch points with the user - especially if you are defining your brand by experience - in short a brand has to have a unique user experience that is associated with the brand only. To achieve this there are three ingredients:

• Values - "values have to extent into every single touchpoint of the experience"
• Differentiation "you need to stand out in the market place" - many companies do not innovate enough, you have to take risks to stand out because you have to stand out a lot to be different - most companies do only innovate a little
• Integrity - internal consistency - the brand is about what customers really touch - what reaches the customers - can a customer recognize that this is your experience, detail matter

To be successful an experience needs to be ownable and good. You need both - one is not enough. As a concluding example he showed Vodafone 360 - (which very few people in the audience knew). My short assessment is that the brand failed on "Differentiation" - to me (and obviously I would expect Josh Ulm is not agreeing) it is too similar to other things in this space…

As a further example of a strong Differentiation he showed Jeff Fong's Metro UI for the new Windows mobile phone platform. If you have not seen the design check this out. It is very different from current Android and iPhone UIs. Everyone is really curious how it will do in the market…

Opening Keynote of Mobile HCI by Patrick Baudisch

Patrick Baudisch presented the opening Keynote. He gave an interesting overview of work on interaction with small screen devices. It is very apparent that currently the form factor of devices is nearly exclusively determined by the I/O components. Throughout the examples it became very explicit, that the usefulness of a device for certain tasks it determined by the options for interaction. E.g. by increasing the input precision or by reducing the fat finger problem new tasks (and eventually new applications) will become possible on mobile devices. Patrick showed an example where he asks his students, to design a UI for a device as small as a one Euro coin (e.g. digital jewelry) - I think I borrow this idea for our next course :-)

How showed many examples of his work - too many to write it in a blog entry - but well documented on his web page. It is a page worthwhile to check regularly as his group is outstandingly creative and productive.

Patrick made an insightful analogy between small screens and theater stage, arguing that the both have a similar problem: the lack space to show everything you would like to show due to a constraint space. The solutions in the theater can give a good inspiration for designing mobile UIs. He mentioned three typical solutions used in the theater:

• Partially out of the frame - you show something only to a small part and the user's imagination will fill in for the rest. In the theater an example is a ocean liner where you only see a very small part but people imagine the rest. The halo visualization technique [1] is one example for this approach on a mobile device.
• In and out points - people enter and leave the stage at given points providing an illusion of a comprehensible world around the stage (and in the UI case around the screen)
• Direction of interaction to invisible targets - by talking/pointing/looking into a certain direction actors can create an impression of interacting with someone at a certain location - who is not really there and who's position is off the stage.

Technically I found the video he showed on using a depth cam extremely exciting. He speculated that this may solve many problems we have currently with using computer vision in difficult light conditions. In his example he showed the image recorded by a depth cam (based on time of flight) "filming" into direct sunlight - and as one would expect the sun does not matter. Looking forward to seeing some more results on this…

Looking at the current re-appearance of watch based computers and phones the idea of back side interaction becomes more and more interesting. In one design he showed how one can interact with a watch size device by interacting on buckle of the watch band. For more on back of device interaction see [2].

[1] Baudisch, P. and Rosenholtz, R. 2003. Halo: a technique for visualizing off-screen objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA, April 05 - 10, 2003). CHI '03. ACM, New York, NY, 481-488. DOI= http://doi.acm.org/10.1145/642611.642695

[2] Baudisch, P. and Chu, G. 2009. Back-of-device interaction allows creating very small touch devices. In Proceedings of the 27th international Conference on Human Factors in Computing Systems (Boston, MA, USA, April 04 - 09, 2009). CHI '09. ACM, New York, NY, 1923-1932. DOI= http://doi.acm.org/10.1145/1518701.1518995

SiMPE 2010, Keynote: Trends and Challenges in Mobile Interaction

I was invited to give a keynote talk at the 5th Workshop on Speech in Mobile and Pervasive Environments that was held as a part of ACM MobileHCI 2010 in Lisbon, Portugal. Over the last years we looked at speech as an additional modality in the automotive user interface domain; besides this my experience with speech interfaces is limited.

My talk, with the title "Trends and Challenges in Mobile Interaction" looked at different issues in mobile interaction. In some parts I reflected on modalities and opportunities for speech interaction.

When characterizing mobile interaction I pointed out the following points:

• Interacting while on the move
• Interaction is one of the user's tasks (besides others - e.g. walking, standing in a crowd)
• Environment in which the interaction takes place changes (e.g. on the train with varying light and noise conditions)
• Interruptions happen frequently (e.g. boarding the bus, crossing the road)
• Application usage is short (typically seconds to minutes)

My small set of key issues and recommendations for mobile UIs is:

• Simple and Understandable
• Perceptive and Context-Aware
• Unobtrusive, Embedded and Integrated
• Low Cognitive Load and Peripheral Usage
• Users want to be in Control (especially on the move)

The presentations and discussion at the workshop were very interesting and I got a number of ideas for multimodal user interfaces - including speech.

One issue that made me think more was the question about natural language speech vs. specific speech commands. A colleague pointed me to Speech Graffiti [1] / Universal Speech Interface at CMU. I wonder if it would make sense to invent a Human Computer Interaction language (with a simple grammar and a vocabulary) that we could teach in a course over several weeks (e.g. similar effort than touch typing on a QUERTY keyboard) or as a foreign language at school to have a new effective means for interaction. Could this make us more effictive in interacting with information? Or should we try harder to get natural languge interaction working? Looking at the way (experienced) people use Google we can see that people adapt very successfully - probably faster than systems improve…

From some of the talks it seems that "Push to talk" seems to be a real issue for users and a reason for many user related errors in speech systems. Users do not push at the appropriate time, especially when there are other tasks to do, and hence utterances are cut off at the start and end. I would guess continuous recording of the speech and using the "push to talk" only as an indicator where to search in the audio stream may be a solution.

[1] Tomko, S. and Rosenfeld, R. 2004. Speech graffiti vs. natural language: assessing the user experience. In Proceedings of HLT-NAACL 2004: Short Papers (Boston, Massachusetts, May 02 - 07, 2004). Human Language Technology Conference. Association for Computational Linguistics, Morristown, NJ, 73-76. http://www.cs.cmu.edu/~usi/papers/HLT04.pdf

Chinese German Symposium on Wearable Computing in Chengdu

The Sino-German Symposium on Wearable Computing in Chengdu provided an interesting opportunity to get together with colleagues in China that work on similar topics.
My talk was entitled "Interaction on the Move - Wearable User Interfaces" and look at a very high level perspective at mobile and wearable interaction. As the main objective of the symposium is to initiate collaboration I also included some slides on the other work we are doing.

Bernt Schiele looked back on his early work in 1998 at MIT with Sandy Pentland and reflected on how wearable computing has evolved. It seems than many of the scenarios that were originally envisioned are now realized on smart phones and it seems that an active usage model - people taking the device explicitly instead of having something that is always on and in their face. However looking back on some of the early visions (continuous capture, contextual support) they are still attractive and the technology may be there to realize them for real. One example of a system that could now be easily realized and may have a growing market could be a device similar to the StartleCam [1], providing personal safety services.

Feng Tian, one of the top HCI researchers in China gave an overview of their current work which I found very exciting (especially the projects related to sports and education). Hopefully there is a chance for future collaboration.

There is more information on the symposium and on the Sino-German collaboration at Wearcom.org.

[1] Healey, J. and Picard, R. W. 1998. StartleCam: A Cybernetic Wearable Camera. In Proceedings of the 2nd IEEE international Symposium on Wearable Computers (October 19 - 20, 1998). ISWC. IEEE Computer Society, Washington, DC, 42.

In the talks and conversation I saw a set of technologies I like to remember (and share) some of them:

• Motion sensing suit from XSens
• Personal Display Carl Zeiss Cinemizer 3D Plus
• MotionNode - a 3-DOF inertial measurement unit (IMU)

Handheld Laser Projector

Enrico got for his project a handheld laser projector. The nice thing about this technology is that the projected image is always in focus - it does not matter if you move the projector or if you project on an uneven surface. The AAXA L1 Laser Pico Projector (even though there are plenty of things that can be improved, noise for a start) provides some inspiration what will become possible if these devices will be common in mobile phones. In Lancaster Enrico explored already 2007/2008 some of the usage scenarios and interaction techniques [1] and I am really curious of further ones. There was a workshop at Pervasive 2010 looking at current research on personal projectors [2].

With this piece of technology we can also move on the idea of a device where interactive shell and functional core of a product is separated. We have published the concept as work in progress at CHI [3] and perhaps it is now time to look into a realistic implementation using such a laser projector.

[1] Hang, A., Rukzio, E., and Greaves, A. 2008. Projector phone: a study of using mobile phones with integrated projector for interaction with maps. In Proceedings of the 10th international Conference on Human Computer interaction with Mobile Devices and Services (Amsterdam, The Netherlands, September 02 - 05, 2008). MobileHCI '08. ACM, New York, NY, 207-216. DOI= http://doi.acm.org/10.1145/1409240.1409263

[2] UBIPROJECTION 2010 http://eis.comp.lancs.ac.uk/workshops/ubiproject2010/

[3] Doering, T., Pfleging, B., Kray, C., and Schmidt, A. 2010. Design by physical composition for complex tangible user interfaces. In Proceedings of the 28th of the international Conference Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 - 15, 2010). CHI EA '10. ACM, New York, NY, 3541-3546. DOI= http://doi.acm.org/10.1145/1753846.1754015

Teaching Ubicomp? What is it we should teach?

Why should we teach Ubicomp? What are the core issues when teaching Ubicomp? How do we cope with the rapid changes in technologies if we provide practical exercises in our Pervasive Computing classes? What skills will students take away from the course?

As Ubicomp is still a young and dynamic subject it is inevitable that we have to ask these questions. To share our experiences in teaching we met at the ETH Zürich. Friedemann Mattern, Marc Langheinrich, Michael Rohs, Kay Römer, and many of our PhD students (and me ;-) spent two days in Zürich to collect materials and discuss the above questions. The hardest one is obviously the what is ubicomp question…

For me the key thing is that we teach about distributed computing systems that are aware and linked to the real world and which are used by humans. The systems aspect is key and I think which specific technologies, tools, methods, we teach are exchangeable. The second point I want to make in my pervasive computing class is to get students excited and aware of the potential of computing in the future and how we are at the heart of a major change that goes beyond technology.

We are currently compiling a Wiki with teaching materials which we hope will become public in the future (at least in parts). If you teach a ubicomp related course or if you know of course please feel free to add a comment with link to the webpage and we will try to include it in the collection.

PS: examples of the UI challenge of ubicomp are everywhere.

Feature or Bug - how do you end an annoying call?

My first mobile phone in 1998 had a detachable antenna (you could just screw the antenna off). This design feature enabled a socially acceptable mechanism to end annoying conversations by losing the connection. When talking became boring you told the communication partner that it seems that the connection gets worse (while you unscrewed the antenna) and then when you detached the antenna the call was usually dropped.

Reading about the iPhone I thought about this long forgotten feature and expected that Apple listened to its users and that there is a next version of this feature - nowadays implemented as touch interaction (not screwing required) on the iPhone 4. The photo shows a phone where the feature is disabled by some rubber cover.

I was really disappointed that Apple tells us it is a bug…

Mobile phones as educational technologies; Vivien visiting our lab

Vivien visited us in the lab and tried out a number of ideas for the project "mobile phones as a learning platform". She really enjoyed to test and comment new applications and devices and she felt for one day like a real researcher and at the same time really contribute insights from a end-user perspective - it is never too early to spark the fascination of research ;-)

Elba is currently putting together applications for a field study later this year. We plan to study of the use of mobile phones for teaching and revision in Panama with a large deployment supported by Nokia Research Center.

We think that mobile phones - especially as they are widely deployed around the world - offer a good alternative to laptop computers [1]. Our expectations are that the mobile phones provide similar benefits as a laptop in education without the drawbacks seen at the OLPC project. Especially the multimedia capabilities of phones and use while on the way are very tempting.

[1] Valderrama Bahamóndez, E. d. and Schmidt, A. 2010. A survey to assess the potential of mobile phones as a learning platform for panama. In Proceedings of the 28th of the international Conference Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 - 15, 2010). CHI EA '10. ACM, New York, NY, 3667-3672. DOI= http://doi.acm.org/10.1145/1753846.1754036

PS: if you are in Essen you have to see the Zeche Zollverein (a world cultural heritage; the most beautiful coal mine in the world)

PhD Defense of Ulrich Steinhoff

I had the pleasure to be external examiner for the PhD thesis of Ulrich Steinhoff at the Technical University of Darmstadt. Ulrich did his PhD with Bernt Schiele and looked at different location techniques. From my perspective his work on dead reckoning for mobile devices that are NOT fixed to a specific position on the body [1].

There are always suprises at PhD defenses ;-) and the positive one at this one was a cake in the shape of a doctoral hat.

[1] U. Steinhoff and B. Schiele. Dead Reckoning from the Pocket - An Experimental Study. Eighth Annual IEEE International Conference on Pervasive Computing and Communications (PerCom 2010). http://dx.doi.org/10.1109/PERCOM.2010.5466978

Keynote at UBI Summit: Ubicomp - Are we there yet? And where is the business?

I was invited to give a keynote at the 2010 UBI Summit in Helsinki. I looked into the recent developments of Ubicomp and in particular when things that have been around in research are surfacing on the markets. Looking back at HUC99 and HUC2k (the first two Ubicomp conferences) things like pocket bargain finder [1], context call [2,3], or sensors in phones [4] have by now become common - however it is not clear how research relates to products. There are very few cases where early Ubicomp research has been exploited in products by the people who did the research…

It was fun to think a little more about the business prespective of Ubicomp. If you are curious about the talk, have a look at my slides on "Ubicomp - Are we there yet? And where is the business?". The title of the talk relates to a recent paper I wrote for IEEE Computer [5].

The investment made in Finland in Ubicomp technology research is impressive and looking at the presentations at UBI Summit it seems it is worthwhile. One example is a really simple technology - but with great potential: www.happy-or-not.com. Their motivation is based on a statement apparently made by Jack Welch (former CEO of GE):

"Too often we measure everything and understand nothing. The three most important things you need to measure in a business are customer satisfaction, employee satisfaction, and cash flow. If you’re growing customer satisfaction, your global market share is sure to grow, too. Employee satisfaction gets you productivity, quality, pride, and creativity. And cash flow is the pulse—the key vital sign of a company."(source)

It says that to assess the success of a company you have to look at customer satisfaction, employee satisfaction, and cash flow. Their product focuses on the first two. Technically it is simple as setting up some buttons is trivial - but creating a complete system to fit companies and their requirements is not straightforward. It is not hard to see the value...

[1] Adam B. Brody and Edward J. Gottsman. Pocket BargainFinder: A Handheld Device for Augmented Commerce. First International Symposium on Handheld and Ubiquitous Computing (HUC '99), 27-29 September 1999, Karlsruhe, Germany

[2] A. Schmidt, A. Takaluoma and J. Mäntyjärvi, Context-Aware Telephony over WAP, Personal Technologies 4(4), December 2000. pp. 225-229.

[3] A. Schmidt, T. Stuhr, H.-W. Gellersen. Context-Phonebook - Extending Mobile Phone Applications with Context. Third Mobile HCI Workshop, Lille, Sept. 2001

[4] Schmidt, A., et al. 1999. Advanced Interaction in Context. In Proceedings of the 1st int. Symposium on Handheld and Ubiquitous Computing (September, 1999). LNCS, vol. 1707. Springer, 89-101

[5] Schmidt, A. 2010. Ubiquitous Computing: Are We There Yet? Computer 43, 2 (Feb. 2010), 95-97. DOI= http://dx.doi.org/10.1109/MC.2010.54

Felix von Reischach - PhD defence

Over the last years Felix looked at how mobile phones can enhance the shopping experience in the real world. In particular Felix compared different identification techniques (e.g. text input, bar code, nfc) [1] and at mapping the design space for product recommendation systems on mobile devices [2]. We had an interesting discussion at the PhD defense and I think we will see many products and services popping up in the future.

Being in Zürich I took the opportunity to see more of Florian's group. There are a lot of exciting projects going on, see their Wiki for details. I looked especially at the work on mobile platforms and public displays. The AppAware application (http://appaware.org/) on Android has an amazing potential. Users share events (what applications they are installing, removing and updating) together with their location. It is just amazing to see what people around you install - and being close to ETH you see events every second.

[1] Reischach, F., Michahelles, F., Guinard, D., Adelmann, R., Fleisch, E., and Schmidt, A. 2009. An Evaluation of Product Identification Techniques for Mobile Phones. In Proceedings of INTERACT 2009, the 12th IFIP TC 13 international Conference on Human-Computer interaction: Part I (Uppsala, Sweden, August 24 - 28, 2009). LNCS, vol. 5726. Springer-Verlag, Berlin, Heidelberg, 804-816. DOI= http://dx.doi.org/10.1007/978-3-642-03655-2_88

[2] von Reischach, F., Michahelles, F., and Schmidt, A. 2009. The design space of ubiquitous product recommendation systems. In Proceedings of the 8th international Conference on Mobile and Ubiquitous Multimedia (Cambridge, United Kingdom, November 22 - 25, 2009). MUM '09. ACM, New York, NY, 1-10. DOI= http://doi.acm.org/10.1145/1658550.1658552

Our Paper and Note at CHI 2010

Over the last year we looked more closely into the potential of eye-gaze for implicit interaction. Gazemarks is an approach where the users' gaze is continuously monitored and when leaving a screen or display the last active gaze area is determined and store [1]. When the user looks back at this display this region is highlighted. By this the time for attention switching between displays was in our study reduced from about 2000ms to about 700ms. See the slides or paper for details. This could make the difference that we enable people to safely read in the car… but before this more studies are needed :-)

Together with Nokia Research Center in Finland we looked at how we can convey the basic message of an incoming SMS already with the notification tone [2]. Try the Emodetector application for yourself or see the previous post.

[1] Kern, D., Marshall, P., and Schmidt, A. 2010. Gazemarks: gaze-based visual placeholders to ease attention switching. In Proceedings of the 28th international Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 - 15, 2010). CHI '10. ACM, New York, NY, 2093-2102. DOI= http://doi.acm.org/10.1145/1753326.1753646

[2] Sahami Shirazi, A., Sarjanoja, A., Alt, F., Schmidt, A., and Hkkilä, J. 2010. Understanding the impact of abstracted audio preview of SMS. In Proceedings of the 28th international Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 - 15, 2010). CHI '10. ACM, New York, NY, 1735-1738. DOI= http://doi.acm.org/10.1145/1753326.1753585

PS: the social event was at the aquarium in Atlanta - amazing creatures! Again supprised how well the N95 camera works even under difficult light conditions...

EmoDetector App is online - Hear The Feeling of SMS

EmoDetector, by University of Duisburg-Essen and Nokia Research Center, is an application that provides auditory cues in addition to the notification tone upon receiving an SMS based on a real-time analysis of a message's contents, see [1].The application responds currently to the following characters sets:

• :) or :-)
• :( or :-(
• ;) or ;-)
• ok (case insensitive)
• ?

There is a version for Nokia Series 60 phones and for Android, see the download site. Have a look at the http://www.emodetector.tom-lab.de/ website for more information.

[1] Sahami Shirazi, A., Sarjanoja, A., Alt, F., Schmidt, A.,Häkkilä, J.: Understanding the Impact of Abstracted Audio Preview of SMS. In Proceeding of CHI 2010, April 10-15, Atlanta, GA, USA

MUM 2009 in Cambridge, no technical solution for privacy

The 8th International Conference on Mobile and Ubiquitous Multimedia (MUM 2009) was held in Cambridge, UK. The conference is fairly specific and had an acceptance rate of about 33% - have a look at the table of content for an overview. Florian Michahelles presented our paper on a design space for ubiquitous product recommendation systems [1]. Our work contributes a comprehensive design space that outlines design options for product recommendation systems using mobile and ubiquitous technologies. We think that over the next years mobile recommendation systems have the potential to change the way we shop in the real world. It probably will be normal to have access in-depth information an price comparison while browsing in physical stores. The idea has been around for a while, e.g. the pocket bargain finder presented at the first ubicomp conference [2]. In Germany we see also a reaction of some electronics stores that asked users NOT to use a phone or camera in the shop.

The keynote on Tuesday morning was by Martin Rieser on the Art of Mobility. He blogs on this topic on http://mobileaudience.blogspot.com/.
The examples he presented in his keynote concentrated on locative and pervasive media. He characterized locative media as media that by social interaction that is linked to a specific place. He raised the awareness that mapping is very important for our perception of the world, using several different subjective maps - I particular liked the map encoding travel times to London . A further interesting examples was a project by Christian Nold: Bio mapping - emotional mapping of journeys. QR or other bar code markers on cloth (large and on the outside) have a potential ... I see this now.

In the afternoon was panel on "Security and Privacy: Is it only a matter of time before a massive loss of personal data or identity theft happens on a smart mobile platform?" with David Cleevely, Tim Kindberg, and Derek McAuley. I found the discussion very inspiring but in the end I doubt more and more that technical solutions will solve the problem. I think it is essential to consider the technological, social and legal framework in which we live. If I would need to live in a house that provides absolute safety (without a social and legal framework) it would be probably not a very nice place… hence I think here we need really interdisciplinary research in this domain.

[1] von Reischach, F., Michahelles, F., and Schmidt, A. 2009. The design space of ubiquitous product recommendation systems. In Proceedings of the 8th international Conference on Mobile and Ubiquitous Multimedia (Cambridge, United Kingdom, November 22 - 25, 2009). MUM '09. ACM, New York, NY, 1-10. DOI= http://doi.acm.org/10.1145/1658550.1658552

[2] Brody, A. B. and Gottsman, E. J. 1999. Pocket Bargain Finder: A Handheld Device for Augmented Commerce. InProceedings of the 1st international Symposium on Handheld and Ubiquitous Computing (Karlsruhe, Germany, September 27 - 29, 1999). H. Gellersen, Ed. Lecture Notes In Computer Science, vol. 1707. Springer-Verlag, London, 44-51.
http://www.springerlink.com/content/jxtd2ybejypr2kfr/

Workshop at MobileHCI: Context-Aware Mobile Media and Mobile Social Networks

Together with colleagues from Nokia, VTT, and CMU we organized a workshop on Context-Aware Mobile Media and Mobile Social Networks at MobileHCI 2009.

The topic came up in discussions some time last year. It is very clear that social network have moved towards mobile scenarios and that utilizing context and contextual media adds a new dimension. The workshop program is very diverse and ranges studying usage practices to novel technological solutions for contextual media and application.

One topic that is interesting to further look at is to use (digital) social networks for health care. Taking an analogy in history it is evident that the direct social group you were in took were the set of people that helped you in case of illness or accident. Looking at conditions and illnesses that cause a loss of mobility or memory it could be interesting to find applications on top of digital social networks to provide help. Seems this could be a project topic.

In one discussion we explored what would happen if we would change our default communication behavior from closed/secret (e.g. Email and SMS) to public (e.g. bulletin boards). I took the example of organizing this workshop: our communication has been largely on email and has not been public. If it would had been open (e.g. public forum) we probably would have organized the workshop in the same way but at the same time provided an example how one can organize a workshop and by this perhaps provided useful information for future workshop chairs. In this case there are little privacy concerns but images all communication is public? We would learn a lot about how the world works…

About 10 years ago we published at paper there is more to context than location [1]. However, looking at our workshop it seems: location is still the dominant context people think of. Many of the presentations and discussions included the term context, but the examples focused on location. Perhaps we do need location only? Or perhaps we should look more closely to find the benefit of other contexts?

[1] A. Schmidt, M. Beigl, H.W. Gellersen (1999) There is more to context than location, Computers & Graphics, vol. 23, no. 6, pp. 893-901.

Tutorials at Mobile HCI 2009 in Bonn

This year Enrico Rukzio organized the tutorials at mobile HCI 2009. He got an exciting program together:

• Matt Jones: Mobile Search
• Luca Chittaro: Information Visualization and Visual Interfaces for Mobile Devices
• Chris Kray: Mobile Guides
• Marc Langheinrich: Mobile Privacy
• Enrico Rukzio: Mobile Interaction with the Real World
• Paul Holleis: Modelling and Developing Mobile Applications

The mobile HCI 2008 tutorials slides are still online - have a look.