Monday, 10 December 2007

Prototypes of unconventional user interfaces

In Linz the students of the course unconventional user interfaces showed their first set of functional prototypes. The topics are related to interactive mirrors, context-aware advertisement posters, healthy rear-seat entertainment, and text input while driving. The assignment was to create a system that allows creating an authentic user experience for the concept. The technical solutions were very different and ranged from a dismantled keyboard to a system using a micro-controller, from a two-way mirror with display behind to direction detection in front of an advert. Even though the prototypes were fairly simple most of them showed impressively how much of an idea a functional prototype can transport.

Sunday, 9 December 2007

Just in time train schedule?

Thought experiment: if we have the same number of trains we have at the moment and we let them travel as we do at the moment – but without time tables (basically a train is always on time – it is there when it arrives – similar to today). Customers would have real time access to all trains and the system could provide estimates when a certain train is where – perhaps with a confidence interval and probabilities of connections and travel times (obviously with an understandable user interface).

Would this be a better or worse model of public transport?

… and by the way the coach I was in has the IP address 192.168.97.181 and runs DOS ;-)

Thursday, 6 December 2007

Talk at the expert meeting on RFID and ubicomp

In Frankfurt there was today an expert meeting on RFID and ubicomp organized by the Fraunhofer ISI. The purpose was a discussion about the impact of RFID technologies. The organizers will use our input to inform the creation of a document of technology assessment for the German parliament. The majority of the participants came from companies developing RFID technology or system.
In the first part of my talk “RFID and Beyond” I highlighted results from two workshops where I was a co-organizer: PTA2006 and Pertec2007 held at the Pervasive and Percom conferences. The results were also published in 2 papers in the IEEE Pervasive Computing magazine, see [1] and [2]. After this I showed some future visions and scenarios, namely the Smart-Its & MediaCup (foto from Birgit at Teco) [3], the SensorKnife [4], and the aware goods project [5]. Michael Müller extended the idea of the first aware goods project with a mobile phone based prototype - which we still have not written up for publication.

For me the technology assessment in Germany seems still often very much centred on threats and looks much less at opportunities. Looking at developments in Asia and in particular in Korea (e.g. U-City) I hope politics in Germany will in the future more often see the positive sides, too. Technology assessment can become a means to find opportunities and ideas to support innovation. For me it seems that a lot of the risks people attribute to RFID are not based on scientific results – is appears rather media induced… Positive cases such as wireless key systems and transport tickets (basically RFID technology) are in widespread use without much problems and great value for users - but not present in the public discussion.

One interesting estimated was that about 200 parts of the several thousands (e.g. safety related parts, large parts, parts that are often stolen, expensive parts) per car will tagged with RFID in the next 10 years to ease logistics, production and maintenance.

[1] Schmidt, A.; Spiekermann, S.; Gershman, A.; Michahelles, F., "Real-World Challenges of Pervasive Computing", Pervasive Computing, IEEE , vol.5, no.3pp. 91- 93, c3, July-Sept. 2006.

[2] Michahelles, F.; Thiesse, F.; Schmidt, A.; Williams, J. R.: Pervasive RFID and Near Field Communication Technology. In: IEEE Pervasive Computing, vol. 6, no. 3, pp. 94-96, c3, Jul., 2007.

[3] Hans-Werner Gellersen, Albrecht Schmidt, Michael Beigl: Multi-Sensor Context-Awareness in Mobile Devices and Smart Artifacts. MONET 7(5): 341-351 (2002)

[4] Matthias Kranz, Albrecht Schmidt, Alexis Maldonado, Radu Bogdan Rusu, Michael Beetz, Benedikt Hörnler, Gerhard Rigoll: Context-aware kitchen utilities. Tangible and Embedded Interaction 2007: 213-214

[5] Anke Thede, Albrecht Schmidt, Christian Merz: Integration of Goods Delivery Supervision into E-commerce Supply Chain. WELCOM 2001: 206-218

Multi-touch displays seen as great opportunity

In our course “case studies in pervasive computing” we re-build systems that are described in the research literature and try to improve them or to apply them to new domains. This term the topic is on multi-touch displays. Starting out with Jeff Han’s paper “Low-cost multi-touch sensing through frustrated total internal reflection” we think about novel interaction methods for large screens. And after some initial problems (filter in the web cam we used) we have a first hardware prototype that shows the FTIR effect. The page of Thomas M. Brand is a good starting point if you too think of a DIY-project.

On Monday Giulio Jacucci from the Helsinki Institute for Information Technology told me that they set up a start-up that has an new interesting and different way of doing multi-touch displays – and they look into enormous sizes of displays, up to 16 meters long. Their web page is http://www.multitouch.fi/. Perhaps we should try to get some of there technology for next term – would save us some serious drilling, soldering and polishing…

Tuesday, 4 December 2007

Interactive Mirrors – an upcoming topic beyond the idea?

At the CHI PC-meeting in Amsterdam I talked to a number of people – and it seems we are not the only one’s who are interested in interactive mirrors. It seems that breaking the physical limitations in time and space, a convention mirror imposes, creates some interest within the research community.

I talked to Boris de Ruyter about the Philips mirror project in the homelab and learned from Bo Begole about their work on interactive mirrors at PARC. It may be interesting to propose a workshop on interactive mirrors at one of the upcoming conference to get the people together looking into this topic.
In the hotel in Schiphol there was a mirror display for adverts. It did not really link any functionality of the mirror with the display, but nevertheless it was a aesthetically pleasing installation

Sunday, 2 December 2007

Reset/reboot is ubiquitous – or my worst train ride so far

What have learned to do when our computer or phone does not work anymore? Easy just reboot it. A colleague recently told me his rental car broke down (basically did not work anymore) but after resetting it, it worked fine again. When he told me I found this pretty strange – ok the radio or opening the car boot – but essential functions related to driving?

Today I was travelling on an ICE high-speed train to Amsterdam for the CHI-Notes committee meeting and shortly after we left Germany the train lost speed and became slower and just rolled out. Then can an interesting announcement: “Sorry it seems we do not get power anymore – but we think it is not a big problem. We reset the train and then we are on our way again”. The reboot did not work :-( so they told us we needed to another engine. Perhaps there was more to reboot (e.g. the train power grid nation wide?)…

Extrapolating in the future I can imagine a lot of things we will need to reboot, e.g. your shoes, your furniture, your house, your augmented sense, and your implants – or should we take more care in developing things?

At some point they decided we can not wait on the train and we had to get off the train outside the station (using small ladder) while it was pouring with rain. The left us than waiting for 2 hours (in the rain) – basically till we found ourselves another means of transport (overall delay about 5 hours). This made me realize that a Nokia N95 with GPS is probably really good while travelling – if I would have had it with me I could have called a taxi to where I was ;-)

More about train rides… Some more traditional technologies however work very well – this week I was already once stuck on a train were a passenger pulled the emergency train and went of the train – somewhere in the middle of nowhere…

Thursday, 29 November 2007

Keynote speaker at TEI’08: Prof. Hiroshi Ishii

Prof. Hiroshi Ishii from the MIT Media Laboratory, kindly accepted our invitation to be the keynote speaker of TEI’08 in Bonn. We are absolutely delighted that he will come to the conference. Looking back at last year's proceedings of TEI, and seeing the references in the papers, it is obvious how much he has inspired and shaped this research field.

I recently learned that Prof. Ishii has lived and worked in Bonn in 1987-1988 at GMD (which became later Fraunhofer. He was then a Post-Doc and worked topics related to CSCW.

There are so many paper of tangibles media group one really has to read. If you have today little time watch this one: topodo.

Talk at the opening of the Fraunhofer IAO interaction lab

The Fraunhofer institute IAO opened today a new interaction lab in Stuttgart under the topic interaction with all senses. Prof. Spath, director of the Fraunhofer IAO, made a strong argument for new user interfaces. In his talk he discussed adaptive cruse control in cars as an example for user interface challenges.

My talk on “implicit interaction – smart living in smart environments” argues for a sensible mix of user centred design and technology driven innovation. As one example I used the Sensor-Knife which Matthias Kranz implemented.

Prof. Jürgen Ziegler, a colleague at the University of Duisburg-Essen who was previously at IAO, showed in his talk a short video of a “galvanic vestibular stimulation” GVS explored by NTT (SIGGRAPH 2005 Demo) to highlight trends and indicate at the same time ethical problems that can arise when we interfere with human senses.

Tuesday, 27 November 2007

TEI’08 – in cooperation with ACM, inclusion in the digital library

TEI’08 will be held in cooperation with ACM and the proceedings will, as last year, included in the ACM digital library.
After finalizing the review and discussion process we have a really amazing program, which will be soon online at http://www.tei-conf.org/.

Visit at the University of Hamburg

Yesterday we visited the computer science department at the University of Hamburg. Prof. Oberquelle und Beckhaus had invited me at the Mensch & Computer conference to visit them and give a talk about our work.

Before the seminar we had a chance to see the lab of Steffi Beckhaus. I have tried the ChairIO – and it was fun. They sound floor creates a really interesting experience (similar to the butt-kicker just more intense). We could also play with GranulatSynthese and try the smell user interface (apple smell is absolutely convincing, not sure about some of the others).

We had some discussion on emotions and capturing physiological parameters. Thinking about emotions and senses with regard to a community sharing them opens up a lot of potential for new experiences and potentially applications. We discussed this topic to some extent some weeks ago at the Human Computer Confluence Workshop in Brussels. I really thing a small scale experience in share emotions could move us forward and provide some more insight. In Hamburg they have the NeXus-system (perhaps we should get this too and create a networked application).

In my talk (creating novel user interfaces) I focused on the PhD work of Paul Holleis (KLM for mobile phones, his CHI Paper from last year) and of Heiko Drewes (Eye-Gestures, his Interact’07 paper). The discussion was quite interesting.

Friday, 26 October 2007

Interesting MSc Dissertations at Trinity in Dublin

I have been at Trinity College in Dublin today as external member of the MSc exam board. While reading MSc dissertations I learned at lot of interesting things. Here are two pointers to technologies which I like to share (they may be useful in further projects):

SUMO - Simulation of Urban Mobility: An open source traffic simulation package
http://sumo.sourceforge.net/

Small computing platform: http://gumstix.com/

Thursday, 25 October 2007

Slowly settling in

Time is flying. We are nearly one month in Essen. Teaching started well and quite a number of students came to our course (see http://www.pervasive.wiwi.uni-due.de/en/teaching/). We have a reliable Internet connection and more furniture than we need ;-) Starting from scratch is a great experience – especially as everybody was very helpful.
Nevertheless it takes a lot of time and effort. I am extremly happy that I was able to start with a real team (Dagmar and Paul)!

Tuesday, 16 October 2007

In Search of Excellence

At the Fraunhofer retreat in Westerburg we had very interesting discussions on research and research strategies in computer science. The span of excellent research in computer science is enormous ranging from theoretical work (e.g. math style proofs), to engineering type work (e.g. systems), to experimental and empirical work (e.g. studies). This makes it really challenging to find a common notion of “excellent research”. This reminds me of an interesting book which I started to read (recommended to me at the retreat): In Search of Excellence: Lessons from Americas Best Run Companies by Robert H Waterman et al. – so far it is really interesting to read. However everything in management seems really straightforward on paper – but in my experience in the real world it always comes down to people.

Monday, 8 October 2007

Guest course at the University of Linz, MSc Pervasive Computing

I am teaching a guest course at the University of Linz in the Pervasive Computing master program. The topic is Unconventional User Interaction – User Interfaces in a Pervasive Computing World (http://www.ubicomp.net/uui). Today we started with an introduction to motivate how pervasive computing changes human computer interaction. I am already looking forward to the projects!

At dinner I learned why you can never have enough forks in a good restaurant. In case you loose your pen for the mobile phone a fork will do… The topic of the lecture is everywhere!

Information inside the cap

Travelling on the train from Crailsheim to Nürnberg I saw several police officers on their travels back from an assignment at Stuttgarter Volksfest. When we got off the train the collected their caps from the luggage rack and observed an interesting (traditional) information display.

Inside the cap they carried a schedule and a description of the location they had to go. The size of the paper-display was about 15 x 15 cm. It seems an interesting place to display and access information – perhaps we will do a digital version of the cap as an assignment in our courses.

Wednesday, 3 October 2007

Starting from scratch – or how to bootstrap

We arrived in Essen and slowly are booting up the new group. It is exciting to have the change to start from scratch! Chairs and internet connectivity are highest priorities ;-)

At the moment our virtual presence (http://www.pervasive.wiwi.uni-due.de/en/) is much further than our physical – one has to have priorities.

Saturday, 29 September 2007

Moving to the University of Duisburg-Essen


From Monday on I will be at the University of Duisburg-Essen. After a little less than a year in Bonn a new challenge is ahead: setting up a new group on Pervasive Computing and User Interface Engineering.

The lab will be situated at the campus in Essen (Schützenbahn 70) in the heart of the city. Our group will be in the Institute for Computer Science and Business Information Systems in the faculty of Economics. Teaching starts in the winter term with a lecture on User Interface Engineering and several project oriented courses.

The focus will be on systems, user interfaces and novel applications in the domain of pervasive and ubiquitous computing.

Thursday, 27 September 2007

UbiLog Workshop in Bremen

This afternoon our UbiLog workshop was held in Bremen as part of the Informatik 2007 conference. We selected 4 papers for presentation and had a lively and interesting discussion.

Following the talk of Nikolai Krambrock we discussed the use context, and in particular location, to restrict or allow access to information. My favourite example is an online-banking appliance that only works in predefined areas (e.g. at home and in my car). Using context appears one option in creating human understandable solutions for secure systems. People have developed means to protect physical objects and valuable, perhaps we should draw more on this experience in the design of secure systems.

Prof. Gerhard Krüger made honorary member of GI

At the dinner of this yeas GI conference Professor Gerhard Krüger became the 6th honorary member of the German Computer Science Society (GI, Gesellschaft für Informatik). He was one of the people who understood very early that computer science is a central topic and pushed in the 1980ies form higher capacities in computer science at German Universities.

When I was at Karlsruhe (1998-2001) he was my supervisor and taught me a lot! In short: invest in the development of people.

Thursday, 20 September 2007

Ubicomp 2007

Over the last few days at Ubicomp 2007 in Innsbruck it was great to catch up with many people from the community. The discussions in the evenings are very inspiring and so were some of the talks.

We tried to explain the idea of ubiquitous computing to journalist and it seems they got the idea. And hence Ubicomp 2007 was featured in the Austrian Press:

Ubicomp 2008 will be in Korea.

Monday, 17 September 2007

CardioViz Demo at Ubicomp 2007

Alireza Sahami presented our CardiViz project at the demo session at Ubicomp. We were very happy that the project that was the result of our IPEC course on developing mobile applications was accepted as a demo.

For more details see:
Alireza Sahami Shirazi, Diana Cheng, Oliver Kroell, Dagmar Kern, Albrecht Schmidt. CardioViz: Contextual Capture and Visualization for Long-term ECG Data. Adjunct Proceedings of Ubicomp 2007 (Demo).

Jonna Häkkilä, Anind Dey, Kari Hjelt, and I organized organized the Ubiwell workshop (Interaction with Ubiquitous Wellness and Healthcare Applications) at this years pervasive. Alireza presented another paper on heartbeat monitoring there:
Florian Alt, Alireza Sahami Shirazi, Albrecht Schmidt. Monitoring Heartbeat per Day to Motivate Increasing Physical Activity. UbiWell workshop@Ubicomp 2007.

Car UIs transport Emotion

It is often discussed whether or not the user interface in the car matters or not. The basic argument is that cars are emotional and hence the driving experience matters and everything else is secondary.

However it seems the user interface becomes more and more part of the experience. On Saturday night I travelled via Munich to Innsbruck – and had again some time on in the lounge at the railway station. In a article on the new VW concept car UP it was interesting to see that about 15% of the text (about 20 lines text of the whole article of 130 lines, see red box) were about the new user touch screen – the section about the motor was similar in length.

The opening keynote at Ubicomp was given by Antonio Calvosa from Ferrari. Here two a very experienced and user interface focus could be seen. The talk touched issues of emotion and affective issues. Overall he argues that Ubicomp technologies should amplify what humans like to perceive.

Thursday, 13 September 2007

Our Papers at Interact 2007

Heiko Drewes and Richard Atterer, collegues from university of Munich, have travelled to Interact 2007. Their emails indicate that the conference is this year at a most interesting place. The conference is in Rio de Janeiro, directly at the Copacabana. The conference was highly competitive and we are happy to have two papers we can present there.

Heiko presents a paper that shows that eye gestures can be used to interact with a computer. In his experiments he shows that users can learn gesture with eyes (basically moving the eyes in a certain pattern, e.g. following the outline of a dialog box). The paper is part of his PhD research on eye-tracking for interaction. More details are in:

Heiko Drewes, Albrecht Schmidt. Interacting with the Computer using Gaze Gestures. Proceedings of INTERACT 2007.

Richard’s paper is on collaboration support with a proxy based approach. Using our previous work on the UsaProxy we extended the functionality to supported synchronous communication while using the Web:

Richard Atterer, Albrecht Schmidt, and Monika Wnuk. A Proxy-Based Infrastructure for Web Application Sharing and Remote Collaboration on Web Pages. Proceedings of INTERACT 2007.

Wednesday, 12 September 2007

Article in the Economist

Some weeks ago Ben Sutherland from The Economist called. He was researching for an article discussing the computing revolution over the last 25 years. In his research he to talked to many different people (from different countries, different fields, different views) and was particularly interested in applications that will come in the future and with me in particular on the concept of context-awareness.

The article "The trouble with computers" appeared 6th of September and discusses a mix of ideas and viewpoints. We talked about 30 minutes on the phone and I am quite surprised what statement he picked from me (I said many things that were more interesting ;-). However I think it is great that people start trying to understanding the radical changes computers introduce - everywhere.

Monday, 10 September 2007

Mechanicals aids for addition and subtraction

In the school museum I came across two very simple pen-based computing aids. The devices are very simple mechanical tools that help to do addition and subtraction. It was called ADDIATOR.

The utility is limited to addition and subtraction and it provides a very simple mechanism to deal with carry-over. If the number which is to be moved is white the calculation is without carry-over and one pulls it down. If the number is red then there will be a carry over one has to pull up and around the semi-circle (this is the mechanism for carry over). A carry over beyond the next position is displayed with a special sign and has to be resolved by moving the next position. The curator told me that he remembers people in shops used them and that people where very quick with them. It seems they have been popular till I was born.

Schools history, tangibles again

After my daughter started school on Saturday we visited a historic school on Sunday. Comparing teaching materials is interesting. Especially providing up to date information in geography must haven quite a costly task. Many expensive charts and maps that were printed on canvas are now freely available in digital form. It seems that instead of having a film project, a slight projector, an overhead projector and canvas displays a computer and projector with internet access will do. Similarly having stamps to reproduce maps seems like ancient history, even though it has been still in use 20 years ago.

However I wonder what we loose by make things digital and whether or not this matters. Having a database (a box with cardboard dividers and a lot of paper slips) or a typewriter (with types that are moved by pressing buttons) on your desktop gives you a very immediate impression how things work. It is remarkable to see that historically tangibility of teaching materials was very common.

I think in the digital we should make more effort to provide means that people can understand the mechanism behind the technology (basics of HCI – conceptual models :-). This is however extremely difficult for purely digital products. My generation seems very lucky to have been witnesses of this transformation for many products from the physical to the digital – providing a lot of insight to us.


Wednesday, 5 September 2007

Our Papers at Mensch and Computer

The last 3 days we were at the German HCI conference (Mensch und Computer) in Weimar. Overall the conference had a really interesting program (21 papers with an acceptance rate of 30%), presentations from usability professionals and a number of workshops.

Dagmar Kern presented our research on improving in-car telecommunication that was carried out together with people from BMW group in Munich. For details see:
Dagmar Kern, Albrecht Schmidt, Michael Pitz, Klaus Bengler. Status- und Kontextinformationen für die Telekommunikation im Auto. Mensch & Computer 2007. Weimar, September 2007.

Heiko Drewes showed the initial results of the studies on eye-gestures for interaction. In this paper we proof that it is possible and sensible to use gesture with the eyes to interact with a computer. For more see the picture:
Heiko Drewes, Heinrich Hußmann, Albrecht Schmidt. Blickgesten als Fernbedienung. Mensch & Computer 2007. Weimar, September 2007.

Tuesday, 4 September 2007

Automotive User Interface Workshop

At the German HCI conference (Mensch und Computer) I organized together with Paul Holleis and Klaus Bengler (BMW Group) a workshop on automotive user interfaces. We were surprised how many people work and research in this area in Germany and Austria.

The 9 talks showed a wide range of research results and questions ranging from activity recognition, search interfaces, cultural issues to research methods. Dagmar Kern presented our work on a new method for interviewing drivers at the gas station. Stefan Graf from BMW groups had an interesting demo on object oriented interaction and in-car text input.

In the final session we discussed on future challenges of automotive user interfaces and it seems that it is a great challenge as cars are very emotional products. One interesting point was that user interfaces may not be central for the decisions which car to buy - but if not satisfied it will influence the decisions not to buy such a car again.

Context and context-awareness (e.g. based on user activity, driving parameters and location) seems to provide a great opportunity for future interfaces and in-car applications. One nice example was presented by Susanne Boll from a joint project with VW (C3World, connected cars in a connected world).

Monday, 3 September 2007

Watching movies on the train

At the moment I am travelling a lot on the train and it seems that there is an increase in people using their mobile devices (e.g. Sony PSP, mobile phones) to watch cinema movies and episodes of TV-shows. Some individually and others even share the experience. Over the last years it become popular that people watched DVDs on their notebook computer on the train – but it seems the real mobile age is moving on.

Even though the screen is very small it shows again that one needs little to create the illusion of a movie. In the end it comes always back to the story…

Saturday, 1 September 2007

Cologne – New Pixel Window

On Saturday on our way back home we made a stop in Cologne. After mounting the tower (509 steps) we had a look at the new window which lead to some discussion over the recent weeks.

It looks like pixels and is abstract in comparison to the other windows (which have traditional picture motives). To me it seems a neat idea that somehow reflects our time.