What happens if you ask the customer (user)?

Dell started some time ago a web page where the public was asked for comments on improvement (http://www.ideastorm.com) – by now the list is quite impressive – at least in length. Such open community processes are really exciting to watch. I am curious which of those suggestions are implemented and how successful it is to listen to customers direct responses. If it works well others are probably trying it, too…

To make the most out of these suggestions and comments it seems essential to perform a detailed analysis (perhaps taking into account temporal dynamics of the conversation additionally to the content) – looks like another really interesting field for text-mining.

Don’t wash your dishes before loging on to the computer

This morning I washed my dished (manually in a kitchen sink) and afterwards (with dry hands) I tried to log on to my computer using the finger print scanner. My thumb did not work anymore. Looking closer at my thumb it seemed clear that this looked temporarily different as it was in the water for 10 minutes. A few minutes later the thumb is back to normal, but I already logged using a password. What do I learn from this – If I will do a ubicomp project in the kitchen (similar to things we did in Munich) I will not use finger print scanners for authentication.

What would happen if I had to wash dishes before entering the US ;-)

Panel on Users as Producers at Schloss Birlinghoven

In the castle on campus Ute Schütz and Michael Krapp from IAIS and SCAI organize a public panel discussion on citizen journalism and Web 2.0 trends. The discussion looked at the topic from several angles including technology, content, and communication. I had the honour to be on the panel with Wolfgang Back, Frank Patalong, Moritz „mo.“ Sauer and Thomas Tikwinski.

On issue was how much blogs are (mis)used to transport information or to do advertising. The web seems to be to many people a very believable medium. This reminded me of an article I read some time ago on story-telling o n the web (Miller, J. 2005. Storytelling evolves on the web: case study: EXOCOG and the future of storytelling. interactions 12, 1 (Jan. 2005), 30-47. DOI= http://doi.acm.org/10.1145/1041280.1041281). I think something along this lines would an interesting project with students.

The questions what is going to change in the near future on the WWW brought many trend statements out, but for me it is amazing that most of the infrastructure and technology we need to make this happen is out there. One comment which I think is really true is that it is more an more about content and communication again. As Thomas said before the panel – most of the great things that are called Web 2.0 have been in the original proposal for the WWW (e.g. annotations by everyone or users as editors) – but now technology is finally there that people can use it.

Girls' day at Fraunhofer in Birlinghoven

In Germany there are still too few girls and women interested in studying technical subjects – it may have different reasons but I think trying to convince young girls that technology is really exciting is a good way of addressing the problem.

We had this morning 7 girls visiting our lab. Matching our current teaching at B-IT (and using the test implementation Dagmar made ;-) we offered the topic “The computer knows where I am – how does this work”. First we played a mini geocaching game where they had to find a bag of jelly babies behind the castle.

After they had some experience with GPS and an electronic map we explained how it works and even parse together a NMEA-0183 sentence. We also discussed some application ideas, e.g. kids monitoring with GPS. The discussion, in particular the privacy issues that came up, were quite interesting.

I can really see that for some projects running focus groups with kids could be fun for them and a great value for the projects.

Why shopping is fun – thoughts on intelligent user interfaces or why n=1 is not enough

Some weeks ago I saw for the first time one of the intelligent scales in the wild (=outside the lab). At that time I was really impressed how well it worked (sample size: n=1, product: banana, pack: no-bag, recognition performance: 100%). Last time I was too late so there was no time to play or see other people using it – but today I had some 5 minutes to invest.

The basic idea of the scale is simple and quite convincing. The customers put their purchase on the scales. A camera makes a guess what it is and the selection menu is reduced to the candidates that match the guess of the camera. Additionally, there is always a button to get all the options (as in the old version without the camera). It appears that this should make things easier.

I observed people trying to weigh different fruits and vegetables in bags and without bags (obviously I tried it myself, too). It did not work very often but interestingly people did not care much. It looked as most people did not really realise that this is meant to be an intelligent user interface. They probably just wondered why the display is showing always different things, but as they are intelligent themselves they found a way to deal with.

Overall it seems that it does really well on bananas which are not wrapped in a bag (my initial test case) and does not too well on many other things. I think the scales are an interesting example of a invisible interface.

Overall this is again a remainder that user tests that are small may be utterly wrong.

A magic lens for the mass market?

Making things visible that can not be seen with the naked eye? Overlaying personalized information onto objects or images? Such concepts make good fiction but are there interesting use cases? Michael Rohs from T-Labs in Berlin visited B-IT and Fraunhofer IAIS today and he showed us in his talk and demos several such scenarios that appear not to be far in the future or fictional anymore.

Michael has developed during his PhD at ETH Zürich the Visual Codes system (http://people.inf.ethz.ch/rohs/visualcodes/) that provides a basis for augmented reality interaction on mobile phones. Some of his current work, in particular overlaying information on large paper maps, shows impressively the potential of using personal mobile devices, such as phones, as interfaces to combine static and dynamic information. I think for everyone trying out information overlays using a phone can easily imaging that this could be commonplace pretty soon. The question is more what the first pervasive and convincing applications are for mobile augmented reality and when will we find them in the wild. In our discussion a number of interesting application areas came up, in particular games and advertising seem very appealing.

In the morning Michael got a tour a B-IT and some demos. One of our tasks in the practical course developing location and context-aware systems is also related to a magic device from the Harry Potter book – a map with a moving point ;-)

Till Schäfers, a student at B-IT who is currently at T-Labs in Berlin for his master thesis (supervised by Michael and me) gave this morning a presentation on the work he started. We had a longer discussion on issues of teleconferencing – and in particular on mobile teleconferencing – were many interesting ideas and issues came up. (Remark on research&realty: somehow it is sad that even after many year of research in teleconferencing the tools we use to do meeting over the phone in our daily work are still poor – but things are getting better). Another issue we discussed in detail is the questions of how to involve the user in the design process even more while giving at same time the user interface designer the freedom to designs and defines novel ways of interaction and exciting interfaces.

Besides the scientific exchange it is great to have visitors to learn about new gadgets. Michael and Till showed the SHAKE SK6 sensor /actuator attached to a phone – quite an interesting tool for research.

Steffi Beckhaus Showed us Virtual Reality beyond 3D Visual Displays

Steffi Beckhaus, who is professor for computer science at the University of Hamburg, visited our group at B-IT. Meeting her was another classical example how small the scientific community in user interface research is. I met Tanja Döring, one of Steffi’s students, at TEI’07 in Baton Rouge. They had a very interesting paper on novel user interfaces for art historians - “The Card Box at Hand: Exploring the Potentials of a Paper-Based Tangible Interface for Education and Research in Art History”. Looking then up Steffi Beckhaus details I saw that she was at Fraunhofer IMK (which is now part of IAIS) in Birlinghoven some year ago in the virtual environments group.

After lunch we had a few demos (like always on short notice as I forgot to tell before). Florian Alt demoed the current stage of his annotation platform for the web and Paul Holleis showed some examples of the work on modelling physical interaction and cross device prototyping, which we will present at CHI in 2 weeks. We also showed one of the student projects from the last course on developing mobile applications (CardiViz) and the ongoing work of our current lab on context and location awareness. We realized that we have very similar values and methods for teaching. In particular forcing students to bring in their own creativity into projects which they drive and for which we set a corridor seems a very efficient way to teach people who to create novel user experiences.

In her presentation Steffi showed us details about her lab in Hamburg (we were so impressed that we invited ourselves for a visit). In particular the combination of “classical VR” and tangible and novel user interfaces is intriguing. Overall her work is greatly interesting as it looks into the whole body experience (e.g. sound-floor, chairIO) and connects much more than I expected to our research theme of embedded interaction.

In our discussion Steffi brought up a video of the Pain-Station (http://www.fursr.com/) . It is basically a pong game where you get penalized for low performance with actuator that creates pain (I think with heat and a whip). To be successful you can either play well or take more pain than your opponent ;-) This led us to the discussion of how far one should go in designing novel user experiences.

Taking about tactile output Steffi mentioned the project VRIB (for more info see VRIB at Fraunhofer IMK or at Univeristy of Ilmenau) that was done from 2000 to 2004 on novel interaction devices and metaphors. This includes interesting issues that may be also relevant for our work on tactile output on mobile devices.

Wearable Activity Recognition – Talk by Kristof van Laerhoven

How many sensors do we need? That was one point in the discussion after Kristof’s talk. His approach, in contrast to many others, is to use a large number of sensors for activity recognition. This offers more freedom with regard to placement of sensors, variations of sensors, and also provides redundancy but makes the overall system more complex. His argument is that in the long term (when sensors will be an integral part of garments) the multi-sensor approach is superior – let’s wait some 10 years and then discuss it again ;-)

From a scientific perspective and in particular for machine learning (where he sees the greatest challenge) the larger number of distributed sensors is more interesting. I find his porcupine2 (http://porcupine2.sourceforge.net/) stuff quite interesting.

Kristof’s web page: www.mis.informatik.tu-darmstadt.de/People/kristof

Guests @ UIE

We are delighted to have a group of people visiting from Lancaster University in the UK. Prof. Nigel Davies and 2 of his PhD students, Oliver Storz and André Hesse, came last week to Bonn and will stay with us for the next 3 months. It is great that Nigel decided to have his Sabbatical at Fraunhofer IAIS and B-IT, University of Bonn.

Earlier this evening we had already a brain storming session at the Bier garden of the Bahnhöfchen in Beuel (www.bahnhoefchen.de). I am really looking forward to interesting joined projects in the next weeks and months.

GPS statistics – or 25 hours in the car not driving?

My navigation system records simple statistics. I was surprised to see that I have been sitting in my car for about 25 hours in the last 4 months – not driving. Overall it means that 30% of the time I am actually not driving (usually waiting at a traffic light or a railroad crossing - not sure if the 30% are a Bonn-phenomenon).

This makes me wonder if it would be useful to design technologies that provide entertainment or education during these forced waiting times. Could I have used these 25 hours to learn or improve a language? Or could I have watched some funny clips from youtube? Or is listening to the radio all we need while driving (and not driving)?

Paul Holleis joined UIE in Bonn

The Embedded Interaction Research Group (www.hcilab.org) moved in the beginning of April from the University of Munich to the University of Bonn. Paul Holleis (www.paul-holleis.de) , who worked on the project for the last 3 years joined us now in Bonn. It is really great to have him and his experience here!

Matthias Kranz (www.ibr.cs.tu-bs.de/users/kranz/) who also worked on the project is now in Braunschweig working with Michael Beigl. Braunschweig is too close to not work together - this term we run a seminar on context-aware and ambient systems in parallel at TU Braunschweig and University of Bonn.

User tests and final presentations of the lab course

This week the final presentations of the lab course were due. It was really interesting to see what motivated students can achieve in just 4 weeks! The projects explored the idea of contextual ECG and students implemented the data acquisition, transmission over the network, and visualisation. The user studies showed that there is quite some potential in the idea (even though there is also still some way to go before the system is perfect ;-) We plan to publish a paper on the results of the course.

Having a digital presence after life?

An event this week reminded me that life has an end. Getting a link to a Google Map page (satellite image) where someone found his last resting place shows how far reaching new technologies have penetrated our life. This made me think about a demo I saw at Ubicomp last year (http://mastaba.digital-shrine.com/). The digital family shrine did not really relate to my cultural experience and felt somehow strange, but still very interesting and intriguing. I wonder in what form of digital presence after life will become common in Germany…

Panel on Sensor Networks – Applications are the Key

Debora Estrin made an interesting statement. The “early challenges” (the thousands or millions of randomly scattered sensor notes) do not have much applicability outside the battlefield. The new challenges are heterogeneity (specific sensors with specific capabilities) and interactivity (basically sense-making is a process where humans are involved). She made the point that the logical consequence is that dealing with data is the essential issue and statistics have an increasing role. Furthermore these new research directions make a stromg call for application driven research. With these very insightful comments she criticised a lot of the current work in sensor networks. Especially the observation that there is no such thing as a "general sensor" - it points out that concrete applications are required to make meaningful contributions, even to basic research in sensor networks research.

Best Demo Award at Percom 2007

Gregor got for our Perci prototype (Supporting Mobile Service Usage through Physical Mobile Interaction) the best demo award. So it paid off that he spend a night configuring the data services on the phones for the US networks ;-) It is amazing that it is still quite an effort to configure data services for a new provider.

Talks and Demos at PerCom 2007 in White Plains, NY

This year we (my previous group from LMU Munich) have a significant presence at PerCom. Form the 20 full papers the Embedded Interaction Research Group (www.hcilab.org) has 3, and additionally 1 of the 7 concise papers is from us. With a total of 207 submissions and an acceptance rate of around 10% this is quite an achievement for the team – and a good high point for the project before moving it to University of Bonn.

Gregor(y) Broll had the demo developed in the Perci-Project yesterday. Lucia Terrenghi and I had our talks today. And Gregor Broll, Sebastian Boring, and Raphael Wimmer have their talks tomorrow. Overall the conference has quite a diverse and interesting program, which seem to be more technical and network oriented than Ubicomp or Pervasive. The publications will be online available at the IEEE digital library or on our new publication webpage.

What can you do with a Wii controller? Use tape and connect a toothbrush and program a nice UI (fish tank) in Flash. Quite an interesting demo from Waseda University in Japan - at least the person who did the demo had really clean teeth in the evening.

PerTec Workshop in NY, Ripping off the Antenna

At PerCom 2007 (www.percom.org) Florian Michahelles (Auto-ID labs, ETH Zurich), Frédéric Thiesse (University of St. Gallen), John R. Williams (MIT Cambridge) and I are running the the PerTec workshop (www.autoidlabs.org/events/pertec2007). There is quite some interest in the topic and the range of topics is from technical to user interface and security.

In contrast to the workshop 1 year ago at Pervasive 2006 it seems that item level RFID-tagging is undisputed and that the only discussion point is when it is coming - in 6 month or 10 years. There is also still some discussion about what types of products are the first ones that are tagged – is it pharmaceuticals or cloth?

There was an interesting contribution by Paul Moskowitz from IBM, the clipped tag. It is a tag where you can physically rip off some part the antenna to reduce the read range from several meters to centimetres (see the pictures). It is really interesting that people can do a very clear and visible action to change the characteristics of a tag. The only questions that remains for me – will people trust that this really rips of the antenna? Probably yes…

The topics we discussed included security, privacy, location and RFID, end user issues, and connection of sensors to RFID, we hope to write it up in an overview article.

In the break out groups one discussion centered on the question what would we need to enable end-users to create novel applications using RFID? Further results of the discussion will be available on the workshop webpage soon.

The overall theme that emerged again and again is impact of real world constraints in RFID systems. Questions like: Can you achieve anonymity with a certain protocol? Can not be answered without knowing how it is used in the real world. Especially having recently learned a lot about data-mining (being at Fraunhofer IAIS) for me the questions of exploiting data collected in RFID systems looks really challenging.

Wearable Computing – Is it here?

10 years after I have got seen first see the crazy idea of wearable computing it appears that the technology is now really pushing into the marked. Even though one could argue whether or not this is really wearable computing (but this argument is as old as the idea of wearable computing). The last thing I would have expected 10 years ago was Bavarian Lederhosen with a built in user interface for an mp3-player. But nevertheless many challenges are still the same (integration with the aesthetics and fashion statement, durability and wash-ability, connectivity between computer and garment, integrated user interfaces) and some are nicely solved (http://www.smarttextiles.net/).

After Falke presented some years ago a sensor/ECG-t-shirt there was another one at CeBIT this year. It is not on the marked yet and it did not yet look fully convincing (you need to button in the electrodes). In our lab class on programming mobile systems we could use such a t-shirt. Currently we use stick on electrodes from http://www.alivetec.com/ which work really good but for the scenarios in mind having a t-shirt would be nicer.

In my recent entry on St. Petersburg I wondered about a communication glove. There was one on display – it includes only the essential (basically a speaker and a microphone) – but it enforced my opinion that creating a communication glove would be an interesting project. There were also hats with included speaker and microphones.

I was told that garments that keep warm – with active heating – are a hot topic ;-) Not fully convinced, but if projected consequently into the future it could change the way we dress completely. Want to show off you body at -20°C? Just power up the heating in your underwear a bit more and walk outdoors in your favourite summer dress without a coat. Not sure if this is the way we should push, I rather take my warm coat and save some energy. Apropos saving energy – there were interesting laptop bags with solar panels on the outside for harvesting energy.

some more photos are at http://foto.ubisys.org/wearables-cebit/

Fraunhofer at CeBIT

“Deutschland – Land der Ideeen” – Germany land of ideas was really visible at the Fraunhofer exhibitions at CeBIT. For me having just recently joined Fraunhofer Gesellschaft I was amazed on the many research areas covered and the quality of the exhibits. Next generation MP3, interaction in public spaced, smart transport solutions, robots, micro-electronics, sensors – it is not really feasible to make a list… Our institute (IAIS) showed several exiting exhibits (see http://www.iais.fraunhofer.de/ for details).

CeBIT: Context-Awareness for Novel Transport and Logistics Services

At the Fraunhofer Forum at CeBIT I had the chance to talk about future transport solutions. One of my students in Munich (Michael Müller) is working on a pro-active transport container. In the project aware-goods (http://www.comp.lancs.ac.uk/~albrecht/awaregoods/) we looked into this domain already in 2000 at TecO together with SAP Research. Reiterating over the idea is really interesting as now the technology is really here – sensor network nodes are available, mobile phones offer massive processing power, there is ubiquitous data connectivity, and web service interfaces are available for many applications.

The big question is now on algorithms and software for context recognition and data mining in the collected sensor data, the integration with processes and company software systems, and the exploitation for optimising transport and logistics processes.

Business in a Nutshell, Thoughts on Patents

Thomas Doppelberger and Andreas Aepfelbacher from Fraunhofer Venture Group (http://www.venturecommunity.de/) came to our lab course to teach us how to get from a technical idea to a successful business. They talked us through the essentials of a business plan, discussed common mistakes and gave us an insight how companies are evaluated and furthermore encouraged our “entrepreneurial thinking”.

After such a day and the interesting discussions with them and the students one wonders why we are not trying more often to look into the option of starting a company. Obviously not every start-up is the next youtube or second life – but without trying ideas out, there is not way in telling if the work or not.

Over lunch we talked very briefly about issues on patents and licensing. Even though the value of patents for companies is fairly comprehensible many questions remain open in publicly funded research institutions, – especially with regard to computer science. Thinking a little more about the figures they presented in the morning I wonder how the balance (over all publicly funded research in universities and non-profit institutions) between investments in securing rights (basically making patents and holding them) and income (e.g. licensing) is. Are there any figures available? Within the whole Fraunhofer Gesellschaft it is impressive to see the contribution of one development such as MP3 to such an equation.

Visitor from Finland

Jonna Häkkilä, a principle scientist from Nokia Research Center in Helsinki/Oulu, is visiting us for two days. As you can see on the pictures she enjoyed arguing with our students. She also gave a talk on her recent work. We talked a lot about the format of the course and the results are really interesting. I think getting 10 students for 4 weeks into one room (every day from 9-5) makes a lot of sense - it is amazing how quick students learn is such a setting.

Jonna was a co-author of a paper on tactile output at TEI'07 ("Tap Input as an Embedded Interaction Method for Mobile Devices"). We discussed some opportunities for a follow-up project here in Bonn. Perhaps we co-supervise a master student on the topic.

Paul Holleis from my group (he is still in Munich) is visiting, too. While walking along river Rhine we got into an interesting discussion on wearable computing. Cloth cover often the whole body - would they not be great for input?

Broadcasting your Heart Beat

This morning the first 3 students completed the exercise part of our lab class. For the first team the basics are done and we start with the exciting part ;-)

We have different sensors that can be connected via Bluetooth to the phone (e.g. heart rate, pulse oximeter, GPS) and the task for the project is to invent a new application that makes use of sensors and creates a new user experience.

In the brainstorming session some were tearing out their hair - but it was rewarding. Some of the ideas that came out are really novel - and perhaps a bit to crazy to implement them. One example of such an idea is to create a web radio station that broadcasts the live heart beat of celebrities as an audio stream (not sure if this is the right way to fame). Other ideas centered on support for sport, exercise and mobile health.

Alexander De Luca (a former colleague from LMU Munich) was spending the last few days with us here. He helped greatly to write some code to get the Alivetec-ECG data parsed.

Zweitgeist - Meeting People While Browsing

By accident I have seen that Heiner Wolf (he was a researcher at the University of Ulm when I was a student there) has a new company - http://portal.zweitgeist.com/. Back then in 1996 he worked on a European funded project called CoBrow - Cooperative Browsing - looking how to create a system that allows you to meet other people who are on the same web page as you are.

Since then I think that is a really exiting idea. But looking at his current work it is easy to imagine that this could really take of. It is extremely easy and looks like fun. You have your avatar (which you can customize) that can meet and interact with other avatars that are at the same web page as you are. It is not a lot what you can do - but that is the beauty!

Lab started: Developing Interactive Mobile Applications

Our Lab course on "Developing Interactive Mobile Applications" started today with 11 students (the limit was 8 - but 3 more is OK as we got some additional phones from Nokia).

Shortly after lunch everyone had there first application written and deployed to the phone. In the afternoon we looked into sending an SMS from JAVA using the messaging API.... And this is fairly easy.

For more details on the course see: http://uie.bit.uni-bonn.de/developing.php

Seeing the possibilities of JAVA ME and how quick people get applications running made me wonder how long it takes till we have massive mal-ware, viruses and spam on the phone. Secutity on phones may be one of the upcomming challenges.

Thoughts on Wearable Computing and Communication

This morning we took some time to walk along Nevsky Prospekt, crossing Anichkov Bridge all the way to the Hermitage and to the river Neva (which was nearly completely frozen). The streets were very busy with people.

… but nearly nobody spoke on the mobile phone. It does not need much brain to figure out why – after just taking a few photos with my phone I had really cold fingers and quickly put my gloves on again! Remembering a summer day last year in Rome – were nearly everyone spoke on the phone – I wondered what phone terminal it would require to transform the scene in St. Petersburg.

After this, many ideas that we recently discussed on wearable computing and communication made much more sense (at least a lot more that skiing and snowboarding scenarios). A headset in a fashionable scarf, a pair of gloves with camera and display, and controls included in a jacket appeared at once very reasonable. Creating an interactive experience – especially controlling the communication and the applications is an interesting challenge (perhaps an interesting student project?).

Educational Fair in St. Petersburg

Together with Alexandra Reitelmann I am in St. Petersburg (Russia) to advertise our study programs at the B-IT and University of Bonn (http://www.bit.uni-bonn.de/). In particular we talk to potential students about the master programs in Media Informatics and Life Science Informatics. The educational fair is held in the centre of St. Petersburg at the Russian Museum of Ethnography, which is a truly magnificent building. Overall I was surprised by the city, the buildings, the shops and the quality of the hotel.

The discussions with potential students and in some cases with their parents were interesting. It showed that there is a demand for high quality education and that Germany is an attractive place to study. Given the background of many people we talked to it could be interesting to look into the potential of a conversion master in media informatics, where people with different degrees (e.g. psychology, business studies, math, or engineering) can enter. In comparison to other countries education seems to be a bargain in Germany.

Tangible and Embedded Interaction 2008 in Bonn

The second international conference on Tangible and Embedded Interaction (TEI’08) will be in Bonn, Germany. Together with Hans Gellersen from Lancaster University I will chair the conference in 2008. I am absolutely delighted that Elise van den Hoven from Eindhoven University of Technology and Ali Mazalek from Georgia Institute of Technology will co-chair the program. The conference will be held in the B-IT-Center in February or March 2008 – we will soon put more information on www.tei-conf.org

Some thoughts to keep in mind for 2008… In the discussion it was suggested that we capture the conference next year on video and put the online or stream them. Furthermore several people argue for workshops as part of the conference. To have papers of different length, which may be presented in different forms (talks, exhibitions, demos, posters) but which are all equal in the proceedings was generally welcome. It was suggested that videos should feature in the submission to the program in one way or another. To make it easier for participants to have demos but also see other demos it was suggested to have student volunteers to help. The publication in the ACM digital library was seen by most people I spoke to as an important plus of the conference.

Affectionate Computing

Thecla Schiphorst introduced us in her talk “PillowTalk: Can We Afford Intimacy? to the concept of Affectionate-Computing.
The central question is really how can we create intimacy in communication an interaction with and through technology? The prototype showed networked soft objects, that include sensors that recognize tactile qualities and gesture interaction. There are more details in her paper published at TEI’07.

Nicolas Villar & Wolfang Spießl present at TEI’07

Wolfgang (one of the students I supervise at the LMU Munich) was last year for an internship at Lancaster University. Together with Nicolas (one of my former colleagues) he build a system that integrates VoodooIO with Macromedia Flash.

The paper is available at http://ubicomp.lancs.ac.uk/~villar/publications/pdf/voodooflash_tei.pdf