




A blog on novel user interfaces, mobile applications, pervasive and ubiquitous computing. I use the blog as a note pad ;-)





We got a new USB GPS tracker(from Mobile Action, GT100) and had to try it out on the trip to Korea. It worked very well compared to the other devices we had so far. It got the bus trip in Düsseldorf airport right and the entire flight from Amsterdam to Seoul. Tracking worked well in the taxi from the Airport to the hotel. While walking in downtown Seoul it still performed OK (given the urban canyons) with some outliers.
On the way into town we got a really good price for the taxi (just make a mental note never to negotiate something with Florian and Alireza at the same time ;-) It seems taxi driving is sort of boring – he too watched television while driving (like the taxi driver some weeks ago in Amsterdam). I think we should seriously think more about entertainment for micro breaks because I still think it is for a good reason not allowed to watch TV while driving.
Seoul is an amazing place. There are many digital signs and electronic adverts. Walking back to the hotel I saw a large digital display on a rooftop (would guess about 10 meters by 6 meters). If working it is probably nice. But now it is mal functioning and the experience walking down the road is worsened as one inevitably looks at it. I wonder if in 10 years we will be used to broken large screen displays…
I have learned about Chumby an interesting platform that is designed to replace devices on your bedside table. Looking forward to get one or some when I fly next time to the US.
For a design competion at the appliance design conference I did a design concept for a networked alarm clock [1] assuming that networked device will be soon cheaply available. Maybe we should look at the paper again and think about how to push such ideas forward as the devices are on the market…
[1] Schmidt, A. 2006. Network alarm clock (The 3AD International Design Competition). Personal Ubiquitous Computing Journal. 10, 2-3 (Jan. 2006), 191-192. DOI= http://dx.doi.org/10.1007/s00779-005-0022-y
Imagine there is a song – you know band and title – and you want to buy it. Should not be really something worthwhile reporting in a blog…
How long does it take to buy a song and how many steps does it need? I tried myself and was pretty much amazed that it is still more difficult than other ways to get music. The idea was to put the song into my shopping cart, press check-out, pay by credit card, and download. On the stores I encountered you have to register before to buy… I finally got the song and here are the steps at a major German music store: go to shop page, search for song, put in shopping cart, go to checkout, told to register, fill in registration form, told to confirm email, opened email client, waited 3 minutes for email, confirmed email, logged in on webpage, realized shopping card is empty :-(, search for song, put in shopping cart, go to checkout, entered credit card information, pay about 1.69€, got download link, got music.
I really wonder how many people will become first time buyers in this shop. Sometimes I think the things we teach in User Interface Engineering are obvious – but real life tells me they are not! If you run a music download portal or if you are in the music business and you wonder why no-one buys – we can tell you :-) it may be about utility and usability of your online offers… if you need more details we are happy to help you :-)
PS: there was a store with a .ru address with better usability that offered the song with no registration at 0.20€ - but I did not want to give my credit card details…
Yesterday there was a workshop on Mobile and Embedded Interaction as part of Informatik2008 in Munich. The talks and discussions were very interesting. Lucia and Thomas raised interesting issues on a new notion of personal computing, where the mobile device becomes the center of a personal computing infrastructure. This idea has been around for some time (e.g. Roy Wants Personal Server [1]) but the new ideas and the feasibility with current hardware makes it really an exciting topic. On the general topic there are many open questions, as visible on the slide.

After the workshop, when swapping business cards, we started the discussion when in the future we will have business cards (in larger quantities, to give away) that have active display elements (e.g. eInk) included. Everyone gave a predictions in how many years we will have it (Lucia Terrenghi:never; Raimund Dachselt:7; Thomas Lang: business card will disappear; Albrecht Schmidt:9; Heiko Drewes:10; Florian Echtler:5; Michael Rohs:5; Paul Holleis:5). Lets get back in 5 years and see… In September 2008 the Esquire Magazine featured an e-ink cover page - have not seen it myself:-( but there is a video: http://www.esquire.com/the-side/video/e-ink-cover-video
Today we organized a workshop on Software, Services and Platforms for new infrastructures in telecommunication. We had a set of really interesting talks. As I did my PhD on context-awareness I was quite impressed by work on context oriented programming and the advances over the last years in this domain (good starting point on the topic with some publications [2]).
At the end of the workshop I gave the following scenario as an impulse for discussion: image there are 10 million facebook users that contniouly stream the video of what they see into the net, e.g. using eagle-i. The discussion raise many technical as well as social challenges!
[1] Want, R., Pering, T., Danneels, G., Kumar, M., Sundar, M., and Light, J. 2002. The Personal Server: Changing the Way We Think about Ubiquitous Computing. In Proceedings of the 4th international Conference on Ubiquitous Computing (Göteborg, Sweden, September 29 - October 01, 2002). G. Borriello and L. E. Holmquist, Eds. Lecture Notes In Computer Science, vol. 2498. Springer-Verlag, London, 194-209.
[2] http://www.swa.hpi.uni-potsdam.de/cop/
PS: there are few photos as someone in the workshop today objected to be on the net…
For the second time we ran this year a workshop on automobile user interfaces and interactive applications in the car at the German HCI conference: http://automotive.ubisys.org/

In the first session we discussed the use of tactile output and haptics in automotive user interfaces. It appears that there is significant interest in this area at the moment. In particular using haptics as an additional modality creates a lot of opportunities for new interfaces. We had a short discussion about two directions in haptic output: naturalistic haptic output (e.g. line assist that feels like going over the side of the road) vs. generic haptic output (e.g. giving a vibration cue when to turn).

I think the first domain could make an interesting project – how does it naturally feel to drive too fast, to turn the wrong way, to be too close to the car in front of you, etc…
In a further session we discussed framework and concepts for in-car user interfaces. The discussion on the use of context with the interface was very diverse. Some people argued it should be only used in non-critical/optional parts of the UI (e.g. entertainment) as one is not 100% sure if the recognized context is right. Others argue that context may provide a central advantage, especially in safety critical systems, as it gives the opportunity to react faster.

In the end it comes always down to the question: to what extent do we want to have the human in the loop… But looking at Wolfgang's overview slide it is impressive how much functionality depends already now on context...
In the third session we discussed tools and methods for developing and evaluating user interfaces in the car context. Dagmar presented our first version of CARS (a simple driving simulator for evaluation of UIs) and discussed findings from initial studies [1]. The simulator is based on the JMonkey Game engine and available open source on our website [2].
There were several interesting ideas on what topics are really hot in automotive UIs, ranging from interfaces for information gather in Car-2-Car / Car-2-Envrionment communication to micro-entertainment while driving.
[1] Dagmar Kern, Marco Müller, Stefan Schneegaß, Lukasz Wolejko-Wolejszo, Albrecht Schmidt. CARS – Configurable Automotive Research Simulator. Automotive User Interfaces and Interactive Applications – AUIIA 08. Workshop at Mensch und Computer 2008 Lübeck 2008
[2] https://www.pcuie.uni-due.de/projectwiki/index.php/CARS

PS: In a taxi in Amsterdam the driver had a DVD running while driving – and I am sure this is not a form of entertainment that works well (it is neither fun to watch, nor is it save or legal).

Last winter term I was teaching a class on Unconventional User Interfaces at the University of Linz as part of the MSc in Pervasive Computing. As part of the exercises the students had to do a project and write a paper on the topic in a group. This required to do a full round in the development (from idea creation to study).
Florian König and his group had an exciting idea for a novel form of advertisement. The user is mirrored in the advert and becomes a part of it. They implemented an interactive poster for a travel agent (users become part of the holyday scene) and tested it in-situ. The paper was accepted at the German HCI conference (Mensch und Computer) and Florian presented it today very well [1].

In the questions there was much discussion about privacy and user acceptance. We discussed whether or not such a installation would be legal in Germany (people mentioned the Datenschutzgesetz §6).
[1] Johannes Schönböck, Florian König, Gabriele Kotsis, Dominik Gruber, Emre Zaim, Albrecht Schmidt. MirrorBoard – An Interactive Billboard. Mensch und Computer 2008. Lübeck. Oldenbourg Verlag, 2008, p 207-216.
This year the German HCI conference (Mensch und Computer) is co-located with the German e-learning conference. The opening keynote this morning by Rolf Schulmeister was an interesting analysis of how young people use media in the context of learning. Over the last year that have been plenty of popular science books that tell us how human kind changes with the internet, e.g. Digital Native vs. Digital Immigrands by Marc Prensky (extract). The talk seriously questioned if a “Net Generation” exists and it seems that many of the properties associated with it (e.g. short attention spans, use of internet to socialize, reveal feelings through the internet, preference of graphics over text) are found based on studies where people select themselves to participate in the studies/questionnaires.
The paper (Gibt es eine »Net Generation«, in German over 130 pages) that accompanies the talk provides many interesting reference and is worthwhile a further look.
Gauntlet: a wearable interface for ubiquitous gaming – exploring a new gaming UI for gestures.
Mobile phones as artifacts children use in their games are discussed. Shows again how creative children are ;-)
An Investigation into round touch screen Wristwatch interaction – interesting topic and good example how to do a small study. Ideas to create a tactile rim, e.g. 2 parts moving to have different tactile cues, were brought up in the discussion.
Programming with children – taking programming it into the environment away from the computer, relates to Tangible User Interfaces
Projector phone: a study of using mobile phones with integrated projector for interaction with maps
Interaction based on Speech seems possible – even in noisy environment – the paper reports interesting preliminary results in the context of a fishing boot. Interesting in-situ tests (e.g. platform in a wave tank)
Wearable computing user interfaces. Where should we put the controls and what functions do uses expect?
Learning-oriented vehicle navigation systems: a preliminary investigation in a driving simulator
Enrico Rukzio followed up the work from Munich pushing the idea of touch interaction with NFC devices further.
Color matching using a mobile phone. The idea is to use a color chart, take a photo of face with a color chart, sent by mms to server, server process look up color match, reply by sms; no software installation only using MMS, SMS. Application in cosmetics are discussed.
Using Second Life to demonstrate a concept automobile heads up display (A-HUD)
Last year Paul did an internship a Nokia in Finland. He worked there on the integration of capacitive sensors in phones and clothing. After Paul was back we jointly followed up on the topic which resulted in an interesting set of guidelines for placing wearable controls [1].The paper gives a good overview of wearable computing and interaction with wearable computers.
In the work we focused on integrating touch sensitive controls into garments and accessories for a operating the music player integrated in a phone. The study showed that there are prime locations where to place controls on their body: the right hip and above the right knee (for more details see the paper [1]). It furthermore showed that it is not clear expectations of functions (e.g. forward, backward, volume up/down) with regard to controls laid out on the close.
During his internship he also did research on integrating touch into buttons, which was published at Tangible and Embedded Interaction 2008 [2].
[1] Holleis, P., Schmidt, A., Paasovaara, S., Puikkonen, A., and Häkkilä, J. 2008. Evaluating capacitive touch input on clothes. In Proceedings of the 10th international Conference on Human Computer interaction with Mobile Devices and Services (Amsterdam, The Netherlands, September 02 - 05, 2008). MobileHCI '08. ACM, New York, NY, 81-90. DOI= http://doi.acm.org/10.1145/1409240.1409250
[2] Paul Holleis, Jonna Häkkilä, Jussi Huhtala. Studying Applications for Touch-Enabled Mobile Phone Keypads. Proceedings of the 2nd Tangible and Embedded Interaction Conference TEI’08. February 2008.
Since Enrico Rukzio (my first PhD student) went to Lancaster he discovered and advanced a very exciting topic for mobile interaction: mobile projector/projector phones. His group has a great presencs at this year’s mobile HCI (3 demonstrations, 2 short papers, 2 full papers, a workshop). In time for the conference the first projector phone appeared on the market (Cking Epoq EGP-PP01) - as to highlight the timeliness of the work.
The mobile projector study [1] revealed several interesting aspects. 1) it is faster to browser on the phone screen than using a project, 2) users do a lot of context switches between projection and device – even nothing is displayed on the screen, 3) the users see a great value in it (even if they may be slower). I am really looking forward to further results in this area. It may be significantly change the way we use mobile phones!
PS: see Enrico watching his student present I remember how exciting it is for a supervisor to just watch…
[1] Andrew Greaves, Enrico Rukzio. Evaluation of Picture Browsing using a Projector Phone. 10th International Conference on Human-Computer Interaction with Mobile Devices and Services (Mobile HCI 2008). Amsterdam, Netherlands. 2-5 September 2008.
He put together a survey – please have a look and take part!
He reported of a class he is teaching at Stanford on designing facebook applications. The metric for success (and on this students are marked) is the uptake of the created application over the time of the course. He reported that the course attracted 16 million users in total and about 1 million on a daily basis – that is quite impressive. This is also an example of the approach he advocates: “rather try than think”. The rational is to try out a lot of things (in the real market with real users, alpha/beta culture) rather than optimize a single idea. Here the background is that nowadays implementation and distribution is really easy and that the marked decides if it is hot or not… His advice is to create minimal application – simple application and then push it forward. All big players (e.g. google, flickr) have done it this ways…
With regard to the distribution methods for persuasion he referred over and over to social networks (and in particular facebook). His argument is that by these means one is able to reach many people in a trusted way. He compared this to the introduction of radio but highlighted the additional qualities. Overall he feels that Web 2.0 is only a worm up for all the applications to come on the mobile in the future.
At the center of the talk was that prediction that mobile devices will be within 15 years the main technology for persuasion. He argued that mobile phones are the greatest invention of human kind – more important than the writing and transportation systems (e.g. planes, cars). He explained why mobile phones are so interesting based on three metaphors: heart, wrist watch, magic wand.
Heart – we love our mobile phones. He argued that if users do not have their phone with them they miss it and that this is true love. Users form a very close relationship with their phone and spend more time with the phone than with anything/anyone else. He used the image of “mobile marriage”…
Wrist watch – the phone is always by our sides. It is part of the overall experience in the real world provding 3 functions: Concierge (reactive, can be asked for advice, relationship base on trust), Coach (proactive, coach comes to me tells me, pushing advice), and Court Jester (entertains us, be amused by it, create fun with content that persuades).
Magic wand – phones have amazing and magical capabilities. A phone provides humans with a lot of capabilities (remote communication, coordination, information access) that empower many things.
Given this very special relationship it may be a supplement for our decision making (or more general our brain). The phone will advise us what to do (e.g. navigation systems tell us where to go) and we love it. We may have this in other areas, too – getting told what movie to see, what food to eat, when to do exercise, … not fully convinced ;-)
He gave a very interesting suggestion how to design good mobile applications. Basically to create a mobile application the steps are: (1) Identify the essence of the application, (2) strip everything of the application that is not essential to provide this and (3) you have a potentially compelling mobile application. Have heard of this before, nevertheless it seems that still features sell but it could by a change with the next generation.
He provided some background on the basics of persuasion. For achieving a certain target behavior you need 3 things – and all at the same time: 1. sufficient motivation (they need to want to do it), 2. Ability to do what they want (you either have to train them or to make it very easy – making easer is better) and 3. a trigger. After the session someone pointed out that this is similar to what you have in crime (means, motive, opportunity ;-)
For creating persuasive technologies there are 3 central pairs describing motivation:
When designing systems it is essential to go for simplicity. He named the following five factors that influence simplicity: (1) money, (2) physical effort, (3) brain cycles, (4) social deviation, and (5) non-routine. Antonio pointed out that this links to work of Gerd Gigerenzer at MPI work on intuitive intelligence.
[1] Gigerenzer, G. Gut feelings: The intelligence of the unconscious. New York: Viking Press.
Lots of people downloaded Google chrome during the conference. And it seemed that google managed to keep secret till the date it is launched – they managed that before with other released… given the quality of the software that seems realy hard - or not?How does google manage to keep its developments secret? One random though is: keeping a secret is much easier if you have control over everyone's search engine and can decided what shows up and what not…
Just thinking of this it shows again the power the search engine company has over the user… Perhaps I should again get used to searching regularly with different search engines (e.g. http://www.cuil.com/ crawls and have their own index). Perhaps there could be a small project to create a search site that combines results from different sources (... hostory repeats... metasearch engines were popular in the 90s before altavista came along).
PS: seems that the new browser works reasonably fast and rendering is OK.
The conference on mobile human computer interaction (MobileHCI 2008) started today in Amsterdam with the tutorial and workshop day.
I am chairing the tutorials and we tried a new approach for the tutorial, having 6 sessions/chapters that all together make up an introduction to mobile HCI. After 10 years of mobile HCI it seems important to help new members of the community to quickly learn about the field. The presentations were given by experts in the field that had 1 hour each for their topics. We had unexpected high attendence (the room with 100 seats was nearly always full). Have a look at the slides:
Scott gave an overview of different input means (e.g. key-based, stylus, predictive, virtual keyboard), parameters relevant for designing and assessing mobile text input (e.g., writing speed, cognitive load) and issues related to the context of use (e.g., walking/standing).
Mobile GUIs and Mobile Visualization by Patrick Baudisch
Patrick introduced input and output options for mobile devices. He will talk about the design process, prototyping and assessment of user interfaces, trade-offs related to the design of mobile GUIs and different possible interaction styles.
Mirjana discussed different means for studying mobile user needs and evaluating the user experience. This includes explorative studies and formal evaluations (in the lab vs. in the field), including longitudinal pilot deployments. The lecture discusses traditional HCI methods of user research and how they need to be adapted for different mobile contexts and products.
Albrecht gave an overview of work in context-awareness and activity recognition that is related to mobile HCI. He discussed how sharing of context in communication applications can improve the user experience. The lecture explained how perception and sensing can be used to acquire context and activity information and show examples how such information can be exploited.
Haptics, audio output and sensor input in mobile HCI by Stephen Brewster
Stephen discussed the design space for haptics, audio output as well as sensor and gesture input in mobile HCI. Furthermore he assessed resulting interaction methods and implications for the interactive experience.
Camera-based interaction and interaction with public displays by Michael Rohs
Michael introduced camera based interaction with mobile devices; this included a assessment of optical markers, 2D-barcodes and optical flow as well as techniques related to augmented reality. In this context he addressed interaction with public displays, too.
It seems that many people share the observation that emotions and culture play a more and more important role in the design of services and applications – even outside the research labs. One evening we looked for the Finnish experience… (photo by Paul)
Overall the workshop showed again how many ideas can be created in a very short time – hopefully we can follow up some of them and create some new means for communication. We plan to meet again towards the end of the year in Essen.
PS: Kiss the phone – some take it literarily: http://tech.uk.msn.com/news/article.aspx?cp-documentid=7770403
PPS: we talked about unanticipated use (some call it misuse) of technology, e.g. using the camera on the phone to take a picture of the inside of your fridge instead of writing a shopping list. Alternative uses is not restricted to mobile phones - see for yourself what you dishwasher may be good for.... http://www.salon.com/nov96/salmon961118.html
We hope we gave some advise – can resist to repeat the most important thing to remember:
A good discussion on doing a PhD in computer science by Jakob Bardram can be found at [3].
[1] Roto, V., Popescu, A., Koivisto, A., and Vartiainen, E. 2006. Minimap: a web page visualization method for mobile phones. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Montréal, Québec, Canada, April 22 - 27, 2006). CHI '06. ACM, New York, NY, 35-44. DOI= http://doi.acm.org/10.1145/1124772.1124779
[2] Lehikoinen, J. T. and Kaikkonen, A. 2006. PePe field study: constructing meanings for locations in the context of mobile presence. In Proceedings of the 8th Conference on Human-Computer interaction with Mobile Devices and Services (Helsinki, Finland, September 12 - 15, 2006). MobileHCI '06, vol. 159. ACM, New York, NY, 53-60. DOI= http://doi.acm.org/10.1145/1152215.1152228
[3] http://www.itu.dk/people/bardram/pmwiki/pmwiki.php?n=Main.ArtPhD
Christian Kray and I were colleagues in Lancaster for a very short time – he just joined the university when I left for Munich. After his post-doc in Lancaster he moved to a position in Newcastle.His work at the cross roads of mobile interaction and public displays is very exciting. In particular he investigates interesting concepts related to visual codes – some aspects to these ideas are discussed in “Swiss Army Knife meets Camera Phone” [1]. His new prototypes are really cool and I look forward to see/read more about them.
We realized that there are many areas where we have common interests. Perhaps there is a chance in the future to work together on some of the ideas discussed!
[1] Swiss Army Knife meets Camera Phone: Tool Selection and Interaction using Visual Markers. C. Kray and M. Rohs. (2007) In "Workshop on Mobile Interaction with the Real World at Mobile HCI 2007". Singapore, September 9, 2007.
Today Matthias Kranz defended his PhD thesis „Engineering Perceptive User Interfaces“ successfully at the University of Munich! Congratulations… and remember "Training to become a Jedi is not an easy challenge. And even if you succeed, it's a hard life." (Qui-Gon Jinn, Star Wars Episode I: The Phantom Menace)
The personalized doctoral hat is a German tradition –and Matthias got a fully functional prototype of a perceptive doctoral hat (following the modification and restriction approach suggested in his thesis, but created without end-user involvement to keep the surprise ;-) Insider hint: http://en.wikipedia.org/wiki/Microfilm - just don’t!
Nicolas, who was the first BSc student I worked with in Lancaster, is now after finishing his PhD with Microsoft Research in Cambridge, UK. He came on Friday to Essen to see the lab and he brought us a Voodoo I/O box [1] – we are really excited!
Some references to remember: [1] Spiessl, W., Villar, N., Gellersen, H., and Schmidt, A. 2007. VoodooFlash: authoring across physical and digital form. In Proceedings of the 1st international Conference on Tangible and Embedded interaction (Baton Rouge, Louisiana, February 15 - 17, 2007). TEI '07. ACM, New York, NY, 97-100. DOI= http://doi.acm.org/10.1145/1226969.1226989
From Friday to Sunday I was in Potsdam for the yearly Emmy Noether meeting organized by DFG (German Science Foundation). The Emmy Noether Program seems to me one of the most attractive funding options for early career researchers I know of (world wide).
This year I was in the preparation team for the meeting and was co-organizing one workshop where we discussed experiences with research funding in other countries and what ideas for improving current programs we can see. The workshop was on how we can benefit from having students rather than seeing them as “teaching load” – especially in computer science (I organized it with Andreas Butz).
The meeting is always very interesting as it brings together people, funded by DFG in the Emmy Noether Program, across all disciplines. In the political evening we had a keynote by Professor Hans Weiler looking at the current problems of the German systems ("Eliten im Wettbewerb - Die deutschen Hochschulen und die internationale Konkurrenz" ) – one message I saw in the talk is that Germany is very efficient – looking how little money is spend in education and research the outcome is surprising. (But this is only a positive message if we do not want to play a leading role in the world of science and technology). It became very clear that the overall system lacks massively in funding. The additional funding that is provided by the German Government in the widely publicized call for elite universities (Exzellenzinitiative) is 1900 million Euros over 5 years (about 5€/citizen/year)– impressive? Not really – this less than the amount projected for the “Yale Tomorrow” campaign – a 5 year program in fundraising by a single University in the US. And Stanford University has even a bigger campaign as Prof. Weiler told – and there are a few other Universities in the league in the US...
When we re-entered South Korea I saw guard looking with an infrared camera at all arriving people. It was very hot outside so the heads were very red. My assumption is that this is used to spot people who have fever – however I could not verify this.
[see the whole set of photos from tour to North Korea]
The sightseeing was magnificent – see the photos of the tour for yourself. We went onto the Kaesong tour (see http://www.ikaesong.com/ - in Korea only) It is hard to tell how much of the real North Korea we really saw. And the photos only reflect a positive selection of motives (leaving out soldiers, people in town, ordinary buildings, etc. as it is explicitly forbidden to take photos of those). I was really surprise when leaving the country they check ALL the pictures you took (in my case it took a little longer as it was 350 photos).
The towns and villages are completely different from what I have seen so far. No cars (besides police/emergency services/army/tourist busses) – but many people in the street walking or cycling. There were some buses in a yard but I have not seen public transport in operation. It seemed the convoy of 14 tourist buses is an attraction to the local people…
Norbert gave an interesting overview of research in the domain of ubicomp based on his personal experience – from Xerox PARC to the disappearing computer. He motivated the transition from Information Design to Experience Design. Throughout the work we see a trade-off between providing “smart support” to the user and “privacy” (or control over privacy). One of the questions if we will re-invent privacy or if it will become a commodity…
I gave a talk on “Human Interaction in Ubicomp -Magic beyond the screen” highlighting work in user interfaces beyond the screen that we did over the last years. It is motivated by the facts that classical limitations in computer science (e.g. frame rate, processing, storage) are getting less and less important to many application areas and that the human computer interaction becomes in many areas the critical part of the system.
His talk focused on the domain of virtual reality with a focus on learning/training applications. One central thing I learned is that the timing of non-verbal cues (e.g. nodding) is very crucial to produce an engagement in speaking with an agent. This may also be interesting for other forms of computer created feedback.
Motivated by the vision that after the personal computer we will see the “Personal Robot” Daijin investigates natural ways to interact with robots. For vision based interaction with robots he named a set of difficulties, in particular: people are moving, robots are moving, and the illuminations and distances are variable. The proposed approach is to generate a pose, expression, and illumination specific active appearance model.
Steven showed some work mobile projector and mobile device interaction, were they used augmented reality for prototyping different interaction methods. He introduced Spot-light (position based interaction), orientation based interaction and widget-based interaction for an arm mounted projector. Using the synaptic touchpad and projection may also be an option for our car-ui related research. For interaction with a wrist device (e.g. a watch) he introduced the string-based interaction which is a simple but exciting idea. You pull out a string of a device and the distances as well as the direction are the resulting input parameters [2].Finally some random things to remember:
[4] Richard W. DeVaul. The Memory Glasses: Wearable Computing for Just-in-Time Memory Support. PhD Thesis. MIT 2004. http://devaul.net/~rich/DeVaulDissertation.pdf
[5] Poel, M., Breemen, A.v., Nijholt, A., Heylen, D.K., & Meulemans, M. (2007). Gaze behavior, believability, likability and the iCat. Proceedings Sixth Workshop on Social Intelligence Design: CTIT Workshop Proceedings Series (pp. 109–124). http://www.vf.utwente.nl/~anijholt/artikelen/sid2007-1.pdf