Silvia Miksch talking about time oriented visual analytics

It seems this term we picked a good slot for the lecture. On Thursday we had Prof. Silvia Miksch from Vienna University of Technology visiting our institute. We took this chance for another guest lecture in my advanced HCI class. Silvia presented a talk with the title “A Matter of Time: Interactive Visual Analytics of Time-Oriented Data and Information”. She first introduced the notion of interactive visual analytics and then systematically showed how time oriented data can be visually presented.

I really liked how Silvia motivated visual analytics and could not resist to adapt it with a Christmas theme. The picture shows three representations (1) numbers, always 3 grouped together, (2) a plot of the numbers where the first is the label and the second and the third are coordinates, and (3) a line connecting the labels in order. Her example was much nicer, but I missed to take a photo. And it is obvious that you do not put it on the same slide... Nevertheless I think even this simple Christmas tree example shows the power of visual analytics. This will go in my slide set for presentations in schools ;-)

If you are more interested in the details of the visualization of time oriented data, please have a look at the following book: Visallization of Time-Oriented Data, by Wolfgang Aigner, Silvia Miksch, Heidrun Schumann, and Christian Tominski. Springer, 2011. http://www.timeviz.net [2]. After the talk there was an interested discussion about the relationship and fundamental difference between time and space. I think this is worthwhile further discussion.

Another direction to follow up is tangible (visual) analytics. It would be interesting to assess the contributions to understanding of further modalities when interactively exploring data, e.g. haptics and sound. Some years back Martin Schrittenloher (one of my students in Munich) visited Morten Fjeld for his project thesis and experimented with force feedback sliders [1], … perhaps we should have this as a project topic again! An approach would be to look specifically at the understanding of data when force-feedback is presented on certain dimensions.

References
[1] Jenaro, J., Shahrokni, A., Schrittenloher, and M., Fjeld, M. 2007. One-Dimensional Force Feedback Slider: Digital platform. In Proc. Workshop at the IEEE Virtual Reality 2007 Conference: Mixed Reality User Interfaces: Specification, Authoring, Adaptation (MRUI07), 47-51
[2] Wolfgang Aigner, Silvia Miksch, Heidrun Schumann, and Christian Tominski. Visallization of Time-Oriented Data. Springer, 2011. http://www.timeviz.net

TEI growing up, Dinner with Hiroshi Ishii and Don Norman

This is now the 5th TEI conference and it has about 300 people attending. It is still a very young community, with many students attending, but also the "big names" are at the conference. When Brygg and I started with a small conference in 2007 (in Baton Rouge) and 2008 (in Bonn) we considered there is a need for tangible and embedded interaction work to find a venue but we did not expect that the community was growing so rapidly. Looking at the presentations and contributions show at this year's conference it is clear that the conference is growing up - without losing its exciting mix of contributions.

It is great to talk to Don Norman and Hiroshi Ishii over dinner and seeing them engaging with this young community. They both have made major contributions to this community and have inspired my personal research some 10 years back. If you have not done so I recommend to read some of their early contributions, such as Hiroshi's CHI1997 paper [1,2] and Don's invisible computing book [3,4]. Both have published and publish many interesting articles and books which are central to the HCI literature, check out their web pages: Hiroshi Ishii and Don Norman.

[1] Ishii, H. and Ullmer, B., "Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms," Proceedings of Conference on Human Factors in Computing Systems (CHI '97), ACM, Atlanta, March 1997, pp. 234-241.

[2] Fitzmaurice, G., Ishii, H., Buxton, W., "Bricks: Laying the Foundations for Graspable User Interfaces," Proceedings of Conference on Human Factors in Computing Systems (CHI '95), ACM, Denver, May 1995, pp. 442-449.

[3] Donald Norman, The Invisible Computer. 1998, Cambridge MA, MIT Press

[4] Donald Norman, The design of Everyday Objects, 2002 Basic Books (Perseus)

Do tangible user interface make sense? Yes they are a great design tool.

The question "Do tangible user interface make sense?" is a question that probably everyone who seriously works in this field has asked themselves once in a while.

Seeing the iPhone and iPod app of the people doing the reactable made me think about this question again! What is really - in the use case of the reactbale the value of the physical over the touch screen? Or is it just sentimental and old school to believe in the physical? Not sure … needs probably some more thinking and research ;-)

One other points which this example underlines is that tangible interaction is a great design tool (still in the process of writing a paper about this - but here the basic idea for discussion). And I strongly believe that this is a great value for user interface design in general. I suggest the following approach:

1. Analyze your task
2. Find data elements that can be made tangible
3. Find operators/manipulators on the data elements that can be made tangible
4. Create a tangible user interface to realize all the interaction required
5. Port it to a touch screen or conventional user interface

The steps 1-4 will ensure simplicity and in step 5 you may lose some of the "ah" and "wow" but it is very likely that you have created a usable and simple interface!

German Workshop on Tangible Interaction

Friday and Saturday we hosted the GI working groups on tangible interaction (GI Arbeitskreis Be-greifbare Interaction in gemischten Wirklichkeiten) for the second inventor's workshop. We were positively surprised that more than 30 people took part. We started with a set of nice demos from our students and then Nicolas Villar presented an invited talk.

The concept of the workshop was to create ideas by looking more closely at different materials that may be used for interaction and by assessing novel interaction technologies. On Friday afternoon we had several tables with material (e.g. smart materials, conductive fabric, magnetic materials, etc.) and technologies (e.g. VoodooIO, EduWear kit, Physiological sensing based on the Nexus system). We bought a set of materials from MUTR Teaching Materials. In groups the participants create many design ideas by imagining a certain technology to be used in a specific context.

The social event was at the unperfekthaus.de in Essen - if you visit Essen this is a "must see". The concept is unique!

On Saturday we started with an exercise to investigate the qualities of tangible UIs in comparison to traditional GUIs. For this we looked at different games (e.g. Space invaders, Super Mario, Sims, Halo) and though how we would make them more tangible and what pros and cons are there for the tangible and GUI version. In this context we also discussed the approach of exertion interfaces [1].

The rest of the morning was spent working on more concrete ideas for the concepts created on Friday afternoon - with remarkable results - see the Wiki for details.

[1] http://exertioninterfaces.com/

Tangible, Embedded, and Reality-Based Interaction

Together with Antonio's group we looked at new forms of interaction beyond the desktop. The journal paper Tangible, Embedded, and Reality-Based Interaction [1] gives overview and examples of recent trends in human computer interaction and is a good starting point to learn about these topics.

Abstract: Tangible, embedded, and reality-based interaction are among novel concepts of interaction design that will change our usage of computers and be part of our daily life in coming years. In this article, we present an overview of the research area of tangible, embedded, and reality-based interaction as an area of media informatics. Potentials and challenges are demonstrated with four selected case studies from our research work.

[1] Tanja Döring, Antonio Krüger, Albrecht Schmidt, Johannes Schöning: Tangible, Embedded, and Reality-Based Interaction. it - Information Technology 51 (2009) 6 , S. 319-324. (pdf)
http://www.it-information-technology.de/

Online Shop for Smart Materials and More

We are in Newcastle for a Workshop working on a new idea for tangible UIs that can be easily customized. The basic idea is to senparate functional parts of the system (electronics etc.) from the shell/tangible components of a devices. By this we hope to support innovation in a sustainable way. The skin of the appliance is printed (in 3D).

Nic Villar came up from Cambridge and he showed us some interesting materials... and obviously there is a shop (materials.
http://www.mutr.co.uk/) to get those... Look in the section for smart materials - there are probably many ideas hidden for now interface technologies - not only for tangible UIs.

We discussed how Polymorph could be used in tangible UIs - I think the challenge is to electronically control the material... obviously we played with the material to get ideas :-)

Auto-UI 2009 and TEI2010 - deadlines not to miss -

Next week is the early registration deadline for the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 2009) and the poster call is still open.

This year the deadline for submitting papers to TEI 2010 is much earlier than in previous years! It is the 10th of August (and was already extended)…

Steve Hinske defents his PhD Thesis at ETH Zurich

"Sounds like a fun project" was my first reaction when I read some time back the first paper on Steve's work on augmented toys and augmented games. Reading through his thesis and seeing more of his papers it seems there was a lot of hard work, too.

Thinking more about it I was wondering how toys are really going to change in the future and to what extent this is going to happen. Technically a lot is feasible as it is well demonstrated by Steve in his thesis (photo from www.vs.inf.ethz.ch); if you do not have time to read the thesis I recommend to look at two of his papers: [1] and [2]. They give a good overview of the systems he created. In the discussion we could see that there can be very interesting business model involving third party developers for such toys.

… but nevertheless the playing experience is something very special and I would bet the augmented toys will come but the ordinary non-augmented dolls will stay.

PS: The cafeteria at ETH provided another example of my collection "if you need a sign/label - you have got the UI design wrong" - great example how gestalt law would have been so easy and arrows look so bad ;-)

[1] Hinske, S. and Langheinrich, M. 2009. W41K: digitally augmenting traditional game environments. In Proceedings of the 3rd international Conference on Tangible and Embedded interaction (Cambridge, United Kingdom, February 16 - 18, 2009). TEI '09. ACM, New York, NY, 99-106. DOI= http://doi.acm.org/10.1145/1517664.1517691

[2] Hinske, S., Langheinrich, M., and Lampe, M. 2008. Towards guidelines for designing augmented toy environments. InProceedings of the 7th ACM Conference on Designing interactive Systems (Cape Town, South Africa, February 25 - 27, 2008). DIS '08. ACM, New York, NY, 78-87. DOI= http://doi.acm.org/10.1145/1394445.1394454

Morten Fjeld visiting

On his way from Eindhoven to Zurich Morten Fjeld was visiting our group. It was great to catch up and talk about a number of exciting research projects and ideas. Some years ago one of my students from Munich did his final project with Morten working on haptic communication ideas, see [1]. Last year at TEI Morten had a paper on a related project - also using actuated sliders, see [2].

In his presentation Morten gave an overview of the research he does and we found a joint interest in capacitive sensing. Raphael Wimmer did his final project in Munich on capacitive sensing for embedded interaction which was published in Percom 2007, see [3]. Raphael has continued the work for more details and the open source hardware and software see http://capsense.org. Morten has a cool paper (combing a keyboard and capacitive sensing) at Interact 2009 - so check the program when it is out.

We talked about interaction and optical tracking and that reminded me that we wanted to see how useful the touchless SDK (http://www.codeplex.com/touchless) could be for final projects and exercise. Matthias Kranz had used it successfully with students in Linz in the unconventional user interfaces class.

[1] Jenaro, J., Shahrokni, A., Schrittenloher, and M., Fjeld, M. 2007. One-Dimensional Force Feedback Slider: Digital platform. In Proc. Workshop at the IEEE Virtual Reality 2007 Conference: Mixed Reality User Interfaces: Specification, Authoring, Adaptation (MRUI07), 47-51

[2] Gabriel, R., Sandsjö, J., Shahrokni, A., and Fjeld, M. 2008. BounceSlider: actuated sliders for music performance and composition. In Proceedings of the 2nd international Conference on Tangible and Embedded interaction (Bonn, Germany, February 18 - 20, 2008). TEI '08. ACM, New York, NY, 127-130. DOI= http://doi.acm.org/10.1145/1347390.1347418

[3] Wimmer, R., Kranz, M., Boring, S., and Schmidt, A. 2007. A Capacitive Sensing Toolkit for Pervasive Activity Detection and Recognition. In Proceedings of the Fifth IEEE international Conference on Pervasive Computing and Communications (March 19 - 23, 2007). PERCOM. IEEE Computer Society, Washington, DC, 171-180. DOI= http://dx.doi.org/10.1109/PERCOM.2007.1

Offline Tangible User Interface

When shopping for a sofa I used an interesting tangible user interface - magnetic stickers. For each of the sofas systems the customer can create their own configuration using these magnetic stickers on a background (everything in a scale 1:50).

After the user is happy with the configuration the shop assistant makes a xerox copy (I said I do not need a black and white copy I make my own color copy with the phone) and calculates the price and writes up an order. The interaction with the pieces is very good and also great as a shared interface - much nicer than comparable systems that are screen based. I could imaging with a bit of effort one could create a phone application that scans the customer design, calculates the prices, and provides a rendered image of the configuration - with the chosen color (in our case green ;-). Could be an interesting student project…

Special Issue on Tangible and Embedded Interaction

Together Eva Eva Hornecker and Brygg Ullmer I was guest editor for a special issue of the International Journal of Arts and Technology (IJART) on the topic of Tangible and Embedded Interaction. The issue contains 6 papers that look at very different aspects of this topic.

Have a look at the editorial (it is openly accessible) for an overview of the papers in the issue.

Demo day at TEI in Cambridge

What is a simple and cheap way to get from Saarbrücken to Linz? It's not really obvious, but going via Stansted/Cambridge makes sense - especially when there is the conference on Tangible and Embedded Interaction (www.tei-conf.org) and Raynair offers 10€ flight (not sure about sustainability though). Sustainability, from a different perspective was also at the center of the Monday Keynote by Tom Igeo which I missed.

Nicolas and Sharam did a great job and the choice to do a full day of demos worked out great. The large set of interactive demos presented captures and communicates a lot of the spirit of the community. To get an overview of the demos one has to read through the proceedings (will post a link as soon as they are online in the ACM-DL) as there are too many to discuss them here.

Nevertheless here is my random pick:

One big topic is tangible interaction on surfaces. Several examples showed how interactive surfaces can be combined with physical artifacts to make interaction more graspable. Jan Borcher's group showed a table with passive controls that are recognized when placed on the table and they provide tangible means for interaction (e.g. keyboard keys, knobs, etc.). An interesting effect is that the labeling of the controls can be done dynamically.

Microsoft research showed an impressive novel table top display that allows two images to be projected - on the interactive surface and one on the objects above [1]. It was presented at large year's UIST but I have tried it out now for the first time - and it is a stunning effect. Have a look at the paper (and before you read the details make a guess how it is implemented - at the demo most people guessed wrong ;-)

Embedding sensing into artifacts to create a digital representation has always been a topic in tangible - even back to the early work of Hiroshi Ishii on Triangles [2]. One interesting example in this year's demo was a set of cardboard pieces that are held together by hinges. Each hinge is technically realized as a potentiometer and by measuring the potion the structure can be determined. It is really interesting to think this further.

Conferences like TEI let you inevitably think about the feasibility of programmable matter - and there is ongoing work in this in the robotics community. The idea is to create micro-robots that can create arbitrary shapes - for a starting point see the work at CMU on Claytronics.

[1] Izadi, S., Hodges, S., Taylor, S., Rosenfeld, D., Villar, N., Butler, A., and Westhues, J. 2008. Going beyond the display: a surface technology with an electronically switchable diffuser. In Proceedings of the 21st Annual ACM Symposium on User interface Software and Technology (Monterey, CA, USA, October 19 - 22, 2008). UIST '08. ACM, New York, NY, 269-278. DOI= http://doi.acm.org/10.1145/1449715.1449760

[2] Gorbet, M. G., Orth, M., and Ishii, H. 1998. Triangles: tangible interface for manipulation and exploration of digital information topography. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Los Angeles, California, United States, April 18 - 23, 1998). C. Karat, A. Lund, J. Coutaz, and J. Karat, Eds. Conference on Human Factors in Computing Systems. ACM Press/Addison-Wesley Publishing Co., New York, NY, 49-56. DOI= http://doi.acm.org/10.1145/274644.274652

Design Ideas and Demos at FH Potsdam

During the workshop last week in Potsdam we got to see demos from students of Design of Physical and Virtual Interfaces class taught by Reto Wettach and JennyLC Chowdhury. The students had to design a working prototype of an interactive system. As base technology most of them use the Arduino Board with some custom made extensions. For a set of pictures see my photo gallery and the photos on flickr. It would need pages to describe all of the projects so I picked few...

The project “Navel” (by Juan Avellanosa, Florian Schulz and Michael Härtel) is a belt with tactile output, similar to [1], [2] and [3]. The first idea along this lines that I have tried out was Gentle Guide [4] at mobile HCI 2003 – it seemed quite compelling. The student project proposed one novel application idea: to use it in sport. That is quite interesting and could complement ideas proposed in [5].

Vivien's favorite was the vibrating doormat; a system where a foot mat is constructed of three vibrating tiles that can be controlled and different vibration patters can be presented. It was built by Lionel Michel and he has several ideas what research questions this could address. I found especially the question if and how one can induce feelings and emotions with such a system. In the same application context (doormat) another prototype looked at emotions, too. If you stroke or pat this mat it comes out of its hiding place (Roll-o-mat by Bastian Schulz).

There were several projects on giving everyday objects more personality (e.g. a Talking Trashbin by Gerd-Hinnerk Winck) and making them emotional reactive (e.g. lights that reacted to proximity). Firefly (by Marc Tiedemann) is one example how reactiveness and motion that is hard to predict can lead to an interesting user experience. The movement appears really similar to a real firefly.

Embedding Information has been an important topic in our research over the last years [6] - the demos provided several interesting examples: a cable that visualized energy consumption and keyboard to leave messages. I learned a further example of an idea/patent application where information is included in the object – in this case in a tea bag. This is an extreme case but I think looking into the future (and assuming that we get sustainable and bio-degradable electronics) it indicates an interesting direction and pushing the idea of Information at your fingertip (Bill Gates Keynote in 1994) much further than originally intended.

For more photos see my photo gallery and the photos on flickr.

[1] Tsukada, K. and Yasumrua, M.: ActiveBelt: Belt-type Wearable Tactile Display for Directional Navigation, Proceedings of UbiComp2004, Springer LNCS3205, pp.384-399 (2004).

[2] Alois Ferscha et al. Vibro-Tactile Space-Awareness . Video Paper, adjunct proceedings of Ubicomp2008. Paper. Video.

[3] Heuten, W., Henze, N., Boll, S., and Pielot, M. 2008. Tactile wayfinder: a non-visual support system for wayfinding. In Proceedings of the 5th Nordic Conference on Human-Computer interaction: Building Bridges (Lund, Sweden, October 20 - 22, 2008). NordiCHI '08, vol. 358. ACM, New York, NY, 172-181. DOI= http://doi.acm.org/10.1145/1463160.1463179

[4] S.Bosman, B.Groenendaal, J.W.Findlater, T.Visser, M.de Graaf & P.Markopoulos . GentleGuide: An exploration of haptic output for indoors pedestrian guidance . Mobile HCI 2003.

[5] Mitchell Page, Andrew Vande Moere: Evaluating a Wearable Display Jersey for Augmenting Team Sports Awareness. Pervasive 2007. 91-108

[6] Albrecht Schmidt, Matthias Kranz, Paul Holleis. Embedded Information. UbiComp 2004, Workshop 'Ubiquitous Display Environments', September 2004

Towards interaction that is begreifbar

Since last year we have in Germany a working group on graspable/tangible interaction in mixed realities.

In German the key term we use is “begreifbar” or “begreifen” which has the meaning of acquire a deep understanding of something and the words basic meaning is to touch. Basically understand by touching – but in a more fundamental sense than grasping or getting grip. Hence the list of translations for “begreifen” given in the dictionary is quite long.

Perhaps we should push more for the word in the international community – Towards interaction that is begreifbar (English has too few foreign terms anyway ;-)

This meeting was organized by Reto Wettach at Potsdam and the objective was to have two days to invent things together. The mix of people mainly included people from computer science and design. It is always amazing how many ideas come up if you put 25 people for a day in a room :-) We followed this week up on some of the ideas related to new means for communication – there are defiantly interesting student projects on this topic.

In the evening we had a half pecha-kucha (each person 10 slides of 20 seconds – in total 3:20, the original is 20 slides) http://www.pecha-kucha.org/. It is a great way of getting quickly to know about work, research, ideas, and background of other people. It could be format we could use more in teaching a perhaps for ad-hoc sessions at a new conference we plan (e.g. http://auto-ui.org) … prepared my slides on the train in the morning – and it is more challenging that expected to get a set of meaningful pictures together for 10 slides.

Overall the workshop showed that there is a significant interest and expertise in Germany moving from software ergonomics to modern human computer interaction.

There is a new person on our team (starting next week) – perhaps you can spot him on the pics.

For a set of pictures see my photo gallery and the photos on flickr.

Two basic references for interaction byond the desktop

Following the workshop I got a few questions on what the important papers are that one should read to start on the topic. There are many (e.g. search in google schoolar for tangible interaction, physical interaction, etc and you will see) and there conference dedicated to it (e.g. the tangible and embedded interaction TEI - next week in cambridge).

But if I have to pick two here is my joice:

[1] Ishii, H. 2008. Tangible bits: beyond pixels. In Proceedings of the 2nd international Conference on Tangible and Embedded interaction (Bonn, Germany, February 18 - 20, 2008). TEI '08. ACM, New York, NY, xv-xxv. DOI= http://doi.acm.org/10.1145/1347390.1347392

[2] Jacob, R. J., Girouard, A., Hirshfield, L. M., Horn, M. S., Shaer, O., Solovey, E. T., and Zigelbaum, J. 2008. Reality-based interaction: a framework for post-WIMP interfaces. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 - 10, 2008). CHI '08. ACM, New York, NY, 201-210. DOI= http://doi.acm.org/10.1145/1357054.1357089

Interesting interaction devices

Looking at interesting and novel interaction devices that would be challenging for students to classify (e.g. in the table suggested by Card et al 1991 [1]) I can across some pretty unusual device. Probably not really useful for an exam but perhaps next year for discussion in class…

Ever wanted to rearrange the keys on your keyboard? ErgoDex DX1 is a set of 25 keys that can be arranged on a surface to create a specific input device. It would be cool if the device could also sense which key is where – would make re-arranging part of the interaction process. In some sense it is similar to Nic Villar's Voodoo I/O [2].

Wearable computing is not dead – here is some proof ;-) JennyLC Chowdhury presents intimate controllers – basically touch sensitive underwear (a bra and briefs). Have a look at the web page or the video on youtube.

What are keyboards of the future? Each key is a display? Or is the whole keyboard a screen? I think there is too much focus on the visual und to less on the haptic – perhaps it could be interesting to have keys that change shape and where the tactile properties can be programmed… 

[1] Card, S. K., Mackinlay, J. D., and Robertson, G. G. 1991. A morphological analysis of the design space of input devices. ACM Trans. Inf. Syst. 9, 2 (Apr. 1991), 99-122. DOI= http://doi.acm.org/10.1145/123078.128726 

[2] VILLAR, N., GILLEADE, K. M., RAMDUNYELLIS, D., and GELLERSEN, H. 2007. The VoodooIO gaming kit: a real-time adaptable gaming controller. Comput. Entertain. 5, 3 (Jul. 2007), 7. DOI= http://doi.acm.org/10.1145/1316511.1316518

Technology Review with a Focus on User Interfaces

The February 2009 edition of technology review (German version) has its focus on new user interfaces and titles "Streicheln erwünscht" (translates to stroking/caressing/fondling welcome). It has a set of articles talking about new way of interacting multimodality, including tangible user interfaces and tactile communication. In the article "Feel me, touch me" by Gordon Bolduan on page 74 a photo of Dagmar's prototype of tactile steering wheel is depicted. The full paper on the study will be published at Pervasive in May 2009 (so you have to be patient to get the details - or come and visit our lab ;-)

In the blog entry of technology review  introducing the current issue there is a nice anecdote mentioned about a literature search on haptic/tactile remote communication (while I was still in Munich) - the final version of the seminar paper (now not X-rated anymore) is "Neue Formen der entfernten Kommunikation" by Martin Schrittenloher. He continued in his MSc Project on the topic and worked with Morten Fjeld  on sliders that give remote feedback, see [1].

Another topic closely related is to new forms of communication are exertion interfaces (we looked at the 2002/2003 work Florian 'Floyd' Mueller in the UIE lecture yesterday - even with the Nintendo Wii around the work is highly inspiring and impressive, see [2]). The communication example given in Breakout for Two is showing the potential of including the whole body in communication tasks. Watching the video  is really to recommend :-)

[1] Jenaro, J., Shahrokni, A., Schrittenloher, and M., Fjeld, M. 2007. One-Dimensional Force Feedback Slider: Digital platform. In Proc. Workshop at the IEEE Virtual Reality 2007 Conference: Mixed Reality User Interfaces: Specification, Authoring, Adaptation (MRUI07), 47-51

[2] Mueller, F., Agamanolis, S., and Picard, R. 2003. Exertion interfaces: sports over a distance for social bonding and fun. InProceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA, April 05 - 10, 2003). CHI '03. ACM, New York, NY, 561-568. DOI= http://doi.acm.org/10.1145/642611.642709  

Mechanical Computing, Beauty of Calculating Machines

Instead of covering the history of calculating machines in the DSD lecture, we took the train and went to the Arithmeum in Bonn to the see the artefacts live and to play with some of them.

We started with early means for counting and record keeping. The tokens and early writings did not use numbers as abstract concepts, rather as representatives of concrete objects – this is very inspiring, especially from a tangible interaction point of view. The knots, as used in south America, show impressively how the tools for calculation have to fit the context people live in. Interestingly all these artefacts highliht how the ability to calculate and store information is related to the ability to do trade – quite a good motivation for the setup we have in Essen business studies and computer science within one faculty.

I was again impressed by the ingenuity by the early inventers of calculating tools and machines. There is an interesting separation between calculating tools and machines – the first ones require the user to take care of the carry and the second do it by themselves. We tried out replicas of Napier’s calculating tool and Schickard’s calculating machine.

The beauty and the mechanical precision required of those early machines is impressive. These prototypes (most of them took years and massive funds to be built complete) can teach us something for research today. These inventors had visions and the will to get it implemented, even without a clear application or business model in mind. They were excited by the creating of systems than can do things, machines could not do before. From the professions of the inventors (e.g. Philipp Matthäus Hahn was a clergyman)  it becomes apparent that at these times some considered religion and calculation as closely related - which to mondern understanding is very very alien.

Seeing the Hollerith machine that was used for the US census more than 100 years ago can teach you a lot about data processing. Punch cards, electrical reading and electrical counters (using mainly relays) were the basis for this technology. Looking at the labels on the counters showed that the US has a long tradition in collecting data that is after some time is not seen as political correct ;-)

Having learned binary calculations during the DSD course it was nice to see a machine that did binary additions, using small steel balls and gravity. On each place (1,2,4,8, …) there is space for one ball. If a second one comes to this place one moves up to the next place (carry) and one is discarded. This is implemented with very simple mechanics and the working prototype (recently build) is based on designs of Schickard (but he never built - if I am correct).

Moving on with binary systems and finally to silicon, we got to see the Busicom 141 - a desk calculator that uses the Intel 4004. It is impressive to see that this is not even 40 years ago – starting with 2300 transistors and 180kHz. 

you can find the full set of photos at: http://foto.ubisys.org/dsd0809/

Article on Tangible UIs in the c't-Magazine

The current issue of the ct-Magazine (one of the largest computing magazines in Germany) features an introductory article on tangible user interfaces (in German).

The article is based on three interviews (Eva Hornecker, Reto Wettach, Albrecht Schmidt) and provides a good overview on this topic for a general audience. The article is in c’t no 21, 2007, p86-88 (no online version yet).

Nicolas Villar visiting

Nicolas, who was the first BSc student I worked with in Lancaster, is now after finishing his PhD with Microsoft Research in Cambridge, UK. He came on Friday to Essen to see the lab and he brought us a Voodoo I/O box [1] – we are really excited!

He stayed for the weekend and I learned a lot about interesting technologies and ideas. Looking at his iREX ebook and Vivien's new USB Microscope (30€ from Aldi ;-) we had to do some research into the screen quality of different devices. It is interesting to see that e-Ink moves closer to newspaper and that in comparison to it an iPhone screen is pretty coarse.

Some references to remember:

• Energy harvest module at Farnell (order No. 1439949, EH301A)
• DIY 3D Priniting - http://fabathome.org/
• Hi-End 3D Printing - http://www.objet.com/
• Interesting web shop - http://www.grand-illusions.com/

[1] Spiessl, W., Villar, N., Gellersen, H., and Schmidt, A. 2007. VoodooFlash: authoring across physical and digital form. In Proceedings of the 1st international Conference on Tangible and Embedded interaction (Baton Rouge, Louisiana, February 15 - 17, 2007). TEI '07. ACM, New York, NY, 97-100. DOI= http://doi.acm.org/10.1145/1226969.1226989