Bill Baxton:

What follows is the current state of my conversion to hypertext of the original linear text version. It includes some somewhat dated information. But even that may have some historical interest.

My purpose of placing the document on the web is, first, to make it accessible to a larger community, and second, to take advantage of the ability to add links to the increasing number of relevant sources that now have a presence on the web. One of the most interesting aspects of this process has been the recognition of the extent to which this document is better suited to the hypertext format than linear text.

I welcome suggestions for additions, corrections, or any other feedback."

Information processing, with or without information technology, is of great significance today. On the one hand, the individual's role and position in a society can only be safeguarded by information skills, on the other, the information technologies have increased access to and the use of information and made them more abstract. Occupations and qualification groups which are mainly defined at information level show a high dominance in working life and in society.
Reducing human computer interaction to the traditional elements of keyboard and screen – with small additions – does not do justice to the significance of this interface. On the one hand, because these elements make only rudimentary use of the broad spectrum of human possibilities, on the other, because they are a heavy physical and psychological burden due to their one-sidedness. Steps to broaden these interfaces, as has been done in other technologies, therefore seem long overdue.
Changes in society are currently leading to a convergence in the use of information technologies in the private and business environment as well as in society as such. The significance of the different spheres of life has shifted dramatically: Neither working life nor leisure time are dominant, but rather a new area which is in between these two poles, yet provides room for activities.
If new forms of human computer interaction become established in this area in particular, they will have a massive influence on society as a whole. If they are only relevant in niches of leisure time or working life, however, they will hardly experience a breakthrough. The example of teleworking shows that technologies and new forms of organization only stand a chance under suitable framework conditions and when they meet acceptance.

The role of human-computer interaction in the future human society is discussed, and the state of the art in human-computer interaction is reviewed. A research project called “Interaction and intelligence” supported by JST (Japan Science and Technology Corporation) is presented.

The research topics of this project include integration and fusion of sensing and decision, smart actuators, intelligent interface, intelligent robots, learning machines, intelligent micro-machines, virtual reality, intelligent mechatronics, and so

Das Projekt verbindet Medieninhalte und Medientechnologien im Bereich i_TV. Ein interdisziplinäres Forschungsteam aus Künstlern, Journalisten, Wissenschaftlern und Technikern entwickelt eine Autorenplattform für Journalisten und Medienkünstler, um nicht-lineare, interaktive TV-Stories zu erstellen und besseren Zugang zu inspirierenden Inhalten aus digitalen Archiven zu ermöglichen. Als praktische Anwendung der neuen Plattform wird eine nicht lineare interaktive i-TV Story für MHP produziert.

Authoring tool for i-TV: Interactive storytelling based on Emergent methods and Dramaturgical principles
Creation of non-linear scripts for i-TV

Prototype production for i-TV: To demonstrate the performance of the developed tools
Presentation of an interactive TV test bed

Summary

Gesture Gallery is a gesture based interactive station designed for access to a wide range of materials in digital format. It provides an alternative way of interacting with museum/gallery content and makes it accessible to different audiences including children, the elderly and populations with special needs.


Gesture Gallery Interactions

Gesture Gallery allows browsing and interactions with digital content by simple hand movements (corresponding to the flipping of a newspaper page). Interactions may be synchronized with appropriate voice narration or sound effects. Supported interactions include:

. gesture-browsing of images;
. rotation of 3D objects;
. text browsing;
. browsing of audio content;
. digital video review;

Gesture Gallery interaction mechanism is intuitive and accessible to populations of all ages, including the population with special needs.

Customization:

The content one may want to make available using the Gesture Gallery is infinitely customizable. Adding a new set of images, audio or video clips, or digitized three dimensional objects consists of putting them in a designated folder. By following a simple naming convention it is possible to associate browsing of visual files with voice narration. Gesture Gallery has been already successfully used in Art Museums.

Multimodal systems process two or more combined user input modes- such as speech, pen, touch, manual gestures, gaze, and head and body movements- in a coordinated manner with multimedia system output. This class of systems represents a new direction for computing, and a paradigm shift away from conventional WIMP interfaces. Since the appearance of Bolt's (1980) "Put That There" demonstration system, which processed speech in parallel with touch-pad pointing, a variety of new multimodal systems has emerged. This new class of interfaces aims to recognize naturally occurring forms of human language and behavior, which incorporate at least one recognition-based technology (e.g., speech, pen, vision). The development of novel multimodal systems has been enabled by the myriad input and output technologies currently becoming available, including new devices and improvements in recognition-based technologies. This chapter reviews the main types of multimodal interfaces, their advantages and cognitive science underpinnings, primary features and architectural characteristics, and general research in the field of multimodal interaction and interface design.

Humans and machines are interacting ever more closely, and this is changing both the structure of human organizations and the experience of the participants. We ask how technology can enhance the individual in order to produce organizations that are more creative and efficient, and which better support the individual.

GroupMedia

GroupMedia is a set of tools and applications to enable social context awareness and quantitative intelligence on pervasive cellphones and PDAs.

Learning Humans

The purpose of this set of projects is to develop techniques for learning human behavior in an office or a social situation.

LiveNet: Distributed Wearable Healthcare Applications

Based on the premise that low-cost, minimally invasive sensing can be used to capture and predict behavior, this project attempts to use wearable technology and non-invasive sensing to extract long-term behavioral trends from an individual's life.

Marketplace of Ideas

The Marketplace of Ideas is exploring the use of digital tools in the understanding and enhancing of community social capital.

MIThril

MIThril is the next-generation research platform for body-worn interaction and sensing developed at the MIT Media Lab.

Dialog Table is a shared interface where you use hand gestures to discover more about any data set. Several people can gather around and together explore the table's movies, narratives and 3D journeys. The table provides an opportunity for people to discuss with each other their thoughts on what they have seen, whether it be an artwork or a service.
The table was originally commissioned by the Walker Art Center in Minneapolis as a permanent interface for its collection, it will open in February 2005. The first version was shown last summer at the exhibition "Strangely Familiar: Design and Everyday Life". The actual Dialog Table is version 2.

The table is a collaboration by:
Marek Walczak
Michael McAllister
Jakub Segen
Peter Kennard

Forschungsfragen (Projekt bis 2005):
• Wie genau entsteht Presence?
• Welche personalen und medialen Faktoren
fürhren zu Presence? Wie kann es gemessen
werden?
• Kann Presence als Motor für E-Learning genutzt werden ? Funktioniert das auch bei traditionellen Medien (Buch, Film, Hypertext)?
• Wie müssen Medien gestaltet sein, damit Presence-Erleben sich einstellt?
• Gibt es auch Gefahren (Sucht!)?

We often find multimedia applications that are called "interactive" media, but for which the interactions seem to be restricted to simple electronic page turning. In this paper we discuss the different aspects of interaction that we have implemented in multimedia instructional materials. Our goal is the creation of Internet-based multimedia materials that use a seminaristic instructional paradigm for encouraging coordination, cooperation and communication in distance learning.

Modern Information & Communications Influence all
Economical Sectors. Human Computer Interaction is Turning into Human Computer Cooperation and Will Support Many Trends of I&C.

Outline

• Trends which change the way of interaction
• User Interfaces and our Living Spaces
• Key Factors for market success
• Conclusion

The overall research question is: What are the specific needs of interaction support related to mobile meetings and dispersed interaction, how might these be supported, and what are the implications for current interaction models and support within CSCW (Computer Supported Cooperative Work).?

The overall conclusions related to the question stated in this thesis are that mobile interaction can be described as ongoing across mobile meetings, including both co -located face-to-face and dispersed interaction. Further, the interaction is maintained by the mobile workers through their efforts of re-establishing different threads of interaction across co -located and dispersed settings. Overall: There is a need to bridge co-located and dispersed meetings with sustained interaction support.