Future Human Machine Interface
Augmented Reality
Augmented Reality (AR) is a new form of human/machine interaction, in which virtual objects are superimposed in scenes filmed using a video camera in real time in such a way that they are correctly positioned in space, so augmenting the real image. In this way, the digital information merges with the user's environment. Rittal sees potential applications for AR-aided systems in the service and maintenance, digital factory and unit planning sectors, as well as in training situations.
Augmented Reality in data centres
The service and maintenance of data centres are further interesting areas of application for augmented reality. The Rittal scenario, which was presented for the first time at the 2008 Hanover Fair, offers effective support for users in the data centre monitoring and maintenance fields. At a glance, rack-based information on important parameters, such as energy consumption and enclosure internal temperatures can be displayed via a mobile PC on site. The technician on the spot thus immediately has all the relevant information at hand.
For example, if permissible temperature limits are exceeded, a red light will be shown and the user can react immediately in the event of a disturbance. Clear instructions on how to act make the work of the technician easier when maintenance interventions have to be made. The Rittal AR solution, which may in future be coupled with the wireless monitoring system, thus represents an innovative concept for the data centre of the future.
Visualisation of solutions with Augmented Reality
All the Rittal operating options at a glance - displayed virtually on a real machine, and set in a real application environment: Here too, Augmented Reality offers a technological platform. On the basis of existing 3D models of Rittal's human/machine products from RiCAD 3D, Augmented Reality animations can be created that display the infinite possibilities of the Rittal product range. This way, a huge variety of variations can be shown in a very small space at trade fairs or in showrooms, without any need to actually display the products. This concept was demonstrated for the first time at the 2008 Hanover Fair.
Visualisation of solutions at www.rittal.de »
Augmented Reality for maintenance and assembly
The core concept behind the use of augmented reality technology in maintenance and assembly applications involves superimposing assembly instructions in the form of virtual 3D objects onto the installer's field of view. According to this concept, an explanatory text may be permanently superimposed onto the installer's viewing panel, a virtual arrow may highlight a key position, or a modelled object may be added to a machine with spatial accuracy.
In close cooperation with different technology partners, such as Fraunhofer IGD, ZGDV or InnoTeamS, Rittal has been investigating for some years the possible applications of augmented reality in the area of maintenance and service.
A first demonstrator was presented in 2006 at the Hanover Fair and at the SPS in Nuremberg. An AR-supported servicing scenario was demonstrated using a recooling system as an example. Here, the installer is guided step-by-step through the maintenance process with the help of superimposed virtual information. The 3D objects are superimposed on the image in the correct position in a spatially accurate manner and provide optimal support when replacing a defective flow sensor.
Tracking, i.e. the determination of the viewer's position and viewing direction, was still marker-based in Rittal's first prototype, which therefore required the machine parts to be prepared with optical markers in the form of small plates with individual patterns. In addition, marker-based tracking is especially susceptible to contamination and changing light conditions, making it practically unsuitable for regular use in industrial applications.
For this reason, several research projects are currently concentrating on markerless object recognition. In this video-based tracking method, the image geometry is compared with the object geometry. The latter can be generated, for example, from existing CAD models.
Markerless tracking based on the detection of feature points and edges was already demonstrated at the 2007 Hanover Fair. In addition, a PDA-based augmented reality system was presented for the first time.
Rapid developments in the field of "Mobile Computing" have resulted in massive performance increases in pocket computers, PDAs and Smartphones in recent years. There are already systems on the market that support 3D computer graphics applications; and this development will continue in the coming years. These mobile systems are ideally suited for augmented reality (AR) applications and will significantly increase the applicability and acceptance of mobile AR applications.
In this system the PDA takes on the role of the graphics notebook. The service engineer uses the camera on the PDA to take a picture of the recooling unit. With the help of the marker-based tracking method, this image is registered and the multimedia animations are superimposed on it in the correct position and orientation.
In addition to that, the system also provides a teleconsulting component: In the course of the maintenance work, the service engineer activates the consultation mode and contacts, when necessary, a specialist at the service centre ("Remote Expert"). In this mode, a collaborative user interface is activated, which allows the communication between the service engineer from the PDA and the remote expert from his computer. Both the service engineer and the remote expert are able to see the images recorded by the PDA camera with the superimposed augmented reality images. In addition, both collaboration partners can add their own annotations to the images and communicate with one another during the entire maintenance process. In this way, we are making a significant step towards the idea of a "remote eye".
» Download video: Markerless tracking
» Download vdeo: Mobile Augmented Reality
» Download flyer: Augmented Reality HMI 2007
» For more information go to ULTRA
» For more information go to Fraunhofer IGD