Traditionally, perceptual research has been compartmentalized into distinct and isolated categories according to individual modalities (i.e., visual, auditory, haptic, proprioceptive, vestibular, etc.).  This modular approach has treated individual sensory and motor processing as involving largely independent systems.  However, recently investigators are recognizing the importance of understanding cross-modal interactions and how they relate to perception and behaviour.

Much of the multisensory research up until this point has focused upon tasks involving discrete stimulus presentations in near body space. Such cue interactions of interest have included: visual-auditory integration, visual-proprioceptive integration, or visual-haptic integration. It is important, however, to investigate multisensory integration from the perspective of large-scale self-motion through action space. Unlike traditional approaches to examining the integration of two specific cues at a particular instance in time, navigating through one’s environment requires the dynamic integration of several cues across space and over time (i.e., visual flow, lower-limb proprioception, and vestibular information).  Understanding the principles underlying multimodal integration in this context of unfolding cue dynamics is very important as it provides insight into an important category of multisensory processing.

◘ Multi-sensory integration in the estimation of distance traveled
◘ Contribution of inertial information to the perception of walking speed
◘ Perception of visual speed while walking
◘ Adaptive treadmill control
◘ Vestibular perception is slow
◘ Perceived object stability
◘ Shape from shading

Perceived object stability

Knowing an object's physical stability affects our expectations about its behaviour and our interactions with it. Objects topple over when the gravity-projected centre-of-mass (COM) lies outside the support area. The critical angle (CA) is the orientation for which an object is perceived to be equally likely to topple over or right itself, which is influenced by global shape information about an object's COM and its orientation relative to gravity. When observers lie on their sides, the perceived direction of gravity is tilted towards the body. Here we investigate the contribution of the orientation of the body when estimating the stability of objects. Our initial investigation tested the hypothesis that the CA of falling objects is affected by the internal representation of gravity rather than the direction of physical gravity. Observers sat upright or lay left- or right-side-down, and observed images of objects with different 3D mass distributions that were placed close to the right edge of a table in various orientations. Observers indicated whether the objects were more likely to fall back onto or off the table. The subjective visual vertical was also tested as a measure of perceived gravity. Our results show the CA increases when lying right-side-down and decreases when left-side-down relative to an upright posture, consistent with estimating the stability of rightward falling objects as relative to perceived and not physical gravity. The next phase of our investigations will assess the extent to which physical and perceived gravity affect the CA in the absence of visual orientation cues and when the body is put in multiple orientations relative to gravity using the KUKA motion simulator.

REFERENCE
◘ Fleming, R. W. , M. Barnett-Cowan and H. H. Bülthoff: Perceived object stability is affected by the internal representation of gravity. European Conference on Visual Perception 2010