Perception

In three experiments we examined the relative effectiveness of motion parallax and two perspective cues for the perception of size and distance. The experimental stimuli consisted of two ellipses (a standard and a comparison) and a horizontal line that indicated the horizon. The subject's task was to report the apparent size and distance of the comparison stimulus relative to the standard stimulus. Two perspective cues were given by the relative heights of the two stimuli and the absolute height of the standard stimulus below the horizon. Motion parallax was defined by both the ratio and the difference in angular velocities between the two stimuli on the display. In experiment 1 we examined the effects of the two perspective cues and the motion parallax. In experiment 2 we eliminated the horizon line, and examined the role of the horizon in size and distance perception. In experiment 3 we separately evaluated the effects of motion parallax and the relative height cues. The results from the three experiments showed that the effect of motion parallax and the two perspective cues were different in three ways. First, the relative effectiveness of motion parallax and the two perspective cues differed for size and distance estimates. For size estimates, the motion parallax was more effective than the perspective cues (experiments 1 and 3). For distance estimates, the motion parallax was as effective as the two perspective cues (experiments 1 and 3). Second, the role of the horizon differed for size and distance estimates. The size estimates were strongly affected by the horizon, while the distance estimates were not affected much by the horizon (experiment 2). Third, the effective perspective cues differed for the size estimates and the distance estimates: size estimates were affected by the perspective cues as a combination of the horizon and relative height; distance estimates were affected by the perspective cues as an interaction between the absolute and relative heights without the horizon line.

Sensory and cognitive mechanisms allow stimuli to be perceived with properties relating to sight, sound, touch, etc, and ensure, for example, that visual properties are perceived as visual experiences, rather than sounds, tastes, smells, etc. Theories of normal development can be informed by cases where this modularity breaks down, in a condition known as synaesthesia. Conventional wisdom has held that this occurs extremely rarely (0.05% of births) and affects women more than men. Here we present the first test of synaesthesia prevalence with sampling that does not rely on self-referral, and which uses objective tests to establish genuineness. We show that (a) the prevalence of synaesthesia is 88 times higher than previously assumed, (b) the most common variant is coloured days, (c) the most studied variant (grapheme - colour synaesthesia)—previously believed most common—is prevalent at 1%, and (d) there is no strong asymmetry in the distribution of synaesthesia across the sexes. Hence, we suggest that female biases reported earlier likely arose from (or were exaggerated by) sex differences in self-disclosure.

Two classes of models have been proposed to explain how the visual system processes texture modulations. In ‘feature models’, abstract representations of the featural properties of local texture regions (eg orientation, spatial frequency, contrast) are first generated, after which differences in individual feature properties across space are detected. In ‘energy models’, on the other hand, differences across space in the response energies of linear simple-cell-like filters are detected. This model thus processes the existing differences between texture regions directly without generating a full representation of the individual texture regions. We provide here direct evidence for the existence of the second, energy model, using an adaptation paradigm in conjunction with textures simultaneously modulated in two dimensions—orientation and spatial frequency. We found that the mechanism that processed the conjoint modulation was tuned to orientations and spatial frequencies that could not be predicted by any feature model, but which were precisely predicted by the energy model.

People with autism have a number of reported deficits in object recognition and global processing. Is there a low-level spatial integration deficit associated with this? We measured spatial-form-coherence detection thresholds using a Glass stimulus in a field of random dots, and compared performance to a similar motion-coherence task. A coherent visual patch was depicted by dots separated by a rotational transformation in space (form) or space - time (motion). To measure parallel visual integration, stimuli were presented for only 250 ms. We compared detection thresholds for children with autism, children with Asperger syndrome, and a matched control group. Children with autism showed a significant form-coherence deficit and a significant motion-coherence deficit, while the performance of the children with Asperger syndrome did not differ significantly from that of controls on either task.

Vision begins with the processing of unbound visual features, which must eventually be bound together into object representations. Such feature binding is required for coherent visual perception, and accordingly has received a considerable amount of study in several domains. Neurophysiological work, often in monkeys, has revealed the details of how and where feature binding occurs in the brain, but methodological limitations have not allowed this research to elucidate just how feature binding operates spontaneously in real-world situations. In contrast, behavioral work with human infants has demonstrated how we use simpler unbound features to individuate and identify objects over time and occlusion in many types of events, but this work has not typically been able to isolate the role of feature binding in such processing. Here we provide a method for assessing the spontaneity and fidelity of feature binding in non-human primates, as this process is utilized in real-world situations, including simple foraging behaviors. Using both looking-time and manual-search measures in a natural environment, we show that free-ranging rhesus macaques (Macaca mulatta) spontaneously bind features in order to individuate objects across time and occlusion in dynamic events. This pattern of results demonstrates that feature binding is used in subtle ways to guide ecologically relevant behavior in a non-human animal, spontaneously and reliably, in its natural environment.

The process of object localization may be accomplished with respect to a particular reference location, such as the center of gravity, COG (eg Vishwanath and Kowler, 2003 Vision Research 43 1637 – 1653). Here, we investigated how part structure affects an object's reference location. The reference location was evaluated with a measure of the illusory displacement of an internal target element embedded within a larger object (Morgan et al, 1990 Vision Research 30 1793 – 1810). To examine whether the reference location is different for shapes with part structure, two shapes were tested: circle (small and large; no part structure) and bell (shape with two parts, one larger than the other). Results were examined with respect to two predictions: either the location of an object is based on its shape as a whole, disregarding part structure (ie a single, overall COG), or the parts are processed separately (different COGs).

With the circles, the results showed a systematic illusory displacement of the internal target toward the COG. With the bell, the illusion was significantly weaker than with both circles—even though the main part of the bell had the same size as the small circle, and its horizontal axis had the same extent as the large circle. Moreover, the distance judgments for the bell were consistent with a (weaker) reference point being located at the COG of the larger part, rather than at the COG of the entire bell. These results show that the part structure of a shape plays a role in the representation of its location, and that for complex shapes the perceived location of an embedded element depends more on the parts within which it is embedded, rather than on the whole shape.

Where we make ocular fixations when viewing an object likely reflects interactions between ‘external’ object properties and internal ‘top - down’ factors, as our perceptual system tests hypotheses and attempts to make decisions about our environment. These scanning fixation patterns can tell us how and where the visual system gathers information critical to specific tasks. We determined the effects of the internal factors of expertise, experience, and ambiguity on scanning during a face-recognition task, in eight subjects. To assess the effects of expertise, we compared upright with inverted faces, since it is hypothesized that inverted faces do not access an orientation-dependent face-expert processor. To assess the effects of experience, we compared famous with novel faces, as famous faces would have stronger internal representations than anonymous ones. Ambiguity in matching seen and remembered faces was manipulated with morphed faces. We measured three classes of variables: (i) total scanning time and fixations; (ii) the spatial distribution of scanning; and (iii) the sequence of scanning, using first-order Markov matrices for local scan structure and string editing for global scan structure. We found that, with inverted faces, subjects redistributed fixations to the mouth and lower face, and their local and global scan structure became more random. With novel or morphed faces, they scanned the eyes and upper face more. Local scan structure was not affected by familiarity, but global scan structure was least random (most stereotyped) for novel upright faces. We conclude that expertise (upright faces) leads to less lower-face scanning and more predictable global patterns of information gathering. Experience (famous faces) leads to less upper-face scanning and more idiosyncratic global scan structures, suggesting a superseding influence of facial memories. With morphed faces, subjects return to the upper face to resolve ambiguity, implying a greater importance of this region in face recognition.

We sought to elucidate the behavioral and electrophysiological correlates of face processing, in adults and infants, by manipulating either the featural or configural information within the face. Two different experiments are reported. In these experiments, event-related potentials (ERPs) were recorded from the scalp while adult, 8-month-old, and 4-month-old participants completed configural-change and featural-change face tasks. The infants also completed a behavioral visual paired-comparison task with featural and configural face changes. ERP results reveal hemispheric differences in processing featural but not configural changes for the N170 in adults. Furthermore, featural and configural changes are processed differently within the right and left hemispheres. The right hemisphere N170 is significantly greater for configural compared to featural changes. The left hemisphere N170, however, exhibits the opposite effect. Infant data suggest that similar to adults, 8-month-old, but not 4-month-old participants, exhibit similar hemispheric differences between featural and configural changes for the P400 component. Behavioral results suggest increased sensitivity to both featural and configural face changes in 8-month-olds compared to 4-month-olds.

Under suitable conditions, pupillary dilation is a reliable index of processing activity. Pupil size was tracked in male and female observers following the presentation of face stimuli for an age-judgment task. The eyes on the faces were either directed towards the observer or deviated to the side. Pupil dilation accompanied processing of the faces, but female observers showed significantly more sustained pupil dilation when viewing direct- than deviated-gaze faces over the period 3 to 7 s after stimulus onset, regardless of stimulus sex. In contrast, male observers did not show a consistent pattern in response to either the gaze or sex of the face stimuli. These findings indicate a sex difference in the processing of gaze direction and suggest that females, but not males, apply increased effort to processing socially relevant (direct-gaze) than irrelevant (deviated-gaze) faces. They also demonstrate that pupillary measurement can potentially provide new insights into the processing of even visual input, provided reflexes are sufficiently controlled.

We tested the ability of the mature visual system for discrimination between types of elliptic biological motion on the basis of event kinematics. Healthy adult volunteers were presented with point-light displays depicting elliptic motion when only a single dot, a moving point-light arm, or a whole point-light human figure was visible. The displays were created in accordance with the two-thirds power kinematic law (natural motion), whereas the control displays violated this principle (unnatural motion). On each trial, participants judged whether the display represented natural or unnatural motion. The findings indicate that adults are highly sensitive to violation of the two-thirds power kinematic law. Notably, participants can easily discriminate between natural and unnatural motions without recognising the stimuli, which suggests that people implicitly use kinematic information. Most intriguing, event recognition seems to diminish the capacity to judge whether event kinematics is unnatural. We discuss possible ways for a cross-talk between perception and production of biological movement, and the brain mechanisms involved in biological motion processing.