Is the Perception of 3D Shape from Shading Based on Assumed Reflectance and Illumination?

Abstract

The research described in the present article was designed to compare three types of image shading: one generated with a Lambertian BRDF and homogeneous illumination such that image intensity was determined entirely by local surface orientation irrespective of position; one that was textured with a linear intensity gradient, such that image intensity was determined entirely by local surface position irrespective of orientation; and another that was generated with a Lambertian BRDF and inhomogeneous illumination such that image intensity was influenced by both position and orientation. A gauge figure adjustment task was used to measure observers' perceptions of local surface orientation on the depicted surfaces, and the probe points included 60 pairs of regions that both had the same orientation. The results show clearly that observers' perceptions of these three types of stimuli were remarkably similar, and that probe regions with similar apparent orientations could have large differences in image intensity. This latter finding is incompatible with any process for computing shape from shading that assumes any plausible reflectance function combined with any possible homogeneous illumination.

Keywords

3D shape perception shading surface material properties

References

Belhumeur

P. N.

Kriegman

D. J.

Yuille

A. L.

(1999). The bas-relief ambiguity. International Journal of Computer Vision, 35(1), 33–44. doi:10.1023/A:1008154927611

Breton

Zucker

(1996). Shadows and shading flow fields. Proceedings of 1996 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 782–789. doi:10.1109/CVPR.1996.517161

Doerschner

Boyaci

Maloney

(2010). Estimating the glossiness transfer function induced by illumination change and testing its transitivity. Journal of Vision, 10, 1–9. doi:10.1167/10.4.8.Introduction

Fleming

Bülthoff

(2005). Low-level image cues in the perception of translucent materials. ACM Transactions on Applied Perception, 2(3), 346–382. doi:10.1145/1077399.1077409

Fleming

R. W.

Dror

R. O.

Adelson

E. H.

(2003). Real-world illumination and the perception of surface reflectance properties. Journal of Vision, 3(5), 347–368. doi:10.1167/3.5.3

Fleming

R. W.

Jäkel

Maloney

L. T.

(2011). Visual perception of thick transparent materials. Psychological Science, 22(6), 812–820. doi:10.1177/0956797611408734

Fleming

R. W.

Torralba

Adelson

E. H.

(2004). Specular reflections and the perception of shape. Journal of Vision, 4(9), 798–820. doi:10.1167/4.9.10

Gilchrist

Jacobsen

(1984). Perception of lightness and illumination in a world of one reflectance. Perception, 13(1), 5–19. doi:10.1068/p130005

Howard

I. P.

(1983). Occluding edges in apparent reversal of convexity and concavity. Perception, 12(1), 85–86. doi:10.1068/p120085

10.

Ikeuchi

Horn

B. K. P.

(1981). Numerical shape from shading and occluding boundaries. Artificial Intelligence, 17(1–3), 141–184. doi:10.1016/0004-3702(81)90023-0

11.

Jensen

H. W.

Marschner

S. R.

Levoy

Hanrahan

(2001). A practical model for subsurface light transport. Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques - SIGGRAPH '01, 511–518. doi:10.1145/383259.383319

12.

Khang

B.-G.

Koenderink

J. J.

Kappers

A. M. L.

(2007). Shape from shading from images rendered with various surface types and light fields. Perception, 36(8), 1191–1213. doi:10.1068/p5807

13.

Koenderink

(1984). What does the occluding contour tell us about solid shape? Perception, 13, 321–330. doi:10.1068/p130321. Retrieved from http://www.cs.rutgers.edu/∼decarlo/readings/koenderink-percep84.pdf

14.

Koenderink

J. J.

van Doorn

A. J.

Kappers

A. M. L.

Todd

J. T.

(2001). Ambiguity and the “mental eye” in pictorial relief. Perception, 30(4), 431–448. doi:10.1068/p3030

15.

Koenderink

J. J.

Pont

S. C.

van Doorn

A. J.

Kappers

A. M. L.

Todd

J. T.

(2007). The visual light field. Perception, 36(11), 1595–1610. doi:10.1068/p5672

16.

Koenderink

J. J.

van Doorn

A. J.

(1980). Photometric invariants related to solid shape. Optica Acta: International Journal of Optics, 27(7), 981–996. doi:10.1080/713820338

17.

Koenderink

J. J.

van Doorn

A. J.

(1982a). Perception of solid shape and spatial lay-out through photometric invariants. In Trappl

(Ed.), Cybernetics and systems research (pp. 943–948). Amsterdam: North-Holland

18.

Koenderink

J. J.

van Doorn

A. J.

(1982b). The shape of smooth objects and the way contours end. Perception, 11(2), 129–137. doi:10.1068/p110129

19.

Koenderink

J. J.

van Doorn

A. J.

Kappers

A. M.

(1992). Surface perception in pictures. Perception & Psychophysics, 52(5), 487–496. doi:10.3758/BF03206710

20.

Koenderink

J. J.

van Doorn

A. J.

Kappers

A. M.

(1995). Depth relief. Perception, 24(1), 115–126. doi:10.1068/p240115

21.

Kunsberg

Zucker

(2013). Characterizing ambiguity in light source invariant shape from shading. arXiv:1306.5480 [cs.CV]. doi:10.1016/0004-3702(81)90023-0

22.

Langer

M. S.

Bülthoff

H. H.

(2000). Depth discrimination from shading under diffuse lighting. Perception, 29(6), 649–660. doi:10.1068/p3060

23.

Langer

M. S.

Bülthoff

H. H.

(2001). A prior for global convexity in local shape-from-shading. Perception, 30(4), 403–410. doi:10.1068/p3178

24.

Langer

M. S.

Zucker

S. W.

(1994). Shape-from-shading on a cloudy day. Journal of the Optical Society of America A, 11(2), 467–478. doi:10.1364/JOSAA.11.000467

25.

Liu

Todd

J. T.

(2004). Perceptual biases in the interpretation of 3D shape from shading. Vision Research, 44(18), 2135–2145. doi:10.1016/j.visres.2004.03.024

26.

Madison

Thompson

Kersten

Shirley

Smits

(2001). Use of interreflection and shadow for surface contact. Perception & Psychophysics, 63(2), 187–194. doi:10.3758/BF03194461

27.

Mamassian

Knill

D. C.

Kersten

(1998). The perception of cast shadows. Trends in Cognitive Sciences, 2(8), 288–295. doi:10.1016/S1364-6613(98)01204-2

28.

Marlow

P. J.

Kim

Anderson

B. L.

(2012). The perception and misperception of specular surface reflectance. Current Biology: CB, 22(20), 1909–1913. doi:10.1016/j.cub.2012.08.009

29.

Mingolla

Todd

J. T.

(1986). Perception of solid shape from shading. Biological Cybernetics, 53, 137–151. doi:10.1007/BF00342882

30.

Nicodemus

F. E.

Richmond

J. C.

Hsia

J. J.

Ginsberg

I. W.

Limperis

(1977). Geometrical considerations and nomenclature for reflectance. Science And Technology, 160(October), 1–52. doi:10.1109/LPT.2009.2020494

31.

Nefs

H. T.

Koenderink

J. J.

Kappers

A. M. L.

(2005). The influence of illumination direction on the pictorial reliefs of Lambertian surfaces. Perception, 34(3), 275–287. doi:10.1068/p5179

32.

Norman

J. F.

Todd

J. T.

Orban

G. A.

(2004). Perception of three-dimensional shape from specular highlights, deformations of shading, and other types of visual information. Psychological Science, 15(8), 565–570. doi:10.1111/j.0956-7976.2004.00720.x

33.

O'Shea

Agrawala

Banks

(2010). The influence of shape cues on the perception of lighting direction. Journal of Vision, 10, 1–21. doi:10.1167/10.12.21.Introduction

34.

Pentland

(1989). Shape information from shading: A theory about human perception. Spatial Vision, 4(2–3), 165–182. doi:10.1109/34.24791

35.

Pont

S. C.

Koenderink

J. J.

(2007). Matching illumination of solid objects. Perception & Psychophysics, 69(3), 459–468. doi:10.1167/10.9.5

36.

Reichel

F. D.

Todd

J. T.

(1990). Perceived depth inversion of smoothly curved surfaces due to image orientation. Journal of Experimental Psychology: Human Perception and Performance, 16(3), 653–664. doi:10.1037/0096-1523.16.3.653

37.

Sadeghi

Bisker

Decken

J. D.

Jensen

H.W.

(2013). A practical microcylinder appearance model for cloth rendering. ACM Transactions on Graphics, 32(2):14, 1–12. doi:10.1145/2451236.2451240

38.

Seyama

Sato

(1998). Shape from shading: Estimation of reflectance map. Vision Research, 38(23), 3805–3815. doi:10.1016/S0042-6989(97)00435-5

39.

Sun

Schofield

A. J.

(2012). Two operational modes in the perception of shape from shading revealed by the effects of edge information in slant settings. Journal of Vision, 12, 1–21. doi:10.1167/12.1.12

40.

Todd

J. T.

Norman

J. F.

Mingolla

(2004). Lightness constancy in the presence of specular highlights. Psychological Science, 15(1), 33–39. doi:10.1111/j.0963-7214.2004.01501006.x

41.

Todd

J. T.

Koenderink

J. J.

van Doorn

A. J.

Kappers

A. M.

(1996). Effects of changing viewing conditions on the perceived structure of smoothly curved surfaces. Journal of Experimental Psychology: Human Perception and Performance, 22(3), 695–706. doi:10.1007/s00426-008-0145-7

42.

Todd

J. T.

Mingolla

(1983). Perception of surface curvature and direction of illumination from patterns of shading. Journal of Experimental Psychology: Human Perception and Performance, 9(4), 583–595. doi:10.1037/0096-1523.9.4.583

43.

Todd

J. T.

Norman

J. F.

Koenderink

J. J.

Kappers

A. M.

(1997). Effects of texture, illumination, and surface reflectance on stereoscopic shape perception. Perception, 26(7), 807–822. doi:10.1068/p260807

44.

Todd

J. T.

Reichel

F. D.

(1989). Ordinal structure in the visual perception and cognition of smoothly curved surfaces. Psychological Review, 96(4), 643–657. doi:10.1037/0033-295X.96.4.643

45.

Wijntjes

M. W. A.

Doerschner

Kucukoglu

Pont

S. C.

(2012). Relative flattening between velvet and matte 3D shapes: Evidence for similar shape-from-shading computations. Journal of Vision, 12(1):2, 1–11. doi:10.1167/12.1.2

46.

Zhang

Tsai

(1999). Shape-from-shading: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(8), 690–706