In the process of lighting design, usually many lighting alternatives are assessed against criteria such as energy consumption, lamp type, price and also user preferences collected through psychovisual experiments. However, these experiments induce subject fatigue, which limits the number of lighting alternatives that can be evaluated. To overcome this limitation, we propose a new protocol based on (1) the use of the internet and (2) an incomplete experimental design in which each subject judges only a subset of the whole set of visual stimuli. This protocol is validated by comparing three experiments conducted in the laboratory and online. No statistical difference was highlighted between the results of the experiments. Extrapolations suggest that this protocol could be used to assess up to 3000 visual stimuli.
Get full access to this article
View all access options for this article.
References
1.
ParducciAWedellDH. The category effect with rating scales: number of categories, number of stimuli, and method of presentation. Journal of Experimental Psychology: Human Perception and Performance1986; 12: 496–516.
2.
ParducciA. Category judgment: a range-frequency model. Psychological Review1965; 72: 407–418.
3.
FlynnJEHendrickCSpencerTMartyniukO. A guide to methodology procedures for measuring subjective impressions in lighting. Journal of the Illuminating Engineering Society1979; 8: 95–110.
4.
Fotios S, Houser K. Tuning the spectrum to match human vision: an opportunity for led arrays: Proceeding of Experiencing Light 2009. Eindhoven, Netherlands, 2009; 41–52.
5.
HouserKWTellerDK. The subjective response to linear fluorescent direct/indirect lighting systems. Lighting Research and Technology2002; 34: 243–264.
6.
NewshamGArsenaultCVeitchJToscoAMDuvalC. Task lighting effects on office worker satisfaction and performance, and energy efficiency. Leukos2005; 1: 7–26.
7.
BoycePVeitchJNewshamGJonesCHeerwagenJMyerMHunterCM. Lighting quality and office work: two field simulation experiments. Lighting Research and Technology2006; 38: 191–223.
8.
MorrisseyJH. New method for the assignment of psychometric scale values from incomplete paired comparisons. Journal of the Optical Society of America1955; 45: 373–378.
9.
Cheung V, Westland S, Li Y. Models estimation for incomplete paired-comparison experiments based on least-squares solution: Proceedings of the 17th Color Imaging Conference: Color Science and Engineering Systems, Technologies, and Applications, Albuquerque, NM, USA, 2009; 107–110.
10.
Li Y, Westland S, Cheung V. Model estimation for incomplete paired comparison experiments based on least-squares solution. Predicting perceptions: Proceedings of the 3rd International Conference on Appearance, Edinburgh, Scotland, 2012; 89–91.
11.
EngeldrumPG. Psychometric Scaling: A Toolkit for Imaging Systems Development, Winchester, MA: Imcotek Press, 2000.
12.
StevensSSVolkmannJ. The relation of pitch to frequency: a revised scale. The American Journal of Psychology1940; 53: 329–353.
13.
ChuangYChenLL. How to rate 100 visual stimuli efficiently. International Journal of Design2008; 2: 31–43.
14.
UrdapilletaITon NuCSaint DenisCHuon de KermadecC. Traité d’Evaluation Sensorielle: Aspects Cognitifs et Métrologiques des Perceptions, Paris: Dunod, 2001.
15.
GaculaMCSinghJBiJAltanS. Statistical Methods in Food and Consumer Research, 2nd Edition. San Diego, CA: Elsevier, 2009.
16.
CochranWGCoxGM. Experimental Designs, New York, NY: John Wiley and Sons, 1957.
17.
TocherKD. The design and analysis of block experiments. Journal of the Royal Statistical Society. Series B (Methodological)1952; 14: 45–100.
OehlertGW. A First Course in Design and Analysis of Experiments, New York, NY: WH Freeman, 2000.
20.
Sprow I, Baranczuk Z, Stamm T, Zolliker P. Web-based psychometric evaluation of image quality: Proceedings of Image Quality and System Performance VI, Electronic Imaging 2009, San José: SPIE, 7242, 2009.
21.
VillaCLabayradeR. Validation of an online protocol for assessing the luminous environment. Lighting Research and Technology2013; 45: 401–420.
22.
Villa C, Parent E, Labayrade R. Calibrating a display device for subjective visual comfort tests: Selection of light simulation programs and post-production operations: Proceedings of the International Commission on Illumination CIE 2010 “Lighting Quality and Energy Efficiency”, Vienna, 2010; 783–791.
23.
ReinhardE. Parameter estimation for photographic tone reproduction. Journal of Graphics Tools2002; 7: 45–52.
24.
Villa C, Labayrade R. Calibrating a display device for subjective visual comfort tests: Selection of a tone-mapping operator: Proceedings of the International Commission on Illumination CIE 2010 “Lighting Quality and Energy Efficiency”, Vienna, 2010; 792–800.
25.
Villa C, Labayrade R. Psychovisual assessment of tone-mapping operators for global appearance and colour reproduction: Proceedings of Colour in Graphics Imaging and Vision 2010, Joensuu, Finland, 2010; 189–196.
Fernandez P, Giboreau A, Fontoynont M. A three step method to design lighting in hotel rooms through a user centered approach: Proceeding of Experiencing Light 2012. Eindhoven, Netherlands, 2012.
31.
ReipsUDBirnbaumMHBehavioral research and data collection via the Internet. In: ProctorRWVuKPL (eds). The Handbook of Human Factors in Web Design, Mahwah, NJ: Erlbaum, 2011, pp. 471–492.
32.
NewshamGRRichardsonCBlanchetCVeitchJA. Lighting quality research on rendered images of offices. Lighting Research and Technology2005; 37: 93–115.
