Image statistics and the perception of surface reflectance

Humans are surprisingly good at judging the reflectance of complex surfaces even when the surfaces are viewed in isolation, contrary to the Gelb effect. We argue that textural cues are important for this task. Traditional machine vision systems, on the other hand, are incapable of recognizing reflectance properties. Estimating the reflectance of a complex surface under unknown illumination from a single image is a hard problem. Recent work in reflectance recognition has shown that certain statistics measured o an image of a surface are diagnostic of reflectance. We consider opaque surfaces with medium scale structure and spatially homogeneous reflectance properties. For such surfaces, we find that statistics of intensity histograms and histograms of filtered outputs are indicative of the diffuse surface reflectance. We compare the performance of a learning algorithm that employs these image statistics to human performance in two psychophysical experiments. In the first experiment, observers classify images of complex surfaces according to the perceived reflectance. We find that the learning algorithm rivals human performance at the classification task. In the second experiment, we manipulate the statistics of images and ask observers to provide reflectance ratings. In this case, the learning algorithm performs similarly to human observers. These findings lead us to conclude that the image statistics capture perceptually relevant information.

Department dc:contributor.department

Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2005

Author dc:creator

• Sharan, Lavanya

Advisor dc:contributor.advisor

• Edward H. Adelson.

• Electrical Engineering and Computer Science.

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/34356

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/34356