Human visual evaluation and photometric gloss and color measurements are the common techniques used for determining the surface deterioration in weathering and durability studies. However, the human visual inspection technique is a subjective and qualitative method and therefore lacks objectiveness as a standard method. The photometric techniques provide quantitative measurements but do not fully incorporate all aspects of surface morphology. Therefore, instrumental inspection techniques that integrate photometric response as well as surface morphology would be beneficial. In this report, the feasibility of an image analysis system as an objective and quantitative surface measurement technique is demonstrated. For the study, three different commercially available plastics were exposed to various weathering conditions conforming to five different industry standard test methods. The materials were periodically evaluated using the image analysis system, and the results were compared. In addition, conventional photometric evaluation results were compared to this new technique. Analysis of the data provided some insight into comparing the four different accelerated weathering tests.