When reading any page in this review, take your own assumptions and goals into account, and relate those to the discussion to verify that the way the test has been done meshes with your own working habits.
For example, shooting JPEG with noise reduction enabled might produce significantly different results than RAW without noise reduction. Or shooting under mercury vapor lights as compared with evenly-balanced 5000°K lighting (daylight).
Testing and assumptions
The assumptions in testing matter a lot, so much so that a test can be perfectly designed and performed, but inapplicable in some cases. Let’s discuss lens tests to illustrate. The same applies to noise and other areas.
Today the popular trend is to assign numeric values to everything: a lens can be assigned rating(s) based on arbitrary assumptions (assume a flat field, test at close range, etc). This yields a very good idea of how a lens performs under specific circumstances on a test target, and so if you shoot test targets the results are eminently useful and scientifically defensible; variables are held constant (assuming focus and focus shift are accounted for). Unfortunately, real world images don’t work that way.
Article continues for subscribers...
Already a subscriber? CLICK HERE TO LOG IN
Since 2006, Diglloyd Advanced Photography is the authoritative review and reference for DSLRs and their lenses: Canon and Nikon primarily, but also Pentax and some medium format. Reviews of key DSLRs are included, but the primary focus is on lens performance. Also included is a wealth of technique and workflow approaches.
DAP includes thousands of pages of exclusive coverage and high resolution Retina-grade examples detailing Canon and Nikon DSLR bodies and their lenses, with in-depth analysis of sharpness and contrast, color, bokeh, vignetting, distortion, MTF, and flare, behavioral and practical usage.
Click for details