Introduction

Imatest™ Rescharts analyzes images of several test charts for resolution-related parameters such as sharpness (i.e., spatial frequency response; MTF), color moiré, and fine detail lost to software noise reduction, using a highly interactive user interface.

The following list of Rescharts modules illustrates many of the supported chart types.


Applied Image QA-77 chart (derived from ISO 12233)
Slanted-edge SFR supports any chart
that contains slanted-edges.
The Applied Image QA-77 chart
(a modified ISO-12233 chart) is shown.


Slanted-edge SFR

Slanted-edge SFR duplicates SFR, but with a far more interactive interface. It calculates and displays the average edge, SFR (Spatial Frequency Response or MTF), and Lateral Chromatic Aberration, and Includes one figure not in SFR: a histogram with noise analysis.

All charts that contain slanted edge patterns are supported, including the ISO-12233 chart and its derivatives. Charts may be purchased from Imatest or created with Test Charts (SVG charts are especially recommended) and printed on a high quality inkjet. If you are just getting started with slanted-edge MTF testing we recommend that you purchase or print an SFRplus chart (shown below), which has numerous advantages over other slanted-edge charts.


SFRplus

Highly automated analysis of SFR (MTF), Lateral Chromatic Aberration, distortion, tonal response, and optional color response. Uses a special test chart, shown on the left. Unlike other Rescharts modules, SFRplus does not require manual region (ROI) selection: it is performed automatically. Running SFRplus in Rescharts saves settings for fully automated runs.

SFRplus instructions



Log Frequency (simple)

Analyzes a sine or bar pattern of increasing spatial frequency. Measures SFR more directly, but less precisely, than the slanted-edge method. Also measures color moiré (Imatest Master only), which is a function of lens sharpness, anti-aliasing filter, and demosaicing algorithm. Spatial frequencies are detected automatically. Charts can be created by Test Charts and printed on a high quality inkjet printer. Also works with the old test chart in Lens testing.

Log Frequency instructions


 

Log F-Contrast  (Imatest Master only)

Analyzes a sine or bar pattern of increasing spatial frequency on the one axis and decreasing contrast on the other. Measures SFR for a range of contrast levels. Useful for measuring the loss of fine detail caused by software noise reduction— the effects of nonlinear signal processing. The chart can be created by Test Charts and printed on a high quality inkjet printer.

Log F-Contrast instructions



 

Star chart   (Imatest Master only)

Analyzes a sinusoidally-modulated Siemens star chart (144, 72, or 48 cycles); proposed for the revised ISO 12233 standard. Measures MTF (SFR) for 8, 12, or 24 segments around the circle. Has a large variety of displays. The chart can be purchased from Image Engineering or created by Test Charts and printed on a high quality inkjet printer.

Star Chart instructions



Log F-contrast chart
ISO 12233 chart (crop showing wedges)

 

Wedge  (Imatest Master only)

Analyzes hyperbolic or trapezoidal wedge patterns (converging bars with linear frequency or linear spacing) contained in the ISO 12233, EIA 1956, and other test charts, and included in the proposed revision to the ISO 12233 standard. Measures MTF (SFR) and the onset of aliasing (similar to the CIPA DC-003 standard).

Wedge instructions



Log F-contrast chart
Scale-invariant random test chart

Random (Scale-invariant)  (Imatest Master only)

Analyzes a random (scale-invariant) pattern, which has a 1/f fourier transform (1/f 2 Power Spectral Density (PSD)). Such a pattern has the same general appearance (the same statistics) regardless of distance. Since images of this pattern typically have little sharpening (due to the lack of contrasty edges) but relatively large amounts of noise reduction, it is an excellent indicator of a camera's ability to render fine low-contrast detail. (Slanted-edges, by comparison, tend to be more sharpened and have less noise reduction, and hence may not give an accurate indication of a camera's response to fine low-contrast detail.) Noise power measured in the smooth regions on the left, is subtracted from the PSD of the random pattern. Two low contrast slanted-edges are used to used to verify the random pattern results.

Random (Scale-invariant) instructions


Log F-contrast chart
Image used for Any scene sharpness

 

Any scene sharpness  (Imatest Master only)

Measures sharpness of any scene. The sharpness metric is nonstandard and applies to the individual scene only (it cannot be used for comparisons with other scenes). (It's the same metric used in Find sharp files.) Useful for optimizing focus during reloads in the Image Sensor edition, which analyzes frames from live (video) feeds. Displays the image and a history showing changes in sharpness as the device is focused.

Any scene sharpness instructions (coming)

 



Getting started

Instructions for purchasing or creating test charts can be found on pages for individual tests: SFR, Log Frequency, and Log F-Contrast.

Photograph or scan the chart, taking care to avoid glare, which can be problematic in charts with semigloss and glossy surfaces. Glare can be especially difficult to control with wide angle lenses. A recommended lighting setup is described here and in How to build a testing lab.

To start Rescharts, run Imatest, then click the Rescharts button. The Rescharts window will appear with brief instructions, which may be more up-to-date than the ones shown below.

Rescharts startup window

Rescharts read image file popup menu

Select an image to analyze by

The Read image file button and Chart type popup menu are highlighted (yellow background) when Rescharts starts.

A standard Windows dialog appears with the chart type indicated in the title. Open the image file. Multiple files can be opened for averaging (but batch (sequential) runs are not supported by Rescharts).

If the folder contains meaningless camera-generated file names such as IMG_3734.jpg, IMG_3735.jpg, etc., you can change them to meaningful names that include focal length, aperture, etc., with the View/Rename Files utility, which takes advantage of EXIF data stored in each file.

For all modules other than SFRplus, if the image is the same size and type as the previous image analyzed by Rescharts, you'll be asked if you want to use the same ROI (region of interest). (ROI selection is entirely automatic with SFRplus.)

Repeat or adjust ROI?

If the image size or type is different or if you answer No, a coarse cropping box appears. The initial crop doesn't have to be precise: you'll have a chance to refine it.

After the rough crop has been selected, the fine adjustment box appears, showing the coarse crop as a rectangle. This dialog box can be enlarged or maximized to facilitate the adjustment. It offers numerous options.

Fine crop window
Crop for the Log Frequency-contrast chart. Leave a small margin
(1/2 - 1% of the image height) at the top and bottom.

When you have completed the fine adjustment, click one of the buttons on the bottom of the window. If you click Yes, Continue , an additional dialog box may appear. The entries in this dialog box can be changed later by clicking on Image settings & options in the Rescharts window. If you click  Yes, Continue in Express mode , it will go directly to the Rescharts window, using saved (recent) values.

The Rescharts window

After the image file has been entered, calculations are performed and the most recent Chart view is displayed. The MTF/contrast (2D pseudocolor contour) display (actual MTF when a sine chart is used) for Log F-Contrast is shown below.

IT8 a*b* display
MTF contours for Canon EOS-20D, 24-70mm f/2.8L, 42mm, f/5.6, ISO 100

The main display image is on the upper left. Additional text results may appear below this image. An image of the chart is shown on the upper right. You can choose to display the whole image or the crop (ROI). The remainder of the right side is the control area.

The Zoom checkbox turns Zoom on and off.

The buttons to the right of Zoom set the display to either the Whole image or a Crop of the image (the selected ROI).

Image and Display areas

The image area is on the right of the Rescharts window, just below the Whole image and Crop buttons. It includes the the Read image file and Reload buttons, the Chart type dropdown menu (described above), and additional controls.

Image and display areas

Reload reloads an image from a file or reacquires it from a device or video stream (depending on how the image was originally acquired). It is most valuable for versions of Imatest that can acquire images from devices or streams.

Immediately below the Chart type menu is the New crop (same image) menu, which has identical entries. If an item is selected on this menu, the image is recropped for analysis by the selected chart type (which may be the same or different). This menu is useful when several regions of an image need to be analyzed or when the target contains more than one chart type.

Image settings & options brings up the input dialog box for the selected chart type. This is the same box that appears when you press Yes, continue (not Express mode) in the ROI repeat or ROI selection window.

Display, immediately below the image area, selects the results to display. Choices depend on the chart type.

The Display options area is immediately below Display. The contents, which depend on the Display selection, are described below in the sections for the individual displays.

Save screen window

Save screen (shown on the right) saves a snapshot of the current display (the entire Rescharts screen) as a PNG file (a widely-used losslessly-compressed format). It also allows you to immediately view the snapshot (if the Open window... box is checked) so it can be used a reference for comparing with other results.

File name and Directory at the top of the window set the location of the file to save.

When you check the Open window in an image viewer... box, the current screen will be opened either the system default viewer (if the box under Image viewer is blank) or a viewer/editor of your choice (if the box contains the path name to the viewer/editor). WeI recommend Irfanview, which is fast, compact, free, and supports an amazing number of image file formats. (It can be valuable for converting nonstandard images to Imatest-readable formats.) Its normal location in English language installations is C:\Program Files\IrfanView\i_view32.exe.

Save data Saves detailed results in CSV and XML formats. The exact content depends on the module.

Help opens this web page in an HTML browser window.

Exit terminates Imatest Rescharts, but the Imatest main window remains available.

Rescharts modules

This section describes the Rescharts modules, illustrating some of the available displays and options. More information is available in the pages for the individual modules (Chart type analyses).

Slanted-edge SFR

SFR Edge and MTF display
SFR Edge and MTF display

 

Slanted-edge SFR measures sharpness as Spatial Frequency Response, also called MTF (Modulation Transfer Function) from images of slanted edges, as described in Sharpness. ROI (Region of Interest) selection, calculations, and output largely duplicate SFR. Available displays:

Edge and MTF (shown on the right). The edge can be displayed linearized or not and normalized or not. LSF (the Line Spread Function) can be displayed in place of the edge.
Chromatic Aberration (right, below)
SQF (Subjective Quality Factor)
Noise spectrum & Shannon capacity
Histograms & noise stats (left, below)
Summary & EXIF (for JPEGs)

 

 

 

The principal differences from SFR are the highly interactive interface and an added histogram of the ROI levels, shown below. Black is the entire ROI. Cyan is the portion on the left and red is the portion on the right, both away from the edge. The upper histogram is for the original image (pixel levels/255); the lower histogram is for the linearized image (gamma applied).


SFR histogram
SFR Histogram
Lateral Chromatic Aberration
SFR Lateral Chromatic Aberration

SFRplus

SFRplus performs a highly automated analysis  of SFR (MTF), lateral chromatic aberration, distortion, and tonal response, using a special test chart. Unlike other Rescharts modules, SFRplus does not require manual region (ROI) selection: it is performed automatically. Running SFRplus in Rescharts saves settings for fully automated runs.         Available displays:    Full instructions
Edge and MTF
Chromatic Aberration
SQF
Noise spectrum & Shannon capacity
Multi-ROI summary
Tonal response & gamma
Histograms and noise stats
Summary & EXIF (for JPEGs)
many more...


Rescharts SFRplus summary display
SFRplus multi-region summary display for 9 automatically-selected regions

3D display
3D plot of MTF50 (many results available)
Lens-style MTF plot
Lens-style MTF plot:  Similar to plots on
the Canon, Nikon, and Zeiss websites.

Log Frequency (simple)

Log f pattern: valid for testing. Right-click to download
Log frequency image: right-click to download an image that can be used for testing.

Log Frequency measures image contrast of charts that increase in spatial frequency on a logarithmic scale (log frequency increases with x). When the image pattern is sinusoidal (not a bar pattern) the contrast is equivalent to SFR or MTF. This method is more direct than Slanted-edge SFR, but less accurate because it is degraded by noise and sampling phase variation. It also measures color moiré (Imatest Master only). The chart can be created by Test Charts and printed on a high quality inkjet. Also works with the test chart in Lens testing and narrow strips of the Log Frequency-Contrast chart.

MTF and moire display
Log Frequency MTF and moire display
(linear x-axis frequency scale)

Available displays:        Full instructions

     The Pattern (original pixel levels and linearized)
     MTF and Moire (linear frequency scale)
     MTF and Moire (log frequency scale)
     EXIF data

The display on the right shows Contrast (MTF) on the top and color moire on the bottom as a function of spatial frequency (displayed linearly). Color moire can me measured in several ways: R-B (normalized RedBlue channel) is shown on the right. The total color moire is the spread of values above 0.3 cycles/pixels (indicated by the red curve). Details of the color moire measurement can be found in Log Frequency. The Correct for color density box should be checked for best results.

Pattern (original pixel levels and linearized)
Log frequency pattern analysis

Log F-Contrast

MTF and moire display
Normalized contrast level (MTF)
(1 at low frequencies for all chart contrasts):
Panasonic TZ1, ISO 80
Log frequency-contast
Normalized contrast level: TZ1, ISO 800

Log F-Contrast (short for Log Frequency-Contrast) measures the image contrast of charts that vary in spatial frequency on one axis (log frequency increases with x) and in contrast on the other (contrast is proportional to ( y/h)2 for image height h). When the image pattern is sinusoidal (rather than a bar pattern) the contrast is equivalent to SFR or MTF. This module can be used to measure how much fine, low-contrast detail is lost to software noise reduction. The chart can be created by Test Charts and printed on a high quality inkjet printer.

Available displays:       Full instructions

The Pattern (original pixel levels and linearized)
MTF (linear frequency scale)
MTF (log frequency scale)
2D pseudocolor contour plots that can display any of several MTF-related parameters:
MTF (envelope - standard) (standard MTF, normalized to 1 at maximum contrast and zero spatial frequency)
Normalized contrast level (MTF normalized to 1 at zero spatial frequency for all contrast levels)
Normalized contrast loss (MTF normalized to 1 at zero spatial frequency for all contrast levels as well as all spatial frequencies at the maximum contrast level: shows contrast loss from ideal)
MTFnn or MTFnnP (spatial frequencies where MTF = nn% of the low frequency or peak value
EXIF data

The displays on the right show the Normalized contrast level (MTF normalized to 1 at low spatial frequencies for all chart contrast levels) for the Panasonic TZ1 camera with ISO speed set at 80 (top) and 800 (bottom). Spatial frequency is on a linear scale with a maximum displayed frequency of 0.5 cycles/pixel. The difference between the two images is quite striking. The TZ1 has much more noise reduction— and correspondingly less detail— at ISO 800. These plots are explained in detail in Log F-contrast.


Star chart

MTFnn values from Log Frequency-Contrast
MTF contours, rectangular display,
Linear frequency scale.
 
MTF displayed in polar coordinates
MTF70 – MTF10: Polar coordinates,
Linear frequency on radius.

 

 

Star Chart measures contrast (MTF or SFR) of sinusoidally-modulated star charts (also known as the Siemens star) proposed for inclusion in the updated ISO 12233 standard. Charts have 144, 72, or 48 cycles and can be analyzed in 8, 12, or 24 segments. Star charts can be purchased from Image Engineering or created by Test Charts and printed on a high quality inkjet printer.

Available displays:       Full instructions

Display Description
MTF (original and linearized) MTF for up to 8 segments of the star. Both linear and logarithmic frequency displays are available.
MTFnn or MTFnnP Display MTFnn (the frequencies where MTF equals nn % of the low frequency values) and MTFnnP (the frequencies where MTF equals nn % of the peak value) for nn = 70, 50, 30, 20, and 10. Both polar (spider) and rectangular plots are available.
MTF contours (rectangular) Display MTF contours in a rectangular plot with linear or logarithmic frequency display. Similar to the MTFnn rectangular plot.
MTF contours (polar) Display MTF contours in a polar plot whose geometry duplicates that of the target.
EXIF data Show EXIF data if available.

The displays on the right show MTF contours and MTF70 through MTF10 (spatial frequencies where MTF = 70 through 10% of the low frequency level). Spatial frequency is displayed in cycles per pixel, but Line Widths per Picture Height (LW/PH), cycles/inch, or cycles/mm can be selected by pressing Image settings & options.


Wedge

Wedge (Imatest Master-only) measures the MTF (Modulation Transfer Function) and the onset aliasing (related to the vanishing resoultion) from converging bar patterns, called "wedges", which are a part of many popular resolution test charts. "Hyerbolic" (linear in frequency) wedge patterns are central to the CIPA DC-003 standard for digital camera resolution measurement, which will be incorporated in a revision of the ISO 12233 resolution measurement standard.

Wedge can analyze vertical and horizontal (but not diagonal) wedges. To the best of our knowledge, Imatest Wedge is the only software that can calculate MTF from wedge patterns, but there is a significant limitation with the calculation: the results at the Nyquist frequency (and also 2/3 Nyquist) are highly sensitive tothe phase of the bars relative to the pixels, i.e., the sub-pixel positioning, which is difficult to control in practice.

MTF and moire display
MTF and Aliasing onset ("vanishing resolution")

Full instructions

The display on the right shows Contrast (MTF)  and the onset of aliasing (the frequency where the number of detected bars (smoothed) drops below the actual number of bars in the chart. The original wedges are shown (with squeezed aspect ratio). Several results including MTFnn for nn = 70-10 are shown below the image.

The color moire plot for R-B (normalized RedBlue channel) is shown on below.

Log frequency pattern analysis

Random (scale-invariant)

MTF from random scale-invariant pattern
MTF from Random scale-invariant pattern

Log F-contrast chart

Analyzes a random (scale-invariant) pattern, which has a 1/f fourier transform (1/f 2 Power Spectral Density (PSD)). Such a pattern has the same general appearance (the same statistics) regardless of distance. Since images of this pattern typically have little sharpening (due to the lack of contrasty edges) but relatively large amounts of noise reduction, it is an excellent indicator of a camera's ability to render fine low-contrast detail. (Slanted-edges, by comparison, tend to be more sharpened and have less noise reduction, and hence may not give an accurate indication of a camera's response to fine low-contrast detail. Noise power measured in the smooth regions on the left, is subtracted from the PSD of the random pattern. Two low contrast slanted-edges are used to verify the random pattern results.

Any scene sharpness

Any scene sharpness

 

Measures sharpness of any scene. The sharpness metric is nonstandard and applies to the individual scene only (it cannot be used for comparisons with other scenes). (It's the same metric used in Find sharp files.) Useful for optimizing focus during reloads in the Image Sensor edition, which analyzes frames from live (video) feeds. Displays the image and a history showing changes in sharpness as the device is focused.

Any scene sharpness display
showing simulated history
(representing focusing to find optimum)