eSFR ISO: Analyze the ISO 12233:2017 Edge SFR chart* and ISO 12233:2023 Edge SFR chart

 

Standard:

ISO 12233:2017 — Photography— Electronic still picture imaging — Resolution and spatial frequency responses*

ISO 12233:2023 — Photography— Electronic still picture imaging — Resolution and spatial frequency responses

Technical Committee: ISO/TC 42 Photography
Published: 2017-01, 2023-02

 

This new standard defines three test charts. The new Imatest eSFR ISO module performs a highly automated analysis of the new low contrast (4:1) Edge SFR chart and is available in Imatest Master and Image Sensor 4.0. 

Note: ISO 12233:2014 has the same chart requirement.

ISO 12233:2017 Test Charts

CIPA resolution (wedge) test chart

Hyperbolic wedges: 4 vertical, 4 horizontal, and 2 diagonal (45 degrees).

Vertical and horizontal (but not diagonal) wedges supported by the Imatest Wedge module, which has manual region detection.

new_iso12233_CIPA_wedges
Low contrast Edge SFR (E-SFR) test chart Contains 9 slanted squares for slanted edge measurements.
4:1 contrast: much lower than the old ISO 12233:2000 chart (>40:1), which was found to cause problems with clipping and nonlinearities.

This chart does not work with the highly automated Imatest eSFR ISO module, described below. For highly automated measurements (including squares near the corners, color patches, and wedges) we recommend one of the Imatest eSFR ISO charts shown below. These charts are fully compliant with ISO 12233:2017 and ISO 12233:2023, respectively. 

Note: ISO 12233:2014 has the same chart requirement.

new_iso12233_esfr
Sine-based SFR test chart

Siemens star chart

Supported by the Imatest Star Chart module. Optional automatic region detection is available when used with a star pattern that has registration marks on the sides of the image.

new_iso12233_siemens
Legacy ISO-12233 chart

2000 Version

The old high-contrast ISO 12233 chart, shown on the right, is referenced in the ISO 12233:2000 standard but is no longer a part of the standard. It should only be used when results need to be compared with older work.

 

The Imatest ISO 12233:2023 Edge SFR charts

Imatest eSFR ISO 2023 test charts comes in a single variant: Extended. Additional variants will be available in the future. All variations are compliant to teh ISO 12233:2023 standard. See related 2017 documentation below for further information about the Imatest eSFR ISO charts. 

Extended E-SFR ISO 2023 test chart: 16:9 aspect ratio,
4 added stars in the corners and 2 added squares on sides,
18 added color patches, 12 pairs of added wedge patterns.

The Imatest ISO 12233:2017 Edge SFR charts

Imatest eSFR ISO 2017 test charts come in three variants: StandardEnhanced and Extended. All have enhancements over the chart illustrated in the ISO 12233:2017 document, but all conform to the standard. Enhanced versions are available from the Imatest store in inkjet, photographic paper, and photographic film media. Note: The standard design is not sold as an Imatest Chart because it is functionally a subset of the enhanced version. 

new_ISO-12233_plain_vanillaStandard eSFR ISO chart: 3:2 aspect ratio, no added features
Click on any of these charts for larger versions.new_ISO-12233_enh_wedges_3_2_sRGBEnhanced eSFR ISO test chart: 3:2 aspect ratio, 6 added squares on sides,
16 added color patches, several added wedge patterns.new_ISO-12233_ext_wedges_16_9_sRGBExtended eSFR ISO test chart: 16:9 aspect ratio for HDTV and cinema (and good for DSLRs),
6 added squares on sides, 16 added color patches, several added wedge patterns.

Sharpness is derived from edges at the boundaries of the slanted squares, as described in Sharpness: What is it and how is it measured? eSFR ISO can handle a wide range of camera aspect ratios; the left and right sides of the chart may extend beyond the frame or be well inside it.

The Imatest Standard eSFR chart is very close to the chart illustrated in the ISO 12233:2017 standard document, with a few minor differences that maintain compliance with the standard.

  • There are four registration (fiduciary) marks instead of three. An additional black circle, just above the lower-left registration mark, is used to detect orientation. This change was made because the projective transformation used for automated region detection requires four points. Annex C, Table C.1, row I of the standard states, "Asymmetric features for automatic target detection. These features should be placed within the 4:3 active area aspect ratio, but may be placed for convenience as dictated by use cases."
  • The focus-aid patterns in the center of the squares are different from the patterns illustrated in the ISO standard document (which are not described in the standard): they are square (which allows more room for the slanted-edge regions used for measuring sharpness), and they have been designed to minimize interference with automatic region detection. They have no effect on measurement results.
  • A 20-patch OECF gray scale pattern is used. Annex C states, "The test chart also includes grey scale patches which are used to determine the OECF. While the example chart in Figure C1 uses 16 OECF test patches; a 20 patch version as described in ISO 14524 may also be substituted."

The enhanced and extended charts add features to regions of the chart that are not specified by the ISO standard (but don't violate it), and which will be valuable to most users.

eSFR ISO chart types
Chart type Features Notes
Standard Closest to chart illustrated in the standard document. No added features. Cannot measure sharpness near the sides or edges of the image. Use only if required. The Enhanced or Extended charts are recommended for most purposes.
Enhanced 3:2 aspect ratio. 6 added squares on sides; several added hyperbolic wedges; 16 added color patches in Imatest-produced inkjet and 8x10 inch LVT charts. Best for 4:3 or 3:2 aspect ratios (camera phones, compact cameras, DSLRs)
Includes several hyperbolic wedges with properties similar to the ISO (CIPA) visual resolution test chart, which is supported (with manual ROI detection) by the Imatest Wedge module.
Extended 16:9 aspect ratio. Same added features as enhanced chart. Best for cameras with 3:2 or 16:9 aspect ratios (DSLRs, HDTV and cinema formats)

eSFR ISO chart print options (can be selected when ordering)
  Options Notes
Chart aspect ratio 3:2 (Standard & Enhanced) or
16:9 (Extended)
3:2 charts (Standard and Enhanced) are well-suited for DSLRs (3:2 aspect ratio) and compact digital cameras and camera phones (4:3 aspect ratio). The 16:9 (Extended) chart is well-suited for HDTV (16:9 aspect ratio) and for DSLRs (3:2 aspect ratio).
Contrast
4:1  only 4:1 contrast is specified in the new ISO 12233:2014 (and 2017) standard.
Grayscale
stepchart
Included (below center) A 20-patch ISO 14524 circular grayscale pattern is included.
Color chart 16 patches Included in all inkjet-printed Enhanced and Extended inkjet charts (all sizes) and in LVT film charts (up to 8x10 inches) produced by Imatest. (Will not be available on reflective photographic charts, which are not yet available.)
Pre-distorted
Undistorted (standard), two standard levels of pre-distortion, custom pre-distortion
Pincushion pre-distortion is available for use with fisheye (strongly barrel-distorted) lenses. Available in matte surface only. See Pre-distorted SFRplus and eSFR ISO charts for Fisheye Lenses.
Extra wedges Standard (4 wedge pairs),
Extra wedges
Standard Enhanced and Extended charts have 4 pairs of low and high frequency wedges. The version with extra wedges has at least 12 additional high frequency wedges: 4 near the center, 8 near the corners.
Media (Surface)

Matte inkjet
Semigloss inkjet
Photographic reflective
LVT film: color up to 8x10 inch; B&W up to 12x20 inch

Semigloss inkjet is slightly sharper and has a more accurate grayscale in the deep tones (print densities > 1.5) than matte inkjet, but is more susceptible to glare (specular reflections), especially with wide angle lenses. Matte surface is recommended for wide angle lenses.

Photographic charts (reflective and LVT film transmissive) are much finer than inkjet: the same size chart is capable of analyzing much higher resolution cameras.

The Imatest eSFR ISO module

The new Imatest eSFR ISO module performs highly automated measurements of several key image quality factors using versions of the new ISO 12233:2017 E-SFR (Edge SFR) test chart that may be purchased from the Imatest store (recommended) or printed on a high-quality inkjet printer. Unlike most other Imatest modules (except for SFRplus, which it closely resembles), the user does not need to manually select Regions of Interest (ROIs). Image quality factors include:

  • Sharpness: expressed as Spatial Frequency Response (SFR) and also known as Modulation Transfer Function (MTF).
  • Noise:  measured from the grayscale patches surrounding the center of the chart, includes all types of noise calculated by Multicharts and Multitest (standard pixel noise, chroma noise, scene-referenced noise, sensor (raw) noise, and ISO-15739 visual noise). SNR (Signal-to-Noise Ratio) can also be displayed as a ratio or in dB.
  • Lateral Chromatic Aberration
  • Distortion (with less detail than the Distortion module). Details in SFRplus Distortion and Field of View measurements.
  • Tonal response (with less detail than Stepchart; no noise statistics yet).
  • Color accuracy, when used with an eSFR ISO chart that contains the optional color pattern, located above the central square.
  • ISO sensitivity (Saturation-based and Standard Output Sensitivity), when incident lux is entered.
  • Onset of aliasing and Moiré, measured  from the four pairs of wedges in the Enhanced and Extended charts, whose spatial frequency range is the same as the separate ISO 12233:2017 wedge chart. Figures and results are identical to the Wedge module.

All chart features— slanted-edges, grayscale patches, color patches, and wedges— are located automatically.

eSFR ISO operates in two modes:

  • Interactive/setup mode (run by pressing Rescharts or eSFR ISO setup in the Imatest main window), which allows you to select settings and interactively examine results in detail.
  • Auto mode (run by pressing eSFR ISO Auto in the Imatest main window), which runs automatically with no additional user input. ROIs are located automatically based on settings saved from the interactive/setup mode. This allows images of different sizes and framing to be analyzed with no change of settings. Auto mode works with large batches of files, and is especially useful for automated testing, where framing may vary from image to image.

Click on any of the thumbnails below (or on the image itself, repeatedly) to explore some of the many capabilities of eSFR ISO. Note the description below the image. Results are described in more detail in eSFR ISO Part 3.

[portfolio_slideshow id=8277 pagerpos=top width=720 height=600 centered=true navpos=disabled thumbnailsize=92 thumbnailmargin=6]

Advantages of the ISO 12233:2023 Edge SFR chart
over the old ISO 12233:2017 chart

  • The 2014/2017 "slanted square" test pattern has been replaced with the "four-cycle slanted star" test pattern to provide supplementary sagittal and tangential SFR measurements, in addition to vertical and horizontal measurements.

  • 2 additional color patches have been added to the 2023 chart, which correspond to patches 8 and 12 of row 2 in a 24 patch Colorchecker.
  • Logarithmic wedges that work across a a wide range of resolutions are now standard, rather than hyperbolic or linear.

Advantages of the ISO 12233:2017 Edge SFR chart
over the old ISO 12233:2000 chart

Note: the old ISO 12233:2000 standard and chart, shown on the right, is referenced in the new ISO 122433:2017 standard, but is no longer an official part of the standard. The new standard specifies three charts, one of which is a slanted-edge (Edge SFR or E-SFR) chart with much lower contrast (4:1; shown on the right, below).

Compared to the old ISO 12233 chart:

  • The new eSFR ISO chart has much less wasted area, especially in the Enhanced and Extended versions. About 90% of the old ISO chart is covered with patterns that have little value for computer analysis.
  • You can produce a detailed map of sharpness (MTF) over the image surface with the Enhanced and Extended charts. This cannot be done with the old ISO chart because there are not enough suitable edges— and they are not well-located.
  • ISO 12233:2017 Edge SFR chart

    Automated region detection, based on location criteria you enter. This makes the eSFR ISO chart and module well-suited for automated testing: with the old ISO chart, regions of interest (ROIs) had to be selected carefully whenever the image framing changed, even slightly.

  • The 4:1 contrast edges are less likely to clip than the edges in the old ISO chart, whose contrast is specified at ≥ 40:1. The camera operates in a more linear region, and hence results are more consistent and accurate— less affected by overexposure, underexposure, incorrect gamma estimate, or excessive software sharpening. 4:1 contrast edges are also more representative of real edges that affect perceived image sharpness.
  • eSFR ISO can measure additional image quality factors, including lateral chromatic aberration, distortion, gamma (contrast), tonal response and color accuracy (in charts that have the color pattern).
  • The old ISO 12233:2000 chart contains no information that can be used to measure gamma (the average slope of the Log pixel vs. log exposure curve. i.e., the contrast), which is needed to linearize the image for the MTF calculation. Accurate gamma measurement is particularly important with high contrast targets. In the eSFR ISO chart, gamma can be derived either from the individual squares (which have a known 4:1 contrast) or from the grayscale step chart.

Compared to the SFRplus chart:

  • The map of MTF over the image surface has less detail.
  • Distortion measurements are slightly less accurate (especially for the Standard chart) because there are no distortion bars and there are fewer features for measuring distortion.
  • A detailed noise analysis (including all the types of noise measured in Multicharts and Multitest) is available.
  • A Wedge analysis (including onset of aliasing and Moiré) is available. The standard chart has 4 pairs of added wedges. A version of the chart with at least 12 extra wedges (4 near center, 8 near corners) is available.