With Imatest 22.2, a user can evaluate auto-exposure on an appropriate video file using the Color/Tone feature.

(In Imatest 4.4+ the ability to evaluate auto-exposure (AE) as a measure of OECF with respect to time was added. This can still be performed by using the Stepchart module ).

Related pages Auto Exposure
in Color/Tone
Autofocus Speed
in SFR
Auto White balance
in Color/Tone
This metric is intended to be used as a way to measure the time a camera system takes to auto-expose a scene. Rise time and settling time are automatically calculated.This measurement does not provide information about the accuracy or precision of auto-exposure. To evaluate those measures, several measurements should be performed on the final, settled images and compared.

File Selection 

  1. Select a Video File
  2. Select the appropriate Target (the chart that was used for the video). In this example, we have used Colorchecker 24, which uses Color/Tone Analysis.

  3. Be sure to select Auto(batch) mode.

  4. Click Analyze to Start the Analysis.

 

Frame Selection

 

Select the Plot metric with respect to time: Mean normalized pixel level option and select a range of frames that covers from out-of-focus to in-focus for at least 1-2 seconds.

Any shorter and you risk not having enough frames to ensure the AE system has settled completely.

For more details on supported video formats, see Image file formats and acquisition devices

AE Video Frame Selection

Video Selection window

Region Selection

Select the Region to be analyzed.

ROI Selection

 

Region Selection window

Note that when selecting regions, the first frame in the sequence is used since that frame should be completely in-focus, making region selection easier.

Color/Tone Auto Settings

There are 4 new Temporal Video Analysis checkboxes near the bottom of the Settings window.

For auto exposure (AE)  Analysis, choices are any or all of:

  • Temporal Video Analysis: Mean Normalized Pixel Level
  • Temporal Video Analysis: Exposure Error
  • Temporal Video Analysis: CPIQ Exposure Quality Loss

Temporal Video Analysis Options

The 4th Temporal Video Analysis option (Correlated Color Temperature) allows the analysis of Auto White Balance.

Save Options

Checkboxes on the Save Results page allow Saving of any or all of the plots, as well as JSON and/or CSV reports.

Auto Exposure Save Options

Outputs

The final output figure will be displayed at the end of the run and saved to the output save directory if selected.

If no plot options are selected, nothing will be displayed. CSV and JSON outputs will always be saved to the output save directory.

AE Pixel level

Auto exposure – Mean Normalized Pixel Level Output

The Mean Normalized Pixel Level plot will contain the mean pixel level with respect to time for each patch of the measured chart.

The time axis (x-axis) will be in units of seconds and will be in units of absolute time from the video file.

The figure will also contain some details about the run including ROI size, in and out points in the video file, total time range, settling time, 10-90% rise time, and total frames analyzed.

Settling time and rise time are calculated on the grey patch of the chart.

 

CPIQ plot

 

 

Exposure Error plot

 

 

JSON

The JSON output file will contain the following structure:

(this assumes all boxes were checked)

ImatestResults:

  • TemporalVideoAnalysis:
    • Video: VideoName
    •  VideoDimensions:
      • Width: Video width in pixels
      • Height: Video height in pixels
    • InPoint: The selected in-point for the video in seconds
    • OutPoint: The selected out-point for the video in seconds
    • TotalTime: The total time evaluated (equivalent to OutPoint – InPoint)
    • TotalFrames: The total number of frames analyzed. Depending on whether or not the video is variable frame-rate, this may not be equivalent to TotalTime*fram-rate.
    • MeanNormalizedPixelLevel:
      • Metric: Mean Normalized Pixel Level
      • Units:
      • SettlingTime: The time taken for the specified metric to settle to +/- 5% of the mean in seconds
      • RiseTime: The time taken to go from 10% to 90% of the starting mean to the settled mean in seconds
      • DampingRatio: The damping ratio of the measured state change
      • Time: An array of measured time values in seconds
      • Data: The measured value for each point in time. In the units specified in Unit.
    • ExposureError:
      • Metric: Exposure Error
      • Units: f-stops
      • SettlingTime: The time taken for the specified metric to settle to +/- 5% of the mean in seconds
      • RiseTime: The time taken to go from 10% to 90% of the starting mean to the settled mean in seconds
      • DampingRatio: The damping ratio of the measured state change
      • Time: An array of measured time values in seconds
      • Data: The measured value for each point in time. In the units specified in Unit.
    • CPIQExposureQualityLoss:
      • Metric: CPIQExposureQualityLoss
      • Units: JND
      • SettlingTime: The time taken for the specified metric to settle to +/- 5% of the mean in seconds
      • RiseTime: The time taken to go from 10% to 90% of the starting mean to the settled mean in seconds
      • DampingRatio: The damping ratio of the measured state change
      • Time: An array of measured time values in seconds
      • Data: The measured value for each point in time. In the units specified in Unit.