Imatest attended the P2020 meeting on May 13 and 14, 2019 in Ann Arbor, Michigan. Paul Romancyzk, PhD., Senior Imaging Scientist, and Rob Sumner, Lead Engineer, represented Imatest. Paul co-led the discussion on Color Separation within the Image Quality for Machine Vision subgroup.
Imatest will attend AutoSens in Detroit on May 14-16, 2019. AutoSens is a 3-day workshop, conference, and exhibition advancing the education for and development of vehicle perception technology. It brings together over a thousand minds in vehicle perception, ADAS, and autonomous vehicles twice a year—in Detroit, Michigan USA in May, and Brussels, Belgium in September. Each event includes conference sessions, discussions, collaborations, debates, networking, business meetings, interactive learning, autonomous driving demonstrations, and technology exhibition showcasing.
Imatest sent two engineers to the IEEE P2020 Automotive Imaging Quality face-to-face meeting in Dusseldorf, Germany this past February in 2019. The IEEE P2020 standard, which is still in development, aims to define KPIs and test procedures to address the many challenges relevant (and often unique) to automotive imaging.
The group hopes to publish the standard in the year 2020 (no relation to the standard’s identifying number) as a unifying guideline for developers of autonomous driving systems. Most driver-assist and autonomous-driving systems rely heavily on cameras despite the significant press other imaging modalities, such as LIDAR, have received. As Level 3, 4, and 5 autonomous vehicles start to come on the road in 2020 and beyond, it is vital that these systems have an agreed-upon set of rigorous performance metrics. (more…)
Imatest partnered with Shenzhen Polytechnic University to support the digital image quality testing curriculum at the university. With the expansion of their image quality program, Imatest sponsored and authorized the development of a state of the art research and education lab.
The lab and ceremony
On October 31st, 2018, Henry Koren, Director of Engineering, and Ian Longton, Imaging Science Engineer joined Shenzhen Polytechnic Executive Vice Presidents of Communication Engineering, Dean He Yuhua and Yang Yunyan, Vice President Zhang Xuilang, and Colorspace General Manager Nick Liu and colleagues for the official unveiling ceremony.
Learn more about the development of standards for automotive camera systems.
The IEEE-SA P2020 is a working group for automotive imaging standards. Their goal is to define a set of standards to resolve the current ambiguity in the measurement of image quality in automotive imaging systems. Generally, today’s image evaluation approaches do not adequately address the unique needs of either the human or computer-vision based automotive applications; therefore IEEE-SA P2020 is working with people in the field, understanding the gaps in current standards, and creating a coherent set of key performance indicators by which automotive camera systems might consistently be evaluated. (more…)
By Robert Sumner
With contributions from Ranga Burada, Henry Koren, Brienna Rogers and Norman Koren
Consistency is a fundamental aspect of successful image quality testing. Each component in your system may contribute to variation in test results. For tasks such as pass/fail testing, the primary goal is to identify the variation due to the component and ignore the variation due to noise. Being able to accurately replicate test results with variability limited to 1-5% will give you a more accurate description of how your product will perform.
Since Imatest makes measurements directly from the image pixels, any source that adds noise to the image can affect measurements. A primary source of noise in images is electronic sensor noise. Photon shot noise also contributes significantly in low-light situations. Other systemic sources of measurement variability, such as autofocus hysteresis, will not be addressed in this post.
Here are 5 tips to limit noise in your test results: (more…)
We now offer a complete, customizable image quality testing solution for Security camera systems to provide our customers with an easy, effective way to outfit their labs. While working with some of the top security camera manufacturers, our engineers have compiled all of the necessary lab materials in a convenient package. The package includes options for software; reflective, transmissive, tunable, and ultra-wide light sources; test fixtures for a variety of fields-of-view and focus distances; and applicable test charts to analyze crucial image quality factors.
The Security package includes two software options, Master and Ultimate. The Master version, designed for R&D testing, is a robust analysis tool to help you measure any and every image quality factor of your camera system. The Ultimate version combines Master and IT, an automated production line testing version, and is a cost-effective solution for customers who manage R&D and production testing. Read more about our software version and license options here.
We include several test fixtures that help test varying fields-of-view (FOV) and focus distances properly. For ultra-wide testing with fields-of-view up to 270˚, our Ultra-Wide Test Fixture works perfectly to help analyze image quality factors such as sharpness and chromatic aberration using our eSFR ISO and SFRreg charts. If you have long-range testing requirements, we’ve included several collimator lenses and target projection systems to help you to test at or beyond your focusing distance. To automate and provide more flexible positioning, add one of the robotic automation fixtures from our partners Sofica and IQL.
Choose from a variety of reflective, transmissive, tunable, and ultra-wide lighting system options. We have included our most widely used reflective light source; the Kino Flo FreeStyle 31 LED DMX for its adjustability, portability, and high-illumination output. To test dynamic range, and high-resolution systems, select a uniform, transmissive LED light box with Lux levels ranging from 10,000 – 100,000. The brightest lightbox enables you to achieve IEC 62676 compliance. For the most adjustability in spectral and Lux levels, and for ultra-wide field-of-view uniformity testing, choose one of our tunable light sources such as the wide-FOV version of the Gamma Scientific RS-7.
To make your selections easier, we have included the most appropriate test charts to meet a variety of requirements for security cameras. For reflective resolution needs, select from our ISO 12233:2014 compliant multi-feature test charts, a Checkboard chart, or sinusoidal siemens star pattern chart. For use with the transmissive, uniform light sources and dynamic range and high-resolution testing, choose to use our ISO 12233:2014 chart printed on High-Precision LVT Film, and our Ultra-High Dynamic Range test chart.
View the package, the options included, and receive a quote by visiting our store.Check It Out Now
Of course, we know that not everyone’s requirements are the same, so if the package doesn’t seem to be a good fit for you talk to a solution expert and we will customize a solution for your unique needs.
Our engineers are continually adding new features and updating Imatest software to provide you with the best analysis tool on the market. In our most recent release, our team has added several new modules to provide you better analysis tools. Here are the top three new features, and why should upgrade to Imatest 5.1:
- Compensate for chart MTF to perform accurate high-resolution or close-distance sharpness tests
MTF Compensation reduces the impact of the chart on measured imaging system MTF.
- Geometrically calibrate single or multi-camera devices obtaining camera intrinsic and extrinsic matrices for accurate machine vision and ADAS applications
A geometrically calibrated device provides a mapping between pixel coordinates and real-world position.
- Direct image acquisition for Sony sensors
Imatest now supports direct image acquisition from Sony sensor development boards through the Sony AYA software tool.
This week, we launched Imatest 5.0. We built Imatest 5.0 to provide users with a streamlined workflow for more efficient image quality analysis. Here are five reasons to start using Imatest 5.0 today.
Refined User Experience
Imatest 5.0 features several new tools and enhancements across our products to help you improve your workflow. Whether you want to reduce the number of images needed for complete system qualification with Arbitrary Charts; process a collection of images with automated analysis routines within the brand new Test Manager, or process batches of images with our enhanced image processing module, Imatest 5.0 is an improved experience for users needing an expedited testing process.
Innovative Image Quality Measurements
The newest release provides several new and enhanced measurements to help your focus on the image quality factors that matter to your business’ camera system.
- Contrast Resolution was designed for the visualization and measurement of contrast separation. This is particularly important for the automotive industry where camera systems need to distinguish between low contrast objects in a larger field with varying ranges of brightness.
- The ISO 18844 flare measurement added to the Uniformity module was created to address the need to accurately measure veiling glare.
- The enhancements to the SFRreg Center Chart provides geometric utilities for measuring tilt and rotational measurements, an especially important factor for users needing to test wide-angled measurements.
Focus on the image quality factors that matter most
Imatest tools serve many industries with widely varying requirements, for example testing an automotive camera system is different from testing a consumer device. Even within one industry, companies need to test several image quality factors on several test charts, complicating the capture analysis workflow. Imatest 5.0 lets you zero in on the image quality factors and results that matter most to your business.
- Customizable reports allows users to more efficiently filter and present select image quality data from a variety of image quality factors.
- The new arbitrary charts functionality serves a similar purpose by letting users define efficient layouts of analysis features within one chart.
Enhanced support for industry standards
Industry standards provide a foundation for the testing and analysis of imaging systems and clearly define testing methods for reliable measurements of system performance. Imatest 5.0 goes along way to support and supplement industry testing standards.
Run predefined test plans for standard testing procedures such as CPIQ within the new Test Manager.
The new P1858 Variant Combo chart, supported by Arbitrary Charts, combines several analysis features required by the standard into one chart. This enables users to minimize the number of images needed in the testing process and increases testing efficiency and accuracy.
Imatest 5.0 also features an enhanced Uniformity module to support the ISO 18844 standard for image flare measurements on digital cameras. The standard was created to address some of the difficulties of making ISO 9358 measurements with cameras.
Streamlined Product Line
The Imatest 5.0 release includes the streamlining of the Imatest product line. As of Imatest 5.0, Imatest Master will now includes image acquisition capabilities that were previously available in Imatest IS, which is now discontinued. Imatest users will now have access to the acquisition library. The library supports direct acquisition from a wide range of frame grabbers and cameras, as well as industry standard interfaces like CameraLink, GigE Vision, and USB through DirectShow (Windows) or QuickTime (OS X). Direct image acquisition cuts out several steps in the image quality testing process and allows for in-the-loop testing with Imatest.
In order to maximize performance in the new Test Manager, we utilized parallel processing. Previously, parallel processing was only available in Imatest IT-P. With the release of Imatest 5.0, Imatest IT-P functionality is now included in Imatest IT . This enables all Imatest users to rapidly process large volumes of images. By utilizing high-performance processors with 6+ cores, parallel processing can improve throughput by over 2.5x.
Imatest is pleased to unveil updated documentation for Imatest IT. The documentation has been updated to include the latest software release (Imatest 4.5), including details for new features, filtering options for preferred languages, and several new Troubleshooting articles.
Users can now filter Imatest IT instructions for their preferred languages and interfaces including C, C++, Python, .NET (C# and Visual Basic), and EXE. In addition, there are now more detailed installation and setup instructions for both Windows and Linux versions.
Imatest IT ships with several example projects in C++, Python, C#, and Visual Basic. You can find them in the samples folder of your IT installation, along with example images of Imatest test charts that can be used for each of IT’s analysis modules.
Automating Lab and Manufacturing Processes – [Webinar]
By Ranga Burada
Autofocus plays a major role in many camera system applications with variable focus, including consumer electronic devices. Camera systems must be able to focus at a variety of distances. Optical systems on cameras only allow a certain range of distances from the camera to be in focus at once (this is often known as the depth of field, or depth of focus). The distance from the camera where objects will be most in focus, effectively the center of this range, is the focus distance—the role of the autofocus system in a camera is to set this point accurately every time.
We refer to autofocus consistency as the ability of a camera to focus on a given point correctly, repeatedly. To determine if a point is in focus, we measure the sharpness of an object (specifically, a test chart) at that distance. By taking many images of the chart—and letting the autofocus system reset each time and try to focus on the chart anew—we can tell if the camera system is focusing consistently or not. By examining the MTF50 values calculated from these images—a common objective image quality metric which correlates well with perceived sharpness—we can tell if sharpness varied between captures, and thus if focus accuracy on the chart varied. (more…)
Over the last few years, the automotive industry has taken great strides to incorporate camera systems into vehicles. From ADAS to rear-view cameras, there are many applications for camera systems in vehicles.
With this integration of camera systems in the automotive industry, companies now have a variety of image quality factors to verify and standards to adhere to.
Imatest is a leader in image quality testing solutions for the automotive industry. Join us for this free webinar to learn more about image quality testing in the automotive industry.
During this webinar, you can expect to learn:
- An introduction to image quality factors and industry standards
- What image quality factors matter most to the automotive industry
- An overview of tests to deploy for automotive camera systems
- How to begin testing your camera systems
For many engineers tasked with designing camera systems for a product, image quality testing is a complicated endeavour given the variety of test charts and measurements available.
Understanding which image quality factors to measure in your product and how to interpret results will ensure your product is equipped with quality imaging systems.
Join us on October 12, 2016 for a free webinar, Fundamentals of Image Quality Testing, presented by Imatest’s Director of Engineering, Henry Koren.
Imatest 4.5 is the most powerful version of the platform yet with enhancements and additions for a variety of industries, including automotive, medical, consumer electronics, security, and more. The newest features give users increased flexibility in the range of target distances and light levels to improve your high-speed, automated testing.
To learn more, please visit imatest.com/4.5.
Imatest is pleased to announce their partnership with Sofica, a group of camera algorithm validation and test automation experts based in Finland. This partnership will bring mobile device customers a revolutionary, robot-aided R&D test automation system integrated with Imatest analysis software and test charts.
What is CPIQ?
IEEE-SA working group P1858 created the CPIQ standard. CPIQ seeks to standardize image quality test metrics and methodologies across the mobile device industry, correlate objective test results with human perception, and combine this data into a meaningful consumer rating system.
CPIQ serves as a way to assess and communicate image quality to the vast majority of consumers who are unsure how to judge and compare device image quality.
Imatest is pleased to announce the release of version 4.4, which includes the following features:
Support for all 2016 Camera Phone Image Quality (CPIQ) standard metrics for mobile device image quality. CPIQ serves as a way to assess and communicate image quality to the vast majority of consumers who are unsure how to judge and compare device image quality. See a full CPIQ overview.
Now available for download
Main features include:
- Support for all CPIQ metrics for 2016 international standards for mobile device image quality.
- Autofocus, Auto White Balance, and Auto Exposure metrics for faster image adjustments.
- Additional controls for Image Sensor (IS) device management.
- Floating Licenses adds flexibility for shared work environments.
- Image processing module to assess the effect of standard image processing algorithms on image quality.
Imatest is pleased to announce our partnership with isMedia, a specialist in building digital imaging test machines and custom test solutions. This partnership will provide customers with a wide range of highly customizable test machines capable of extensive image quality analysis on manufacturing lines.