Asus Zenfone 11 Ultra Camera Test

For evaluation and analysis, SBMARK engineers capture and evaluate more than 2,600 test images in both controlled laboratory environments and natural outdoor, indoor and low-light scenes, using default camera settings. The photographic protocol is designed to account for key use cases and is based on typical shooting scenarios, such as portrait, family and landscape photography. Evaluation is performed by visually inspecting images Cons a natural scene reference and performing objective measurements on chart images captured in the laboratory under various lighting conditions from 1 to 1,000+ lux and color temperatures from 2,300K to 6,500K.

Exposure and color are the key attributes for technically good images. For exposure, the primary attribute evaluated is the brightness of the main subject across various use cases such as landscape, portrait, or still life. Other factors evaluated are contrast and dynamic range, such as the ability to render details in both the bright and dark areas of the image. Repeatability is also important because it demonstrates the camera’s ability to provide the same rendering when taking multiple images of the same scene.
For color, the image quality attributes analyzed are skin tone rendition, white balance, color hue, and repeatability. For color and skin tone rendition, we penalize unnatural colors but respect the manufacturer’s choice of color signature.

Autofocus tests focus on focus accuracy, focus repeatability, shutter lag, and depth of field. Shutter lag is the difference between when the user presses the capture button and when the image is actually taken. It includes the speed of focusing and the ability of the device to capture images at the right time, what is called “zero shutter lag” capability. While a shallow depth of field can be nice for a single subject portrait or a close-up shot, it can also be a problem in some specific conditions such as group portraits; both are tested. Focus accuracy is also evaluated in all real-world images taken, from infinity to close-up objects and in low-light conditions to outdoors.

Texture tests analyze the level of detail and texture of subjects in images shot in the lab and in real-life scenarios. For natural shots, special attention is paid to the level of detail in the bright and dark areas of the image. Objective measurements are performed on chart images taken under various lighting conditions from 1 to 1000 lux and different types of dynamic range conditions. The charts used are the proprietary SBMARK (DMC) chart and the Dead Leaves chart.

Noise tests analyze various noise attributes such as intensity, chromaticity, grain, structure on real images and chart images taken in the laboratory. For natural images, special attention is paid to noise on faces, landscapes, but also on dark areas and high dynamic range conditions. Noise on moving objects is also evaluated on natural images. Objective measurements are performed on chart images taken in various conditions from 1 to 1000 lux and different types of dynamic range conditions. The chart used is the Dead Leaves chart and the measurement standardized as Visual Noise derived from ISO 15739.

Artifact grading examines lens shading, chromatic aberrations, geometric distortion, edge ringing, halos, ghosting, quantization, unexpected color shifts, among other types of possible unnatural effects on photos. The more severe and frequent the artifact, the higher the points deducted from the score. The main artifacts observed and the corresponding loss of points are listed below.

Bokeh is tested in a dedicated mode, usually portrait mode or aperture, and analyzed by visually inspecting all images captured in the lab and in natural conditions. The goal is to reproduce a portrait photograph comparable to that taken with a DLSR and a wide aperture. The main image quality attributes that are paid attention to are depth estimation, artifacts, blur gradient, and the shape of the bokeh blur reflectors. Portrait image quality attributes (exposure, color, texture) are also taken into account.

Preview tests analyze the image quality of the camera app’s image preview, with a focus on the difference between capture and preview, particularly with respect to dynamic range and the application of bokeh. The smoothness of exposure, color, and focus adaptation when zooming from the minimum to the maximum zoom factor available is also evaluated. Preview frame rate is measured using the LED Universal Timer.

SBMARK engineers capture and evaluate over 400 test images in controlled laboratory environments and in natural outdoor, indoor and low-light scenes, using camera presets and pinch zoom at various zoom factors from ultra-wide to ultra-long range zoom. Evaluation is performed by visually inspecting images Cons a natural scene reference and by performing objective measurements of lab-captured chart images under various conditions from 20 to 1000 lux and color temperatures from 2300K to 6500K.

These tests analyze the performance of the ultra-wide-angle camera at different focal lengths from 12mm to 20mm. All image quality attributes are evaluated, with particular attention to artifacts such as chromatic aberrations, lens softness, and distortion. The images below are an excerpt of tested scenes.

All image quality attributes are evaluated at focal lengths from approximately 40mm to 300mm, with particular attention to texture and detail. The score is derived from a series of objective laboratory measurements and perceptual analysis of real images.

SBMARK engineers capture and evaluate more than 2.5 hours of video in controlled laboratory environments and natural low-light scenes, indoors and outdoors, using the camera’s default settings. The evaluation consists of visually inspecting natural video captured under various conditions and performing objective measurements on lab-recorded chart videos under various conditions from 1 to 1000+ lux and color temperatures from 2,300K to 6,500K.

Exposure tests evaluate the brightness of the main subject and the dynamic range, i.e. the ability to make details visible in both the bright and dark areas of the image. Exposure stability and temporal adaptation are also analyzed.
Image quality color analysis examines color rendition, skin tone rendition, white balance, color hue, white balance stability and its adaptation to changing light.

Texture tests analyze the level of detail and texture of real videos and laboratory-recorded graphic videos. Natural video recordings are evaluated visually, with particular attention to the level of detail in bright and dark areas. Objective measurements are performed on graphic images taken under various conditions from 1 to 1000 lux. The graphs used are the SBMARK (DMC) graph and the Dead Leaves graph.

Noise tests analyze various noise attributes such as intensity, chromaticity, grain, structure, temporal aspects on real video recordings and lab-shot chart videos. Natural videos are evaluated visually, with special attention to noise in dark areas and under high dynamic range conditions. Objective measurements are performed on chart videos recorded under various conditions from 1 to 1000 lux. The chart used is the SBMARK Visual Noise Chart.

Stabilization rating tests the device’s ability to stabilize footage using software or hardware technologies such as OIS, EIS, or any other means. The rating looks at residual motion, smoothness, yellow artifacts, and residual motion blur in walking and running usage cases under various lighting conditions. The video below is an excerpt from one of the scenes tested.

Artifacts are evaluated with MTF and ringing measurements on the SFR chart in the lab, as well as frame rate measurements using the LED Universal Timer. Natural videos are evaluated visually with special attention to artifacts such as aliasing, quantization, blocking, and hue shift, among others. The more severe and frequent the artifact, the higher the points deducted from the score. The main artifacts and the corresponding point loss are listed below.