No-Reference Quality Assessment of Pan-Sharpening Images with Multi-Level Deep Image Representations (original) (raw)
2022, Remote Sensing
The Pan-Sharpening (PS) techniques provide a better visualization of a multi-band image using the high-resolution single-band image. To support their development and evaluation, in this paper, a novel, accurate, and automatic No-Reference (NR) PS Image Quality Assessment (IQA) method is proposed. In the method, responses of two complementary network architectures in a form of extracted multi-level representations of PS images are employed as quality-aware information. Specifically, high-dimensional data are separately extracted from the layers of the networks and further processed with the Kernel Principal Component Analysis (KPCA) to obtain features used to create a PS quality model. Extensive experimental comparison of the method on the large database of PS images against the state-of-the-art techniques, including popular NR methods adapted in this study to the PS IQA, indicates its superiority in terms of typical criteria.
Related papers
Algorithm Selection for Image Quality Assessment
ArXiv, 2019
Subjective perceptual image quality can be assessed in lab studies by human observers. Objective image quality assessment (IQA) refers to algorithms for estimation of the mean subjective quality ratings. Many such methods have been proposed, both for blind IQA in which no original reference image is available as well as for the full-reference case. We compared 8 state-of-the-art algorithms for blind IQA and showed that an oracle, able to predict the best performing method for any given input image, yields a hybrid method that could outperform even the best single existing method by a large margin. In this contribution we address the research question whether established methods to learn such an oracle can improve blind IQA. We applied AutoFolio, a state-of-the-art system that trains an algorithm selector to choose a well-performing algorithm for a given instance. We also trained deep neural networks to predict the best method. Our results did not give a positive answer, algorithm se...
No Reference Image Quality Assessment based on Multi-Expert Convolutional Neural Networks
IEEE Access, 2018
No Reference (NR) Image Quality Assessment (IQA) algorithm is capable of measuring the quality of distorted images without referencing the original images. This property is of great importance in image processing, compression, and transmission. However, due to the diversity of the distortion types and image contents, it is difficult for the existing NR IQA algorithms to be applied and maintain the best performance for all cases. To address this problem, we develop a novel NR IQA algorithm based on multi-expert convolutional neural networks (CNNs), which consists of distortion type classification, CNN based IQA algorithms and fusion algorithm. First, we present a distortion type classifier to identify the distortion type of the input image. Then, we propose a multi-expert CNN based IQA algorithms for each type of distortion. Finally, a fusion algorithm is adopted to aggregate the classification result of distortion types and multi-expert CNN based image quality predictions. The propo...
Gradient-based Image Quality Assessment
2018
An objective measure for image quality assessment based on a direct comparison of visual gradient information in the test and reference images is proposed. A perceptual model is defined to provide local estimates of gradient preservation and investigate perceptual importance pooling of such local quality estimates by using the lowest scores. The proposed perceptual pooled measure is validated using extensive subjective test results. Results indicate that the proposed measure is perceptually meaningful in that it corresponds well with the results of subjective evaluation and can outperform actual objective metrics.
Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.