UNIQUE

The codebase for
Uncertainty-aware blind image quality assessment in the laboratory and wild (TIP2021) and
Learning to blindly assess image quality in the laboratory and wild (ICIP2020)

Prequisite:

Python 3+
PyTorch 1.4+
Matlab
Successfully tested on Ubuntu18.04, other OS (i.e., other Linux distributions, Windows)should also be ok.

Usage

Sampling image pairs from multiple databases

data_all.m

Combining the sampled pairs to form the training set

combine_train.m

Training on multiple databases for 10 sessions

python Main.py --train True --network basecnn --representation BCNN --ranking True --fidelity True --std_modeling True --std_loss True --margin 0.025 --batch_size 128 --batch_size2 32 --image_size 384 --max_epochs 3 --lr 1e-4 --decay_interval 3 --decay_ratio 0.1 --max_epochs2 12

(As for ICIP version, set std_loss to False and sample pairs from TID2013 instead of KADID-10K.) (For training with binary labels, set fideliy and std_modeling to False.)

Output predicted quality scores and stds

python Main.py --train False --get_scores True

Result anlysis

Compute SRCC/PLCC after nonlinear mapping: result_analysis.m
Compute fidelity loss: eval_fidelity.m

Pre-trained weights

Google: https://drive.google.com/file/d/18oPH4lALm8mSdZh3fWK97MVq9w3BbEua/view?usp=sharing

Baidu: https://pan.baidu.com/s/1KKncQIoQcbxj7fQlSKUBIQ code：yyev

A basic demo: python demo.py

Link to download the BID dataset

The BID dataset may be difficult to find online, we provide links here:

Google: https://drive.google.com/drive/folders/1Qmtp-Fo1iiQiyf-9uRUpO-YAAM0mcIey?usp=sharing

Baidu: https://pan.baidu.com/s/1TTyb0FJzUdP6muLSbVN3hQ code: ptg0

Training/Testing Data

In addition to the source MATLAB code to generate training/testing data, you may also find the generated files here (If you do not want to generate them yourselve or if you do not have MATLAB):

Google: https://drive.google.com/file/d/1u-6xmedUB0PNA5xM787OY-YfiJg195xA/view

Baidu: https://pan.baidu.com/s/12nb6OTUxnz_rxssg2rthIQ code: 82k3

Citation

@article{zhang2021uncertainty,
title={Uncertainty-aware blind image quality assessment in the laboratory and wild},
author={Zhang, Weixia and Ma, Kede and Zhai, Guangtao and Yang, Xiaokang},
journal={IEEE Transactions on Image Processing},
volume = {30},
pages = {3474--3486},
month = {Mar.},
year={2021} }

@inproceedings{zhang2020learning,
title={Learning to blindly assess image quality in the laboratory and wild},
author={Zhang, Weixia and Ma, Kede and Zhai, Guangtao and Yang, Xiaokang},
booktitle={IEEE International Conference on Image Processing},
pages={111--115},
year={2020} }