• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Wang, Huasheng (Wang, Huasheng.) | Lou, Jianxun (Lou, Jianxun.) | Liu, Xiaochang (Liu, Xiaochang.) | Tan, Hongchen (Tan, Hongchen.) | Whitaker, Roger (Whitaker, Roger.) | Liu, Hantao (Liu, Hantao.)

Indexed by:

EI SCIE

Abstract:

When images undergo quality degradation caused by editing, compression or transmission, their saliency tends to shift away from its original position. Saliency shifts indicate visual behaviour change and therefore contain vital information regarding perception of visual content and its distortions. Given a pristine image and its distorted format, we want to be able to detect saliency shifts induced by distortions. The resulting saliency shift map (SSM) can be used to identify the region and degree of visual distraction caused by distortions, and consequently to perceptually optimise image coding or enhancement algorithms. To this end, we first create a largest-of-its-kind eye-tracking database, comprising 60 pristine images and their associated 540 distorted formats viewed by 96 subjects. We then propose a computational model to predict the saliency shift map (SSM), utilising transformers and convolutional neural networks. Experimental results demonstrate that the proposed model is highly effective in detecting distortion-induced saliency shifts in natural images.

Keyword:

Convolutional neural networks Saliency Visualization Computational modeling convolutional neural networks Image coding Distortion Gaze tracking transformer saliency shift Predictive models eye-tracking

Author Community:

  • [ 1 ] [Wang, Huasheng]Cardiff Univ, Sch Comp Sci & Informat, Cardiff CF244AG, Wales
  • [ 2 ] [Lou, Jianxun]Cardiff Univ, Sch Comp Sci & Informat, Cardiff CF244AG, Wales
  • [ 3 ] [Whitaker, Roger]Cardiff Univ, Sch Comp Sci & Informat, Cardiff CF244AG, Wales
  • [ 4 ] [Liu, Hantao]Cardiff Univ, Sch Comp Sci & Informat, Cardiff CF244AG, Wales
  • [ 5 ] [Liu, Xiaochang]Sun Yat Sen Univ, Sch Math, Guangzhou 510275, Peoples R China
  • [ 6 ] [Tan, Hongchen]Beijing Univ Technol, Inst Artificial Intelligence, Beijing 100124, Peoples R China

Reprint Author's Address:

  • [Lou, Jianxun]Cardiff Univ, Sch Comp Sci & Informat, Cardiff CF244AG, Wales;;

Show more details

Related Keywords:

Related Article:

Source :

IEEE TRANSACTIONS ON MULTIMEDIA

ISSN: 1520-9210

Year: 2024

Volume: 26

Page: 4938-4949

7 . 3 0 0

JCR@2022

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count: 1

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 4

Affiliated Colleges:

Online/Total:445/10569564
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.