• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Wang, Jin (Wang, Jin.) | Wang, Chen (Wang, Chen.) | Huang, Qingming (Huang, Qingming.) | Shi, Yunhui (Shi, Yunhui.) | Cai, Jian-Feng (Cai, Jian-Feng.) | Zhu, Qing (Zhu, Qing.) (Scholars:朱青) | Yin, Baocai (Yin, Baocai.)

Indexed by:

CPCI-S EI Scopus

Abstract:

Image inpainting methods usually fail to reconstruct reasonable structure and fine-grained texture simultaneously. This paper handles this problem from a novel perspective of predicting low-frequency semantic structural contents and high-frequency detailed textures respectively, and proposes a multi-frequency probabilistic inference model(MPI model) to predict the multi-frequency information of missing regions by estimating the parametric distribution of multi-frequency features over the corresponding latent spaces. Firstly, in order to extract the information of different frequencies without any interference, wavelet transform is utilized to decompose the input image into low-frequency subband and high-frequency subbands. Furthermore, an MPI model is designed to estimate the underlying multi-frequency distribution of input images. With this model, closer approximation to the true posterior distribution can be constrained and maximum-likelihood assignment can be approximated. Finally, based on the proposed MPI model, a two-path network consisting of inference network(InferenceNet) and generation network(GenerationNet) is trained parallelly to enforce the consistency of global structure and local texture between the generated image and ground truth. We qualitatively and quantitatively compare our method with other state-of-the-art methods on Paris StreetView, CelebA, CelebAMask-HQ and Places2 datasets. The results show the superior performance of our method, especially in the aspects of realistic texture details and semantic structural consistency.

Keyword:

probabilistic inference model wavelet transform GenerativeAdversarial Networks (GANs) image inpainting

Author Community:

  • [ 1 ] [Wang, Jin]Beijing Univ Technol, Beijing, Peoples R China
  • [ 2 ] [Wang, Chen]Beijing Univ Technol, Beijing, Peoples R China
  • [ 3 ] [Shi, Yunhui]Beijing Univ Technol, Beijing, Peoples R China
  • [ 4 ] [Zhu, Qing]Beijing Univ Technol, Beijing, Peoples R China
  • [ 5 ] [Yin, Baocai]Beijing Univ Technol, Beijing, Peoples R China
  • [ 6 ] [Huang, Qingming]Univ Chinese Acad Sci, Beijing, Peoples R China
  • [ 7 ] [Cai, Jian-Feng]Hong Kong Univ Sci & Technol, Hong Kong, Peoples R China

Reprint Author's Address:

Show more details

Related Keywords:

Related Article:

Source :

MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA

Year: 2020

Page: 1-9

Cited Count:

WoS CC Cited Count: 8

SCOPUS Cited Count: 7

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

Affiliated Colleges:

Online/Total:476/10650238
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.