• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Wu, Lifang (Wu, Lifang.) (Scholars:毋立芳) | Zhang, Dai (Zhang, Dai.) | Jian, Meng (Jian, Meng.) | Yang, Bowen (Yang, Bowen.) | Liu, Haiying (Liu, Haiying.)

Indexed by:

CPCI-S EI Scopus

Abstract:

Content curation social networks (CCSNs), where users share interests by images and their text descriptions, are booming social networks. For the purpose of fully utilizing user-generated contents to analysis user interests on CCSNs, we propose a framework of learning multimodal joint representations of pins for user interest analysis. First, images are automatically annotated with category distributions, which benefit from the network characteristics and represent interests of users. Further, image representations are extracted from an intermediate layer of a fine-tuned multilabel convolutional neural network (CNN) and text representations are obtained with a trained Word2Vec. Finally, a multimodal deep Boltzmann machine (DBM) are trained to fuse two modalities. Experiments on a dataset from Huaban demonstrate that using category distributions instead of single categories as labels to fine-tune CNN significantly improve the performance of image representation, and multimodal joint representations perform better than either of unimodal representations. © Springer Nature Switzerland AG 2018.

Keyword:

Computer vision Convolutional neural networks Recommender systems Social networking (online) Knowledge representation Image enhancement Multilayer neural networks Modal analysis

Author Community:

  • [ 1 ] [Wu, Lifang]Faculty of Information Technology, Beijing University of Technology, Beijing, China
  • [ 2 ] [Zhang, Dai]Faculty of Information Technology, Beijing University of Technology, Beijing, China
  • [ 3 ] [Jian, Meng]Faculty of Information Technology, Beijing University of Technology, Beijing, China
  • [ 4 ] [Yang, Bowen]Faculty of Information Technology, Beijing University of Technology, Beijing, China
  • [ 5 ] [Liu, Haiying]Faculty of Information Technology, Beijing University of Technology, Beijing, China

Reprint Author's Address:

  • [jian, meng]faculty of information technology, beijing university of technology, beijing, china

Show more details

Related Keywords:

Related Article:

Source :

ISSN: 0302-9743

Year: 2018

Volume: 11258 LNCS

Page: 363-374

Language: English

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count: 2

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 5

Online/Total:480/10596216
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.