• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Yang, Zhongguo (Yang, Zhongguo.) | Zhang, Mingzhu (Zhang, Mingzhu.) | Li, Han (Li, Han.) | Ding, Weilong (Ding, Weilong.)

Indexed by:

EI Scopus SCIE

Abstract:

Workflow scheduling problems have been widely studied in cloud computing and edge computing, which aim to exploit cloud-edge resources to execute workflow tasks considering several constraints and optimization goals. However, in the era of Internet of things, the load of each computing task and the amount of data transferred between computing tasks will fluctuate, which changes the original workflow and needs for a new scheduling plan correspondingly. Existing methods are difficult to quickly cope with these dynamic changes and there are few studies applying neural networks to solve problems in workflow scheduling. To bridge the gap, we propose an innovative supervised learning method which leverages function-fitting strategy of neural networks to link the workflow environment and its optimal scheduling plan. Specifically, our approach can be divided into two steps, the first one is to generate dataset and train a seq2seq-based prediction models. In this step, we develop an algorithm for generating a significant amount of workflow instances while ensuring dataset diversity based on complexity estimation. Then we apply GA, NSGA, NSGA-NN three different types GA-based optimization methods to search optimal solutions. Finally, we construct dataset which includes {workflow, environment configurations -> obtained optimal solution} and train a seq2seq-based model. The other part is real-time generation of scheduling plans based on trained seq2seq-based model. Simulation experiments have confirmed that our method is both effective and efficient, demonstrating its ability to adapt to changes in the execution environment, workflow task load, and task data transmission, and effectively schedule tasks in real-time. The simulation results show that the seq2seq-based prediction method can approach 90% of the optimal scheme.

Keyword:

Dynamic scheduling Function fitting Seq2Seq model Workflow scheduling

Author Community:

  • [ 1 ] [Yang, Zhongguo]North China Univ Technol, Sch Informat Sci & Technol, Beijing 100144, Peoples R China
  • [ 2 ] [Li, Han]North China Univ Technol, Sch Informat Sci & Technol, Beijing 100144, Peoples R China
  • [ 3 ] [Ding, Weilong]North China Univ Technol, Sch Informat Sci & Technol, Beijing 100144, Peoples R China
  • [ 4 ] [Yang, Zhongguo]North China Univ Technol, Beijing Key Lab Integrat & Anal Large Scale Stream, Beijing 100144, Peoples R China
  • [ 5 ] [Li, Han]North China Univ Technol, Beijing Key Lab Integrat & Anal Large Scale Stream, Beijing 100144, Peoples R China
  • [ 6 ] [Ding, Weilong]North China Univ Technol, Beijing Key Lab Integrat & Anal Large Scale Stream, Beijing 100144, Peoples R China
  • [ 7 ] [Zhang, Mingzhu]Beijing Univ Technol, Dept Informat, Beijing 100124, Peoples R China

Reprint Author's Address:

  • [Yang, Zhongguo]North China Univ Technol, Sch Informat Sci & Technol, Beijing 100144, Peoples R China;;[Yang, Zhongguo]North China Univ Technol, Beijing Key Lab Integrat & Anal Large Scale Stream, Beijing 100144, Peoples R China;;

Show more details

Related Keywords:

Source :

CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS

ISSN: 1386-7857

Year: 2023

Issue: 2

Volume: 27

Page: 1897-1910

4 . 4 0 0

JCR@2022

ESI Discipline: COMPUTER SCIENCE;

ESI HC Threshold:19

Cited Count:

WoS CC Cited Count: 1

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

Affiliated Colleges:

Online/Total:381/10596618
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.