• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Liang, Yi (Liang, Yi.) | Xu, Guimei (Xu, Guimei.) | Shen, Haotian (Shen, Haotian.) | Ruan, Nianyi (Ruan, Nianyi.) | Wang, Yinzhou (Wang, Yinzhou.)

Indexed by:

Scopus SCIE

Abstract:

The rapid expansion of multi-cloud environments enables the fulfillment of the dynamic and diverse resource requirements of cloud applications. Cumulative data processing (CDP) applications, which handle incrementally generated data in stages like preprocessing and aggregate analysis, particularly benefit from these environments. However, existing cloud scheduling solutions struggle to handle the dynamic accumulation of processed data and the long-term data operation dependencies in CDP applications. Aiming at this issue, we propose a novel job execution model, CDP-EM, and a tailored job scheduling strategy, CDP-JS, to optimize the scheduling of CDP applications in multi-cloud environments. The CDP-EM model enables dynamic job generation and dependency-aware execution for CDP applications, while the CDP-JS strategy formulates the job scheduling problem as a Markov Decision Process (MDP), utilizing deep reinforcement learning with Proximal Policy Optimization (PPO) to optimize scheduling decisions. The simulation results show that integrating CDP-EM and CDP-JS reduces the SLA violation rate and resource cost of CDP applications by an average of 34.8% and 23.4%, respectively. Real-world evaluations show average reductions of 27.2% and 31.3%, respectively.

Keyword:

cumulative data processing deep reinforcement learning job scheduling multi-cloud

Author Community:

  • [ 1 ] [Liang, Yi]Beijing Univ Technol, Coll Comp Sci, Beijing 100124, Peoples R China
  • [ 2 ] [Xu, Guimei]Beijing Univ Technol, Coll Comp Sci, Beijing 100124, Peoples R China
  • [ 3 ] [Shen, Haotian]Beijing Univ Technol, Coll Comp Sci, Beijing 100124, Peoples R China
  • [ 4 ] [Ruan, Nianyi]Beijing Univ Technol, Coll Comp Sci, Beijing 100124, Peoples R China
  • [ 5 ] [Wang, Yinzhou]Beijing Univ Technol, Coll Comp Sci, Beijing 100124, Peoples R China

Reprint Author's Address:

  • [Liang, Yi]Beijing Univ Technol, Coll Comp Sci, Beijing 100124, Peoples R China

Show more details

Related Keywords:

Related Article:

Source :

ELECTRONICS

ISSN: 2079-9292

Year: 2025

Issue: 7

Volume: 14

2 . 9 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 7

Affiliated Colleges:

Online/Total:623/10839551
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.