Dynamic Task Allocation for Robotic Edge System Resilience Using Deep Reinforcement Learning

点击次数:296   下载次数:0
外文摘要:Incorporating edge and cloud computing with robotics provides extended options for robots to perform real-time sensing and actuation operations in various cyber-physical systems (CPSs), including smart farms. Such systems are prone to uncertain failures triggered by mechanical disruptions. Consequently, the overall system performance degrades, primarily when location-specific tasks are already assigned to a faulty robot and require immediate recovery. Using edge and cloud computing resources is not always feasible due to communication and latency constraints. Therefore, this article exclusively focuses on harnessing the mobility of robots to support the computation tasks affected by uncertain failures of previously assigned robots and ensure faster resiliency management by relocating active robots near task sources. The proposed mobility-as-a-resilience-service (MaaRS) is formulated using a Markov decision process (MDP). Later, an edge server proximal to the robots is trained using deep reinforcement learning (DRL) to assign tasks among the robots. Specifically, a multiple deep $Q$ -network (MDQN)-based dynamic task allocation mechanism is proposed to converge to a solution exploring reward uncertainties with the best exploitation. Numerical evaluation using Python and TensorFlow validates the effectiveness of the proposed approach compared to other benchmarks.
外文关键词:edge computing;multirobot system;Smart farming;deep reinforcement learning (DRL);task allocation
作者:Afrin, Mahbuba;Jin, Jiong;Rahman, Ashfaqur;Li, Shi;Tian, Yu-Chu;Li, Yan
作者单位:Curtin Univ;CSIRO;Queensland Univ Technol;Univ Southern Queensland;Swinburne Univ Technol
期刊名称:IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS
期刊影响因子:0.0
出版年份:2024
出版刊次:54(3)
原文传递申请:江苏省科技资源(工程技术文献)统筹服务平台

  1. 编译服务:智慧农业
  2. 编译者:虞德容
  3. 编译时间:2025-01-15