About | Contact Us | Register | Login
ProceedingsSeriesJournalsSearchEAI
Smart Grid and Internet of Things. 6th EAI International Conference, SGIoT 2022, TaiChung, Taiwan, November 19-20, 2022, Proceedings

Research Article

Research on Edge Computing Offloading Based on Reinforcement Learning in Multi-user Scenarios

Cite
BibTeX Plain Text
  • @INPROCEEDINGS{10.1007/978-3-031-31275-5_11,
        author={Zi-Hang Yu and Jian-Jun Zeng and Sai Liu and Zhen-Jiang Zhang},
        title={Research on Edge Computing Offloading Based on Reinforcement Learning in Multi-user Scenarios},
        proceedings={Smart Grid and Internet of Things. 6th EAI International Conference, SGIoT 2022, TaiChung, Taiwan, November 19-20, 2022, Proceedings},
        proceedings_a={SGIOT},
        year={2023},
        month={5},
        keywords={Edge computing Reinforcement learning Computing offload Deep Q network},
        doi={10.1007/978-3-031-31275-5_11}
    }
    
  • Zi-Hang Yu
    Jian-Jun Zeng
    Sai Liu
    Zhen-Jiang Zhang
    Year: 2023
    Research on Edge Computing Offloading Based on Reinforcement Learning in Multi-user Scenarios
    SGIOT
    Springer
    DOI: 10.1007/978-3-031-31275-5_11
Zi-Hang Yu1, Jian-Jun Zeng2, Sai Liu1, Zhen-Jiang Zhang1,*
  • 1: Department of Electronic and Information Engineering, Key Laboratory of Communication and Information Systems, Beijing Municipal Commission of Education, Beijing Jiaotong University
  • 2: College of Intelligence and Computing, Beijing InchTek Technology, Tianjin University
*Contact email: zhangzhenjiang@bjtu.edu.cn

Abstract

Under the blessing of the new generation of information technology represented by 5G, a large number of new models and new businesses represented by smart logistics, industrial Internet, and smart transportation have emerged one after another, and the door to the intelligent interconnection of all things has officially opened. However, due to IoT sensor devices are usually responsible for data acquisition and transmission, they have certain limitations in terms of computing and storage capabilities. How to expand the performance of devices located at the edge of the network has become a focus of attention. Aiming at the problems of high energy consumption, prolonged time and high task failure rate in traditional IoT edge computing methods, this paper introduces deep reinforcement learning technology to optimize IoT edge computing offload methods. This paper models a single edge server multi-user scenario, and designs a function that comprehensively considers task delay and task failure rate as the goal of further optimization. At the same time, aiming at the problem of state space dimension explosion in traditional reinforcement learning, a computing task offloading method based on deep Q network is further proposed. Through simulation experiments, the results show that the proposed method has certain advantages in time delay and task success rate under the condition of different number of IoT devices.

Keywords
Edge computing Reinforcement learning Computing offload Deep Q network
Published
2023-05-01
Appears in
SpringerLink
http://dx.doi.org/10.1007/978-3-031-31275-5_11
Copyright © 2022–2025 ICST
EBSCOProQuestDBLPDOAJPortico
EAI Logo

About EAI

  • Who We Are
  • Leadership
  • Research Areas
  • Partners
  • Media Center

Community

  • Membership
  • Conference
  • Recognition
  • Sponsor Us

Publish with EAI

  • Publishing
  • Journals
  • Proceedings
  • Books
  • EUDL