Research Article
Poisoning Attack for Inter-agent Transfer Learning
@INPROCEEDINGS{10.1007/978-3-030-90022-9_21, author={Zelei Cheng and Zuotian Li}, title={Poisoning Attack for Inter-agent Transfer Learning}, proceedings={Security and Privacy in Communication Networks. 17th EAI International Conference, SecureComm 2021, Virtual Event, September 6--9, 2021, Proceedings, Part II}, proceedings_a={SECURECOMM PART 2}, year={2021}, month={11}, keywords={Poisoning attack Inter-agent transfer learning Reinforcement learning}, doi={10.1007/978-3-030-90022-9_21} }- Zelei Cheng
Zuotian Li
Year: 2021
Poisoning Attack for Inter-agent Transfer Learning
SECURECOMM PART 2
Springer
DOI: 10.1007/978-3-030-90022-9_21
Abstract
In reinforcement learning, high sample complexity is a big challenge to deal with. Inter-agent transfer learning is one solution to this challenge that can leverage the experience of other more competent agents. In this paradigm, a student can make a query to the teacher and the teacher will give some action advice given the current state. However, most previous works ignored the instruction reliability problem. In this work, we investigate the instruction reliability issue based on the one-to-one teaching framework and formulate the poisoning attack as an optimization problem. By solving the optimization problem, the attacker can significantly influence the performance of the student in three different query models. Evaluation highlights that we need to consider the instruction reliability when using teacher-student frameworks in reinforcement learning.
