The 2nd International ICST Workshop on Cognitive Radio Network

Research Article

A novel access network selection scheme using Q-learning algorithm for cognitive terminal

Download513 downloads
  • @INPROCEEDINGS{10.4108/crnet.2010.2,
        author={Haifeng Tan and Yizhe Li and Yami Chen and Li Tan and Qian Li},
        title={A novel access network selection scheme using Q-learning algorithm for cognitive terminal},
        proceedings={The 2nd International ICST Workshop on Cognitive Radio Network},
        publisher={IEEE},
        proceedings_a={CRNET},
        year={2011},
        month={1},
        keywords={access network selection Q-Iearning algorithm cognitive network low-carbon},
        doi={10.4108/crnet.2010.2}
    }
    
  • Haifeng Tan
    Yizhe Li
    Yami Chen
    Li Tan
    Qian Li
    Year: 2011
    A novel access network selection scheme using Q-learning algorithm for cognitive terminal
    CRNET
    IEEE
    DOI: 10.4108/crnet.2010.2
Haifeng Tan1,*, Yizhe Li2, Yami Chen2, Li Tan2, Qian Li2
  • 1: The State Radio Monitoring Center; Beijing 100037
  • 2: Key Laboratory of Universal Wireless Communications, Ministry of Education, Wireless Technology Innovation Institute (WTl), Beijing University of Posts and Telecommunications, Beijing, P.R.China, 100876
*Contact email: tanhf@srrc.org.cn

Abstract

In a B3G/4G wireless communication system, the users will connect to the network using one of several available radio access technologies. In this paper, we proposed a Q-learning based algorithm for terminals' independent access network selection with the aim of improving the resource utilization and providing the best quality of service with respect to the wireless environment status, network performance and user' requirement. In particular, for the first time we introduced the concept of low-carbon as one of the evaluation indicators of wireless communication performance, in order to reduce the power consumption and achieve a balance between quality and consumption. The proposed scheme is based on the concept of cognitive network, which has been proposed recently by the motivation of complexity, heterogeneity and reliability requirements of tomorrow's network and the cognitive pilot channel used in it. The performance of the access network selection algorithm is shown in the simulation and it can be seen that this algorithm significantly reduced the blockrate and power consumption as well as increased the throughput compared with random accessing approach. In future work, we will continue to research on the effective access network selection algorithm and try to introduce the low-carbon indicator to other aspects of the wireless communication system.