ew 22(40): e6

Research Article

A Hybrid Framework for Visual Positioning: Combining Convolutional Neural Networks with Ontologies

Download34 downloads
  • @ARTICLE{10.4108/ew.v9i40.2959,
        author={Abdolreza Mosaddegh and S\^{e}rgio Lopes and Habib Rostami and Ahmad Keshavarz and Sara Paiva},
        title={A Hybrid Framework for Visual Positioning: Combining Convolutional Neural Networks with Ontologies},
        journal={EAI Endorsed Transactions on Energy Web},
        volume={9},
        number={40},
        publisher={EAI},
        journal_a={EW},
        year={2022},
        month={12},
        keywords={Visual Positioning, Convolutional Neural Network, Ontology, Image Understanding},
        doi={10.4108/ew.v9i40.2959}
    }
    
  • Abdolreza Mosaddegh
    Sérgio Lopes
    Habib Rostami
    Ahmad Keshavarz
    Sara Paiva
    Year: 2022
    A Hybrid Framework for Visual Positioning: Combining Convolutional Neural Networks with Ontologies
    EW
    EAI
    DOI: 10.4108/ew.v9i40.2959
Abdolreza Mosaddegh1,*, Sérgio Lopes2, Habib Rostami3, Ahmad Keshavarz3, Sara Paiva2
  • 1: King's College London
  • 2: Polytechnic Institute of Viana do Castelo
  • 3: Persian Gulf University
*Contact email: Abdolreza.Mosaddegh@kcl.ac.uk

Abstract

Visual positioning is a new generation positioning technique which has been developed rapidly during recent years for many applications such as robotics, self-driving vehicles and positioning for visually impaired people due to advent of powerful image processing methods, especially Convolutional Neural Networks. Nowadays, deep Convolutional Neural Networks are capable of classifying images with high accuracy rates; however, comparing visual perception by a human being, pure Neural Networks lack background knowledge which is essential for estimating the position through a reasoning process. In this paper we present a hybrid framework for employing ontologies over Convolutional Neural Networks to integrate a knowledge-based reasoning with Neural Networks for taking advantages of capabilities similar to human brain’s functions. The proposed framework is generic so it can be applied to a wide variety of scenarios in smart cities where visual positioning represents added value.