ct 22(3): e1

Research Article

TailorEd: Classroom Configuration and Activity Identifiers (CCID & CAID)

Download252 downloads
  • @ARTICLE{10.4108/eetct.v9i3.2229,
        author={Andres Calle and Quan Nguyen and Kristin Lee and Julia Voss and Navid Shaghaghi},
        title={TailorEd: Classroom Configuration and Activity Identifiers (CCID \& CAID)},
        journal={EAI Endorsed Transactions on Creative Technologies},
        keywords={Classroom Configuration, Convolutional Neural Networks (CNNs), Data Science, Education Technology, Image Recognition},
  • Andres Calle
    Quan Nguyen
    Kristin Lee
    Julia Voss
    Navid Shaghaghi
    Year: 2022
    TailorEd: Classroom Configuration and Activity Identifiers (CCID & CAID)
    DOI: 10.4108/eetct.v9i3.2229
Andres Calle1, Quan Nguyen1, Kristin Lee1, Julia Voss1, Navid Shaghaghi1,*
  • 1: Santa Clara University
*Contact email: nshaghaghi@scu.edu


INTRODUCTION: The study of how classroom layout and activities affect learning outcomes of students with different demographics is difficult because it is hard to gather accurate information on the minute by minute progression of every class in a course. Furthermore, the process of data gathering must produce an abundance of data to work with and hence must be automated.

OBJECTIVES: A machine learning model trained on images of a classroom and thus capable of accurately labeling the classroom layout and activity of many thousands of images much faster and cheaper than employing a human. 

METHODS: Transfer learning can allow for preexisting computer vision models to be retrained on a smaller, more specific dataset in order to still achieve a highly accurate result. 

RESULTS: In the case of the classroom layout, the final model achieved an accuracy of 97% on a four category classification. And for detecting the classroom activity, after experimentation with several different versions that could work on a very small sample sizes, the best model achieved an accuracy of 86.17%.

CONCLUSION: In addition to showing that using computer vision to determine human activities is possible albeit more difficult than layouts of inanimate objects such as classroom desks, the study shows the differences between the use of self-supervised learning techniques and data augmentation techniques in order to overcome the problem of small training data-sets.