EAI Endorsed Transactions on Creative Technologies

EAI Endorsed Transactions on Creative Technologies is an open access, peer-reviewed scholarly journal focused on a whole industrial project or framework integrating creative technologies, creative content management, and more. The journal publishes research articles, review articles, commentaries, editorials, technical articles, and short communications with a quarterly frequency (four issues per year). Authors are not charged for article submission and processing.

Editor(s)-in-Chief: Predrag K. Nikolic

Aims & Scope
Indexing
Editor in Chief
Editorial Board
Special Issues

Given the accelerated changes and deeply interconnected activities of the times we are living in, creativity is a key factor of disruptive future developments. Creative and entertainment industries nowadays represent more than 3% of the GDP in Europe and they range from creative content providers (TV & radio, fashion, music) through creative experience providers (movies and music experience) to creative services providers (advertising, design, architecture).

Creative services, contents and experiences present knowledge requirements that are defined increasingly beyond a single discipline and appear to lie in a sound engagement among the creative practitioner (artist/designer/composer/entertainer), the engineer and the scientist. Digital arts, creative industries, and (tele)communication + (social) signal processing speak the language of convergence rather than autonomy. Their interaction calls for special attention now more than ever.

The journal is not limited to only specific aspects of creative technologies but also open to considering the high-level and innovative contributions from a wide range of subfields, especially articles of interdisciplinary nature.

Some of the journal topics are:

Creative Industries - the paper can describe a whole industrial project or framework integrating creative technologies for domains such as:

Creative content providers: TV & radio (broadcast, linked media), fashion (RFID and sensors, energy recycling), music & movies, books (digitization, sonification), museums (creative/artistic installations for tourism or cultural heritage) and media archives, etc.
Creative services providers: Advertising (user-centered web and ads optimization), design (communication devices for creative environments), architecture (places that adapt to people, creativity from domotics), new media and transmedia, etc.
Creative experience providers: Movies and music experience, game-based installations and playable media (participative creation, DJs and VJs creative tools), interactive social and urban spaces, etc.

Scientific topics - the paper can focus on scientific tools for creative industries on topics such as:

Creative content management: Multimedia data mining and innovative browsing, data 2D/3D visualization, digitization and storage, cultural heritage, etc.
Creative interactions: Social signal processing, verbal and nonverbal, explicit or implicit interactions, interacting robots, sensors and MoCap, human-computer interaction, user interface design, serious game etc.
Creative experiences: Affective content analysis and synthesis, immersive technologies, special effects, augmented reality, expressivity and emotion detection and processing, user experiences, etc.

Additional materials such as videos of installations and setups, public/users reactions and comments, or demo links are welcome.

Call for Papers: ICDM 2021 (Manuscript submission deadline: 2021-10-15; Notification of acceptance: 2021-12-10; Submission of final revised paper: 2022-01-21; Publication of special issue (tentative): 2022-02-04)

Lead Guest Editor: Prof Dr. Mohd Shahrizal Sunar (Universiti Teknologi Malaysia) Guest Editor: Dr. Goh Eg Su (Universiti Teknologi Malaysia) Guest Editor: Ruhiyati Idayu Abu Talib (Universiti Teknologi Malaysia)

Albert Ali Salah (Bogazici University, Turkey)
Anthony Brooks (SensoramaLab, Aalborg University Esbjerg, Denmark)
Anton Nijholt (University of Twente, Netherlands)
Antonio Camurri (DIST-University of Genova, Italy)
Antonio Camurri (University of Genoa, Italy)
Christian Jacquemin (LIMSI-CNRS, France)
Christophe d'Alessandro (LIMSI-CNRS, France)
Christophe Hurter (ENAC, French Civil Aviation University, Toulouse France)
Cristina Sylla (University of Minho)
Dirk Heylen (University of Twente IntetainElsebeth Korsgaard Sorensen)
Eva Irene (Brooks Aalborg University)
Fabrizio Lamberti (Politecnico di Torino)
Gualtiero Volpe (University of Genoa, Italy)
Insook Choi (Columbia College Chicago, USA)
Jesus Ibanez (Escola Municipal d'Art i Disseny (EMAiD))
Jonathan Duckworth (RMIT University ArtsIt)
Jorge C. S. Cardoso (University of Coimbra, Portugal)
Jun Hu (Eindhoven University of Technology, Netherlands)
Lau Bee Theng (Swinburne University of Technology Sarawak Campus, Malaysia)
Mel Krokos (University of Portsmouth, United Kingdom)
Michail Kalogiannakis (Faculty of Education, University of Crete, Greece)
Milton Luiz Horn Vieira (UFSC Intetain)
Mikkel Kirkedahl Lysholm Nielsen (Aalborg University, Denmark)
Pedro Campos (Intetain)
Pieter Jan Maes (McGill University, Canada)
Rainer Malaka (University of Bremen)
Radu-Daniel Vatavu (University of Suceava, Romania)
Robin Bargar (Columbia College Chicago, USA)
Rolf Gehlhaar (private ArtsIt Creative Technologies)
Robby van Delden (University of Twente)
Sudarshan Khanna (National Institute of Design, India)
Surabhi Khanna (Independent Design Educator & visiting faculty DLI)
Thierry Dutoit (University of Mons, Belgium)
Tiago Cardoso (University Nova of Lisbon, Portugal)
Tracy Harwood (De Montfort University, Leicester, United Kingdom)
Vincent Courboulay (University of La Rochelle, France)
Valentina Nisi (University of Madeira)
Yves Rybarczyk (University Nova of Lisbon, Portugal)
Mohd Shahrizal Sunar (Universiti Teknologi, Malaysia)

Predrag K. Nikolic

Predrag K. Nikolic is Associate Professor and Principal Investigator in AI.R at ShanghaiTech University School of Creativity and Art, Shanghai, China. He is an interactive media designer, digital media expert and a media artist who holds a PhD in Digital Media and an MBA. His research focuses on intelligent interfaces, robot creativity, AI aesthetics and design for behavioural changes. He mixes experiential reality, artificial intelligence, and responsive environments to engage an audience in new types of interactive experiences and media perceptions. His design and artworks, such as Botorikko, MindCatcher, InnerBody, Ciklosol, Before & Beyond, Vrroom, Robosophy Philosophy, Digital Lolipop, In_Visible Island were exhibited worldwide and presented at the Ars Electronica Festival, SIGGRAPH, SIGGRAPH Asia, Technarte USA, Technarte Spain, Singapore Science Center, Hong Kong – Shenzhen Design Biennial, Maison Shanghai, National Museum of Applied Art in Belgrade, National Museum of Education in Belgrade.

Before joining ShanghaiTech University School of Creativity and Art, Predrag Nikolic was a professor at Shantou University School of Art and Design China, Dean of Faculty of Digital Production at Educons University Serbia, Visiting Professor at Bergen Academy of Art and Design Norway, Researcher at Aalto University Finland, Global Digital Director at Grey Germany, Global Digital Director at J. Walter Thomson Germany, Global Head of Digital at Ogilvy Greece, Head of Digital Marketing at Groundlink USA, Consultant at Yahoo USA and Managing Director at JadePremier United Kingdom. During his career in a creative industry, he conceptualized and designed digital media presence for the clients such as Telenor, IBM, Nestle, H&M, Mars, Coca-Cola, Credit Agricole Bank, Yahoo, Czech Airlines and many others.

Predrag K. Nikolic has published numerous research papers in the field of artificial intelligence aesthetics, robot creativity, robot–robot interaction, design for behaviour change, collective creativity, mix-experiential reality, multi-sensory interfaces, interactivity and interface design. He lectures at universities and giving speeches at international conferences such as EmTech MIT, Technarte, SIGGRAPH, INTETAIN, MobilityIOT, Smart City 360, etc. Professor Nikolic is European Alliance for Innovation Fellow, listed artist in Leonardo Electronic Directory, SIGGRAPH Digital Arts Community Member, international exhibitions curator and serves on many conference committees.

More about prof. Nikolic you can find on www.predragnikolic.com

Online First
Recently Published
Most Popular

An overview of the applications of Artificial Intelligence in Cybersecurity
Appears in:
ct 18: e4

Authors:
Muhammad Shoaib Akhtar, Tao Feng

Published:
23rd Nov 2021

Abstract:
The rates at which cyber-attacks are performed have made the cybersecurity unprotected and make it impossible for the security experts to evaluate and combat every new type of cyber-attack. Today's digital age necessarily requires the protection of a vast amo…The rates at which cyber-attacks are performed have made the cybersecurity unprotected and make it impossible for the
security experts to evaluate and combat every new type of cyber-attack. Today's digital age necessarily requires the
protection of a vast amount of valuable electronic data from cyber-attacks. Cyber-attacks can destroy the reputation of
organizations even shutdown organizations. The protection of cybersecurity is inevitable. In this paper, we have
highlighted the potential applications of AI in cybersecurity. Artificial intelligence has advanced to the point where it has
surpassed human performance in tasks like data analytics. This study was carried out using systematic literature review;
the relevant literature was collected from google scholar, research gate, science direct, IEEE Xplore, Digital Library and
Microsoft academic search engines and databases. Our study resulted that AI applications in cybersecurity have many
advantages than disadvantages. AI-based applications of cybersecurity can improve the security of cyberspace. This is
evidenced by the rising of AI engines in computer security rather than traditional scanning engines.
more »
OBE: Perception of Computer Science Learners and Teachers in online learning during COVID-19
Appears in:
ct 18: e3

Authors:
Basetty Mallikarjuna, Munish Sabharwal, Pardeep Kumar, Niranjanamurthy M

Published:
12th Nov 2021

Abstract:
Outcome-Based Education (OBE) is the most prominent method for teachers to improve student learning during the COVID-19 pandemic, however, achieving OBE in an online learning environment is a challenging task for teachers. In India, the ability to implement OBE with limited online resources …Outcome-Based Education (OBE) is the most prominent method for teachers to improve student learning during the COVID-19 pandemic, however, achieving OBE in an online learning environment is a challenging task for teachers. In India, the ability to implement OBE with limited online resources is crucial. Major online learning platforms such as Google Classroom, Zoom and Microsoft Teams are preferred by many universities. The goal of this paper is to analyze the results of OBE implementation during COVID-19 lockdown.

OBJECTIVES: In lockdown difficult implement OBE, educational institutions has no maintenance cost, but it impacts various health conditions of learners and teachers. In online learning, the maximum workload of teachers and learners are
spending with electric gadgets that affect the physical body, vital body, and mental body. Computer science students utilize online learning tools adopted through online platforms.

METHODS: We introduced a new Teaching-Learning (T-L) pedagogy for students and teachers who adopted the online T-L process, the new pedagogy is aimed at providing an algorithmic approach to implementing OBE in an online learning environment. It is an effective methodology on Program Specific Outcomes (PSO) and Course Outcome (CO) mapping functionality.

RESULTS: It described the online T-L platform achieved through the OBE had been proved on MATLAB software, the Course Outcomes (CO) and the Program Outcomes (PO) attainment through integrated OBE (iOBE) software. The survey
of three institutions is recommended 90% (percentage obtained by the learners’ positive rate subtracted with negative rate divides by total number of learners) positive rate of the learners and they recommended through online T-L Methodology.

CONCLUSION: The survey responses have shown how an online learning environment has provided more flexibility to computer science students. The three institutions survey also demonstrated how online learning is an effective T-L platform. The attainment of CO-PO mapping has been updated from time to time by using iOBE5.2 software, as per the given methodology more than 85% of learners agreed through the online T-L tool is an effective and the demand computer science education increased during the COVID-19 lockdown.
more »
Human-Paper Interaction in the Digital Era: Directions for Human-Information Interaction Design
Appears in:
ct 18: e2

Author:
Amir-Reza Asadi

Published:
12th Oct 2021

Abstract:
These days, we receive most information through digital mediums such as emails and social networking applications. Investigating the characteristics of human-paper interactions can help us design more meaningful interactions and better understand why people use pape…These days, we receive most information through digital mediums such as emails and social networking applications.
Investigating the characteristics of human-paper interactions can help us design more meaningful interactions and better
understand why people use paper documents in the age of digitalization.
In this study, the interaction of people with physical documents was studied through a mixed-method of conducting a
literature review, gathering expert opinions, interviewing subjects, and analysing Instagram photos. By codifying the
gathered information, the human-paper interaction framework was developed. This framework articulates the advantages of
physical documents compared to electronic documents and serves researchers and practitioners by providing insightful
human factors about human-document interaction.
Finally, we propose six design themes as the solutions to the findings of this study. These implications can provide practical
foundations for future design and research.
more »
Research on the Application of Augmented Reality Technology in the Transformation and Development of Cultural and Creative Industries
Appears in:
ct 18: e1

Authors:
Liying Feng, Giap Weng Ng, Liyao Ma, Maozheng Fu, Xiaoping Que

Published:
12th Oct 2021

Abstract:
INTRODUCTION: In this paper, China Hainan "Li" national woven culture is used as an example, the status quo and problems of cultural creative in-dustry in Hainan are analyzed, and the new trend of the development of Hainan cultural creative industry is further clarified. OBJECTIVES: The i…INTRODUCTION: In this paper, China Hainan "Li" national woven culture is used as an example, the status quo and
problems of cultural creative in-dustry in Hainan are analyzed, and the new trend of the development of Hainan cultural
creative industry is further clarified.

OBJECTIVES: The integration of AR technology and cultural creative industry is the main research object.

METHODS: This study integrates technology into culture, introduces AR technology to integrate the development of
Hainan cultural and creative industrial development, and propose the transformation strategy of cultural industries to
integrate scientific and technological innovation. The application examples of enhanced reality technology are introduced.
summarized the four technical characteristics and advantages of AR technology with virtual fusion, real-time interaction,
two-way mode and multi-intensity.

RESULTS: One preliminary result was Augmented Reality is a promising media to learn, promote and protect Hainan
national brocade culture.

CONCLUSION: It concludes generally Augmented Reality promoteslearning about, and builds back better Hainan's
cultural and creative industry.
more »

Karachi Stock Exchange Price Prediction using Machine Learning Regression Techniques
Appears in:
ct 21(28): e5

Authors:
Mazhar Hameed, Khurum Iqbal, Rozaida Ghazali, Fawwad Hassan Jaskani, Zunaira Saman

Published:
24th Aug 2021

Abstract:
Accurate stock market returns are quite difficult for the company because of the unpredictable and non-linear nature of the financial stock markets. With the development of artificial intelligence and increased computer power, programmed prediction approaches have demonstrated that th…Accurate stock market returns are quite difficult for the company because of the unpredictable and non-linear nature of the financial stock markets. With the development of artificial intelligence and increased computer power, programmed prediction approaches have demonstrated that they are increasingly effective in predicting stock values. In this study, the Artificial Neural Network, LSTM, and LR techniques were used to predict the closing price for the following day for five companies belonging to different business sectors. In today's economy, the stock market or equity market has a profound
influence. The prediction of stock prices is quite complex, chaotic, and it is a big challenge to have a dynamic environment. Behavioural finance means that investors' decision-making processes are affected by emotions and attitudes in response to particular news. In order to help investors' judgements, we have supplied a technology for the analysis of the stock exchange. The method combines historical price prediction. For predicting, LSTM (Long Short-Term Memory), ANN and LR are employed. It includes the latest information on trade and analytical indicators. Financial data: Open, high, low and close stock prices are used to build new variables needed for model input. The models are validated with standard strategic indicators: RMSE and MAPE. The low values of these two variables indicate that the models are cost-effective.
more »
Time-Series Prediction of Cryptocurrency Market using Machine Learning Techniques
Appears in:
ct 21(28): e4

Authors:
Mahir Iqbal, Muhammad Shuaib Iqbal, Fawwad Hassan Jaskani, Khurum Iqbal, Ali Hassan

Published:
7th Jul 2021

Abstract:
In the market of cryptocurrency the Bitcoins are the first currency which has gain the significant importance. To predict the market price and stability of Bitcoin in Crypto-market, a machine learning based time series analysis has been applied. Time-series analysis can predict the…In the market of cryptocurrency the Bitcoins are the first currency which has gain the significant importance. To predict the market price and stability of Bitcoin in Crypto-market, a machine learning based time series analysis has been applied. Time-series analysis can predict the future ups and downs in the price of Bitcoin. For this purpose we have used ARIMA, FBProphet, XG Boosting for time series analysis as a machine learning techniques. The parameters on the basis of which we have evaluated these models are Root Mean Square Error (RMSE), Mean Absolute Error (MAE) and R2. We conduct experiments on these three techniques but after conducting time series analysis, ARIMA considered as the best model for forecasting Bitcoin price in the crypto-market with RMSE score of 322.4 and MAE score of 227.3. Additionally, this research can be helpful for investors of crypto-market.
more »
The future of Artificial Intelligence in Cybersecurity: A Comprehensive Survey
Appears in:
ct 21(28): e3

Authors:
Feng Tao, Muhammad Shoaib Akhtar, Zhang Jiayuan

Published:
7th Jul 2021

Abstract:
AI in Cybersecurity Market scheme helps organizations in observance, detecting, reporting, and countering cyber threats to keep up information confidentiality. The increasing awareness among folks, advancements in info technology, up-gradation of intelligence and police work solutions, and i…AI in Cybersecurity Market scheme helps organizations in observance, detecting, reporting, and countering cyber threats to keep up information confidentiality. The increasing awareness among folks, advancements in info technology, up-gradation of intelligence and police work solutions, and increasing volume of knowledge gathered from numerous sources have demanded the utilization of reliable and improved cybersecurity solutions all told industries. The increase in the incidence and quality of cyber-attacks is driving AI-enabled cyber systems. Increasing incidents of huge cyber-attacks globally have created awareness among organizations for securing their information. The motive behind these cyber-criminals are political competition, competitors move for gain and harming the name of others, international information theft, and radical non-secular cluster interest. Most cyber-attacks are for gain. In this review we have presented some previous studies related to Cybersecurity which involves AI.
more »
From GUI to AVUI: Situating Audiovisual User Interfaces Within Human-Computer Interaction and Related Fields
Appears in:
ct 21(27): e5

Authors:
Nuno N. Correia, Atau Tanaka

Published:
12th May 2021

Abstract:
INTRODUCTION: We propose AudioVisual User Interfaces (AVUI), a novel type of UI linking interaction, sound and image. It extends the concept of Graphical User Interface (GUI) by adding interconnected sound and image. OBJECTIVES: We aim to situate AVUIs in relation to identified relevant fields: …INTRODUCTION: We propose AudioVisual User Interfaces (AVUI), a novel type of UI linking interaction, sound and image. It extends the concept of Graphical User Interface (GUI) by adding interconnected sound and image.

OBJECTIVES: We aim to situate AVUIs in relation to identified relevant fields: Human-Computer Interaction (HCI), sonic interaction design, cognitive psychology and audiovisual art, and to identify benefits of AVUIs inthe context of those fields.

METHODS: In this research, we combine literature review of related concepts with a user-centered design methodology, involving a community of audiovisual artists and performers.

RESULTS: We contextualize AVUI within the identified fields and identify benefits for the implementation of AVUIs in relation to those fields.

CONCLUSION: These results can contribute to the further adoption of AVUIs by the HCI community, particularly those interested in multisensory experience involving sound and image.
more »
A Survey of Audio Synthesis and Lip-syncing for Synthetic Video Generation
Appears in:
ct 21(28): e2

Authors:
Anup Kadam, Sagar Rane, Arpit Kumar Mishra, Shailesh Kumar Sahu, Shubham Singh, Shivam Kumar Pathak

Published:
14th Apr 2021

Abstract:
The fields like Media, Education and Corporations etc have started focusing on content creation. This has led to the huge demand for synthetic media generation using less data. To synthesize a high-grade artificial video, the lip must be synchronized with the audio. Here we have compared the variou…The fields like Media, Education and Corporations etc have started focusing on content creation. This has led to the huge demand for synthetic media generation using less data. To synthesize a high-grade artificial video, the lip must be synchronized with the audio. Here we have compared the various methods for voice-cloning and lip synchronization. Voice cloning procedure include state of the art methods like wavenet and other text-to-speech approaches. Lip synchronization methods describe constrained and unconstrained methods. Various recent research like LipGan, Wav2Lip are discussed. The methods are compared and the best method is suggested. Apart from studying and comparing the various methods, their drawbacks, future scopes, and application are also there. Different social and ethical issues are also discussed.
more »
An Enhanced ANN-HMM based classification of video recordings with the aid of audio-visual feature extraction
Appears in:
ct 21(28): e1

Authors:
Pooja Mehta, Sahil Kaswan, Jaspreet Kaur

Published:
31st Mar 2021

Abstract:
INTRODUCTION: As an essential part of life, the use of the Internet has increased exponentially. This rising Internet bandwidth speed has made video data transmission a more popular and modern form of information exchange. For classification of video date files the…INTRODUCTION: As an essential part of life, the use of the Internet has increased exponentially. This rising Internet bandwidth speed has made video data transmission a more popular and modern form of information exchange. For classification of video date files there is a requirement of human efforts. Also for reducing the rate of clutter in video data on Internet, a suitable automatic video classification method is required.

OBJECTIVES: In this work, we tried to find a successful model for video classification.

METHODS: To make a successful model we use different schemes of visual and audio data analysis. On the other hand we choose some music, traffic and sports videos for different analysis. The model is based on Hidden Markov model (HMM) and Artificial neural network (ANN) classifiers. In order to gather the final results, we developed an “enhanced ANN-HMM based” model.

RESULTS: Our approach attained an average of 90% success rate among all three classification classes.

CONCLUSION: In aim of this work is to categorize and caption the videos automatically. Here we proposed an enhanced HMM-ANN based classification of video recordings with the aid of audio visual feature extraction.
more »
Evoking the Mythic: Hearing the Sound of Sukhāvatī
Appears in:
ct 21(27): e4

Authors:
M.D.F. Evans, S. Hall, J. Dooley

Published:
31st Mar 2021

Abstract:
Buddhism has a rich visual history of ancient paintings and sculpture used to evoke spiritual and archetypal concepts. One of the key figures in Mahayana Buddhism is the celestial Buddha Amitabha, also known as the Buddha of Infinite Light. Several Buddhist texts describe the “Sukhāvatī” the land t…Buddhism has a rich visual history of ancient paintings and sculpture used to evoke spiritual and archetypal concepts. One of the key figures in Mahayana Buddhism is the celestial Buddha Amitabha, also known as the Buddha of Infinite Light. Several Buddhist texts describe the “Sukhāvatī” the land that that Amitabha inhabits. The texts not only describe the physical characteristics of this environment but also the soundscape. This paper discusses the process of transcoding an image of Amitabha into sound to create an interactive sonic environment. This process explores how choosing sounds based upon the literary description, can be a way of creating a link between an image and the literary counterpart.
more »
Design Strategies for a Hybrid Video Synthesizer
Appears in:
ct 21(27): e3

Authors:
Sourya Sen, Nuno N. Correia, Koray Tahiroğlu

Published:
19th Mar 2021

Abstract:
INTRODUCTION: Technological advances have led to newer instruments and forms of audiovisual performance. Simultaneously, there has been a resurgence of analogue equipment in sound synthesis. However, such instruments for video synthesis are yet to be well establish…INTRODUCTION: Technological advances have led to newer instruments and forms of audiovisual performance. Simultaneously, there has been a resurgence of analogue equipment in sound synthesis. However, such instruments for video synthesis are yet to be well established.

OBJECTIVES: The primary objective of this research is to propose design guidelines for designing hybrid video synthesizers and develop a working prototype.

METHODS: Through a study of historical and contemporary practises, design guidelines for a hybrid video synthesizer are proposed. A prototype instrument is then developed and used in live performances to justify the guidelines.

RESULTS: The hybrid approach towards audiovisual performance has some merit, however, it may only be relevant to a certain group of people already familiar with modular workflows.

CONCLUSION: The merits and demerits of our design proposal using the prototype instrument has been noted in this research. Future plans have also been discussed.
more »
Virtual Reality and Audiovisual Experience in the AudioVirtualizer
Appears in:
ct 21(27): e2

Authors:
Adinda van ’t Klooster, Nick Collins

Published:
19th Mar 2021

Abstract:
INTRODUCTION: Virtual Reality (VR) provides new possibilities for interaction, immersiveness, and audiovisual combination, potentially facilitating novel aesthetic experiences. OBJECTIVES: In this project we created a VR AudioVirtualizer able to generate graphics in response to any sound input…INTRODUCTION: Virtual Reality (VR) provides new possibilities for interaction, immersiveness, and audiovisual combination, potentially facilitating novel aesthetic experiences.

OBJECTIVES: In this project we created a VR AudioVirtualizer able to generate graphics in response to any sound input in a visual style similar to a body of drawings by the first author.

METHODS: In order to be able to make the system able to respond to any given musical input we developed a Unity plugin that employs real-time machine listening on low level and medium-level audio features. The VR deployment utilized SteamVR to allow the use of HTC Vive Pro and Oculus Rift headsets.

RESULTS: We presented our system to a small audience at PROTO in Gateshead in September 2019 and observed people’s preferred ways of interacting with the system. Although our system can respond to any sound input, for ease of interaction we chose four previously created audio compositions by the authors of this paper and microphone input as a restricted set of sound input options for the user to explore.

CONCLUSION: We found that people’s previous experience with VR or gaming influenced how much interaction they used in the system. Whilst it was possible to navigate within the scenes and jump to different scenes by selecting a 3D sculpture in the scene, people with no previous VR or gaming experience often preferred to just let the visuals surprise them. They used mainly head movement to change their point of view, whereas people with previous VR or gaming experience quickly learned inherent capabilities of the system. The AudioVirtualizer system is most suited to respond to electronic soundscapes and microphone input.
more »
Gesture Sonification. An Interaction Design Approach to an Artistic Research Case
Appears in:
ct 21(27): e1

Authors:
P. Polotti, M. Goina

Published:
19th Mar 2021

Abstract:
INTRODUCTION: The subject of this paper is a phenomenological study of cognitively plausible relationships between gesture and sound mediated by technologies. In this discussion, the term ‘gesture’ indicates a movement of the body consciously performed and able to express or com…INTRODUCTION: The subject of this paper is a phenomenological study of cognitively plausible relationships between gesture and sound mediated by technologies. In this discussion, the term ‘gesture’ indicates a movement of the body consciously performed and able to express or communicate something. The expression ‘cognitively plausible’ refers to an interactive sound response that is immediate, continuously varying and enactively coherent with the generating (sonified) gesture.

OBJECTIVES: The objectives of this paper are two. The first is an artistic exploration of gesture sonifications in various contexts. The second is rather methodological, i.e., to provide a possible general paradigm for Artistic Research (AR).

METHODS: More in detail, the AR phenomenological approach is modeled according to an Interaction Design (IxD) research paradigm.

RESULTS: A number of case studies of gesture sonification are presented and discussed according to the above methodological framework.

CONCLUSION: We claim that the introduction of such methodological framework was successful in terms of providing robust guidelines for our research and for a clear and structured presentation of its results.
more »

Smart Attendance Management System Using Face Recognition
Appears in:
ct 18(17): e4

Authors:
Kaneez Laila Bhatti, Laraib Mughal, Faheem Yar Khuhawar, Sheeraz Ahmed Memon

Downloads:
16279

Abstract:
To maintain the attendance record with day to day activities is a challenging task. The conventional method of calling name of each student is time consuming and there is always a chance of proxy attendance. The following system is based on face recognition to maintain the attendance record of stud…To maintain the attendance record with day to day activities is a challenging task. The conventional method of calling name of each student is time consuming and there is always a chance of proxy attendance. The following system is based on face recognition to maintain the attendance record of students. The daily attendance of students is recorded subject wise which is stored already by the administrator. As the time for corresponding subject arrives the system automatically starts taking snaps and then apply face detection and recognition technique to the given image and the recognize students are marked as present and their attendance update with corresponding time and subject id. We have used deep learning techniques to develop this system, histogram of oriented gradient method is used to detect faces in images and deep learning method is used to compute and compare feature facial of students to recognize them. Our system is capable to identify multiple faces in real time.
more »
The Significance of a Body in Contemporary Arts
Appears in:
ct 16(6): e2

Authors:
Emmanouela Vogiatzaki, Artur Krukowski

Downloads:
2872

Abstract:
This paper discusses the role and significance of a body in Performance Art. Considering that Art reflects social, cultural and sometimes political realities, we identify types of messages that an artwork using advanced technological might transmit to us, spectators or artists. This paper focusses …This paper discusses the role and significance of a body in Performance Art. Considering that Art reflects social, cultural and sometimes political realities, we identify types of messages that an artwork using advanced technological might transmit to us, spectators or artists. This paper focusses on the Cyborg Theatre, whereby the technology is its inherent element without which the performance could not happen. Such a technological performance cannot occur without a body. We refer here to a cyborg body as a human organism extended with mechanical parts, which integrate non organic components in order to gain meaning within the artwork. By focusing on such a theatrical performance, we observe a relationship developing between the performer and the spectator. This is an unusual interaction, which deserves our attention. We claim that both the performer and the spectator take part in a social event that does not only represent societal realities, but also indicates future ones.
more »
Solitude or co-existence – or learning-together-apart with digital dialogic technologies for kids with developmental and attention difficulties
Appears in:
ct 17(12): e4

Authors:
E.K. Sorensen, H.V. Andersen

Downloads:
2063

Abstract:
An overall political vision of a prosperous society is one in which everyone has the same access and possibilities of participating in democratic processes, and in which everyone has equal access to the resources, life and learning – a society grasping the potential of diversity. This study reports…An overall political vision of a prosperous society is one in which everyone has the same access and possibilities of participating in democratic processes, and in which everyone has equal access to the resources, life and learning – a society grasping the potential of diversity. This study reports on research into the impact of digital technological interventions for including kids with attention and developmental dificulties into school class contexts. The paper describes, how the authors have approached the challenge of researching inclusion of kids with attention and developmental deficits for communication, collaboration and knowledge sharing. Some of the questions addressed in the study are: How – and in what sense - may technology and technological interventions be utilised to enhance this approach with our focus learners? In which situations does it occur in the case study? The data analysis assesses the potential of interventions with digital technology for acting as stimulating enzymes for life and learning. On the basis of a thorough discussion of the analysis and findings, the authors assess the degree to which interventions with digital technologies may promote inclusion through stimulating the participation in life and learning of kids with attention and developmental deficits.
more »
Evaluation of a Facial Animation Authoring Pipeline Seamlessly Supporting Performance Capture and Manual Key-pose Editing
Appears in:
ct 15(3): e4

Authors:
Fabrizio Nunnari, Alexis Heloir

Downloads:
1920

Abstract:
In this paper, we present an architecture following a novel animation authoring pipeline seamlessly supporting performance capture and manual editing of key-frames animation. This pipeline allows novice users to record and author sophisticated facial animations in a fraction of the time that woul…In this paper, we present an architecture following a novel animation authoring pipeline seamlessly
supporting performance capture and manual editing of key-frames animation. This pipeline allows novice
users to record and author sophisticated facial animations in a fraction of the time that would be required
using traditional animation tools. This approach paves the way towards novel animation pipelines which
seamlessly merge the roles of the animator and the actor. The second contribution is a method assessing a
facial retargeting system, we conducted a user study where participants assessed the emotions conveyed by
the facial expression displayed in the control and the authored animation. Contrary to existing evaluation
methods, it factors out possible misinterpretations of the intended emotion and focuses on assessing the
retargeting quality.
more »
Video Streaming Analysis in Vienna LTE System Level Simulator
Appears in:
ct 16(7): e1

Authors:
Zakaria Ye, Tania Jimenez, Rachid El-Azouzi

Downloads:
1748

Abstract:
The demand for multimedia services in mobile communication is increasing day by day due to the proliferation of end devices. To overcome the future needs of data communication on mobile devices, the $ 3^{rd} $ Generation Partnership Project (3GPP) has introduced a new technology which is known as L…The demand for multimedia services in mobile communication is increasing day by day due to the proliferation of end devices. To overcome the future needs of data communication on mobile devices, the $ 3^{rd} $ Generation Partnership Project (3GPP) has introduced a new technology which is known as Long Term Evolution (LTE) UMTS. In this paper, we study video streaming behavior on the LTE network. For this purpose, we use the Vienna LTE System Level Simulator which implements network features that correspond to our goal. We consider the parameters that may affect the users experience on a network and define ten scenarios for our simulations. We finally search for methods to fit the video streaming data traffic on the LTE network and exhibit its long range dependence.
more »
Sandtime: A Tangible Interaction Featured Sensory Play Installation For Children To Increase Social Connection
Appears in:
ct 17(10): e4

Authors:
Chulin Yang, Stephen Jia Wang

Downloads:
1365

Abstract:
From the study of social-interaction enhanced gaming design, aimed at providing a public environment which supports tangible & social interactions among children, we designed Sandtime. Sandtime is a public installation designed to encourage such interaction. Using the Tangible Interaction Design ap…From the study of social-interaction enhanced gaming design, aimed at providing a public environment which supports tangible & social interactions among children, we designed Sandtime. Sandtime is a public installation designed to encourage such interaction. Using the Tangible Interaction Design approach, this gaming installation features collaborative play and social interactions under public context, where children can collaboratively interact with the virtual onscreen characters by manipulating physical objects. This design is based on the study of how interactive gaming facilities can help to ease anxiety and enhance social interactions among children. In this paper, we want to continue this line of research by exploring further the elements that can enhance such interaction experience. This paper focuses specifically on the sensory play and how it can help to facilitate social interaction.
more »
Towards a 15.5W Si-LDMOS Energy Efficient Balanced RF Power Amplifier for 5G-LTE Multi-carrier Applications
Appears in:
ct 18(15): e5

Authors:
B. A. Mohammed, A. S. Hussaini, R. A. Abd-Alhameed, I. M. Danjuma, A. S. Asharaa, I. T. E. Elfergani, J. Rodriguez

Downloads:
1335

Abstract:
In this paper, a 15.5W Si-LDMOS balanced RF power amplifier has been designed using 2.620-2.690GHz frequency band to improve efficiency and linearity for 5G-LTE mobile applications. The amplifier was designed and simulated using large signal Si-LDMOS transistor model to achieve 53% PAE, 41dBm Pout,…In this paper, a 15.5W Si-LDMOS balanced RF power amplifier has been designed using 2.620-2.690GHz frequency band to improve efficiency and linearity for 5G-LTE mobile applications. The amplifier was designed and simulated using large signal Si-LDMOS transistor model to achieve 53% PAE, 41dBm Pout, 14 dB gain at P1dB saturation point. The proposed balanced RF power amplifier was fabricated and measurement results for phase variation of the signal between the carriers have been the main focus. At 1dB compression point power added efficiency increased to 81.5% with 19.5 gain at the Pout. The AM-AM and AM-PM measured data of the balanced RF power amplifier was extracted from the MATLAB fitting tool to produce polynomials. The polynomials were used in the proposed pre-distortion technique to compensate for the nonlinearities of the balanced power amplifier. A simple linear model was designed for behavioural modelling of the memory-less baseband digital pre-distorter. A Simulink IEEE 802.11a OFDM Transceiver system was used to demonstrate validity of the proposed pre-distorter. To the best of authors’ knowledge, this study presented excellent results of predistortion system that compensated the nonlinearity behaviour of the balanced RF power amplifier using the Simulink version R2011a.
more »
Towards a new software quality model for evaluation the quality of gamified systems
Appears in:
ct 18(14): e2

Authors:
Omaz Azouz, Youssef Lefdaoui

Downloads:
1253

Abstract:
Due to the emergence of the Gamification concept in various domains, this article studies how to improve the quality of gamified systems with the software engineering discipline. Recent studies have shown a significant gap between design frameworks and gamified products, reflected in a lack of cons…Due to the emergence of the Gamification concept in various domains, this article studies how to improve the quality of gamified systems with the software engineering discipline. Recent studies have shown a significant gap between design frameworks and gamified products, reflected in a lack of consistency, integrity, measurement and a comprehensive process that covers the different phases to achieve a quality
gamified product. For this purpose, a specific quality model software for evaluation is required. Our contribution consists of making an analytical and qualitative study of the existing Gamification frameworks and platforms, with the aim of proposing a model for quality evaluation of the gamified applications. This proposal is based on the patterns and attributes determined during the conducted bibliographic study and comparative studies, with an attempt
to integrate the ISO 25010 quality model.
more »
Time-Series Prediction of Cryptocurrency Market using Machine Learning Techniques
Appears in:
ct 21(28): e4

Authors:
Mahir Iqbal, Muhammad Shuaib Iqbal, Fawwad Hassan Jaskani, Khurum Iqbal, Ali Hassan

Downloads:
1238

Abstract:
In the market of cryptocurrency the Bitcoins are the first currency which has gain the significant importance. To predict the market price and stability of Bitcoin in Crypto-market, a machine learning based time series analysis has been applied. Time-series analysis can predict the…In the market of cryptocurrency the Bitcoins are the first currency which has gain the significant importance. To predict the market price and stability of Bitcoin in Crypto-market, a machine learning based time series analysis has been applied. Time-series analysis can predict the future ups and downs in the price of Bitcoin. For this purpose we have used ARIMA, FBProphet, XG Boosting for time series analysis as a machine learning techniques. The parameters on the basis of which we have evaluated these models are Root Mean Square Error (RMSE), Mean Absolute Error (MAE) and R2. We conduct experiments on these three techniques but after conducting time series analysis, ARIMA considered as the best model for forecasting Bitcoin price in the crypto-market with RMSE score of 322.4 and MAE score of 227.3. Additionally, this research can be helpful for investors of crypto-market.
more »
Multi-agent evolutionary systems for the generation of complex virtual worlds
Appears in:
ct 15(5): e5

Authors:
J. Kruse, A. M. Connor

Downloads:
1236

Abstract:
Modern films, games and virtual reality applications are dependent on convincing computer graphics. Highly complex models are a requirement for the successful delivery of many scenes and environments. While workflows such as rendering, compositing and animation have been streamlined to accommodate …Modern films, games and virtual reality applications are dependent on convincing computer graphics. Highly complex models are a requirement for the successful delivery of many scenes and environments. While workflows such as rendering, compositing and animation have been streamlined to accommodate increasing demands, modelling complex models is still a laborious task. This paper introduces the computational benefits of an Interactive Genetic Algorithm (IGA) to computer graphics modelling while compensating the effects of user fatigue, a common issue with Interactive Evolutionary Computation. An intelligent agent is used in conjunction with an IGA that offers the potential to reduce the effects of user fatigue by learning from the choices made by the human designer and directing the search accordingly. This workflow accelerates the layout and distribution of basic elements to form complex models. It captures the designer’s intent through interaction, and encourages playful discovery.
more »

Publisher: EAI
ISSN: 2409-9708
Number of Volumes: 8

Last Published: 2021-08-24