EAI Endorsed Transactions on Creative Technologies

An open access journal abstracted/indexed in DBLP, CrossRef, EBSCO Discovery Services, DOAJ, and WorldCat. It focuses on a whole industrial project or framework integrating creative technologies, creative content management and more, with no publishing fees.

Editor(s)-in-Chief: Predrag K. Nikolic and Eva Irene Brooks

Scope
Topics
Editor in Chief
Editorial Board
Special Issues

Given the accelerated changes and deeply interconnected activities of the times we are living in, creativity is a key factor of disruptive future developments. Creative and entertainment industries nowadays represent more than 3% of the GDP in Europe and they range from creative content providers (TV & radio, fashion, music) through creative experience providers (movies and music experience) to creative services providers (advertising, design, architecture).

Creative services, contents and experiences present knowledge requirements that are defined increasingly beyond a single discipline and appear to lie in a sound engagement among the creative practitioner (artist/designer/composer/entertainer), the engineer and the scientist. Digital arts, creative industries, and (tele)communication + (social) signal processing speak the language of convergence rather than autonomy. Their interaction calls for special attention now more than ever.

The Journal seeks for high-level contributions addressing several of those aspects with a special focus on at least one of them:

Creative Industries - the paper can describe a whole industrial project or framework integrating creative technologies for domains such as:

Creative content providers: TV & radio (broadcast, linked media), fashion (RFID and sensors, energy recycling), music & movies, books (digitization, sonification), museums (creative/artistic installations for tourism or cultural heritage) and media archives, etc.
Creative services providers: Advertising (user-centered web and ads optimization), design (communication devices for creative environments), architecture (places that adapt to people, creativity from domotics), new media and transmedia, etc.
Creative experience providers: Movies and music experience, game-based installations and playable media (participative creation, DJs and VJs creative tools), interactive social and urban spaces, etc.

Scientific topics - the paper can focus on scientific tools for creative industries on topics such as:

Creative content management: Multimedia data mining and innovative browsing, data 2D/3D visualization, digitization and storage, cultural heritage, etc.
Creative interactions: Social signal processing, verbal and nonverbal, explicit or implicit interactions, interacting robots, sensors and MoCap, human-computer interaction, user interface design, serious game etc.
Creative experiences: Affective content analysis and synthesis, immersive technologies, special effects, augmented reality, expressivity and emotion detection and processing, user experiences, etc.

Additional materials such as videos of installations and setups, public/users reactions and comments, or demo links are welcome.

Special issue editor: Manik Sharma (Dav University, India)

Albert Ali Salah (Bogazici University, Turkey)
Andy Connor (Auckland University of Technology, New Zealand)
Anthony Brooks (SensoramaLab, Aalborg University Esbjerg, Denmark)
Anton Nijholt (University of Twente, Netherlands)
Antonio Camurri (DIST-University of Genova, Italy)
Antonio Camurri (University of Genoa, Italy)
Christian Jacquemin (LIMSI-CNRS, France)
Christophe d'Alessandro (LIMSI-CNRS, France)
Christophe Hurter (ENAC, French Civil Aviation University, Toulouse France)
Cristina Sylla University of Minho
David Geerts (iMinds - University of Leuven (KU Leuven), Belgium)
Dirk Heylen (University of Twente IntetainElsebeth Korsgaard Sorensen)
Eva Irene (Brooks Aalborg University)
Fabrizio Lamberti (Politecnico di Torino)
Gualtiero Volpe (University of Genoa, Italy)
Insook Choi (Columbia College Chicago, USA)
Jesus Ibanez Escola Municipal d'Art i Disseny (EMAiD)
Jonathan Duckworth (RMIT University ArtsIt)
Jorge C. S. Cardoso (University of Coimbra, Portugal )
Jun Hu (Eindhoven University of Technology, Netherlands)
Lau Bee Theng (Swinburne University of Technology Sarawak Campus, Malaysia)
Mel Krokos (University of Portsmouth, United Kingdom)
Michail Kalogiannakis (Faculty of Education, University of Crete, Greece)
Milton Luiz Horn Vieira (UFSC Intetain)
Mikkel Kirkedahl Lysholm Nielsen Aalborg University, Denmark
Pedro Campos (Intetain)
Pieter Jan Maes (McGill University, Canada)
Rainer Malaka (University of Bremen)
Radu-Daniel Vatavu (University of Suceava, Romania)
Robin Bargar (Columbia College Chicago, USA)
Rolf Gehlhaar (private ArtsIt Creative Technologies)
Robby van Delden (University of Twente)
Sudarshan Khanna (National Institute of Design, India)
Surabhi Khanna Independent Design Educator & visiting faculty DLI
Thierry Dutoit (University of Mons, Belgium)
Tiago Cardoso (University Nova of Lisbon, Portugal)
Tracy Harwood (De Montfort University, Leicester, United Kingdom)
Vincent Courboulay (University of La Rochelle, France)
Valentina Nisi (University of Madeira)
Yves Rybarczyk (University Nova of Lisbon, Portugal)

Predrag K. Nikolic¹

Predrag K. Nikolic is Associate Professor at Cheung Kong School of Art and Design, Shantou University, in China. He is an interaction designer and an interactive media artist who holds a PhD in Digital Media and a Master in Business Administration. His research focuses on intelligent interfaces, robot creativity, AI aesthetics and design for behavioural changes. He mixes experiential reality, artificial intelligence, and responsive environments to engage an audience in new types of interactive experiences and media perceptions. His artworks, such as MindCatcher, InnerBody, Ciklosol, Before & Beyond, Vroom, Robosophy Philosophy, VR Restaurant and Digital Lolipop were exhibited and presented worldwide at the Ars Electronica, SIGGRAPH, SIGGRAPH Asia, Technarte, Singapore Science Center, Hong Kong – Shenzhen Design Biennial, Maison Shanghai, National Museum of Applied Art in Belgrade, Museum of Education in Belgrade, etc.

Before joining Shantou University, professor Nikolic was Dean of the Faculty of Digital Production in Novi Sad, Global Digital Director at Grey Worldwide, Global Digital Director at J. Walter Thomson Worldwide, Global Head of Digital at Ogilvy Greece, Head of Digital Marketing at Groundlink New York USA, Managing Director at JadePremier London UK and professional services consultant at YAHOO.

During his twenty years long career in the creative industry, he conceptualised and designed digital presence and digital media campaigns for the clients such as Czech Airlines, IBM, Telenor, Coca-Cola, Credit Agricole Bank, Kraft Foods, Nestle, Mars, H&M, etc.

Predrag K Nikolic has published numerous research papers in the field of artificial intelligence aesthetics, design for behaviour change, collective creativity, mix-experiential reality, multi-sensory interfaces, interactivity and interface design. He lectures at universities, act as Chair in committees and giving speeches at international conferences.

You can follow his work on the www.predragnikolic.com.

1: Shantou University, China

Recently Published
Most Popular

Learning by playing: An LBG for the Fortification Gates of the Venetian walls of the city of Heraklion
Appears in:
ct 18(16): e5

Authors:
Kostas Vassilakis, Orestis Charalampakos, Georgios Glykokokalos, Persefoni Kontokalou, Michail Kalogiannakis, Nikolas Vidakis

Published:
18th Oct 2018

Abstract:
Games in education have always been a tool for increasing motivation and interest of learners. We present Location-Based Games (LBG) as a tool to involve and motivate students in the learning process. LBGs require the player to move around in order to complete a task and proceed in the storyline an…Games in education have always been a tool for increasing motivation and interest of learners. We present Location-Based Games (LBG) as a tool to involve and motivate students in the learning process. LBGs require the player to move around in order to complete a task and proceed in the storyline and use localization technology such as Global Positioning System (GPS). LBGs are built on physical worlds, while virtual world augmentations enable the interaction of physical and other related (cultural, historical etc.) data with the player. Augmented reality (AR) is used to provide this extra layer with 3D objects, avatars and animations for player’s interaction. In our paper we present a history learning LBG with the use of augmented reality in the form of 3D objects. We explore the concept, of having both virtual and physical worlds available within the same visual display environment.
more »
Rendering style and viewer’s perception of historic virtual architecture
Appears in:
ct 18(16): e4

Authors:
Wei Tang, Nicoletta Adamo, Nicholas J. Villani, Hazar N. Dib

Published:
18th Oct 2018

Abstract:
The paper presents a study that investigated the effect of rendering style on users’ perception of 3D historic architectural environments. Three architectural styles were considered (Traditional Chinese, Gothic and Classic Greek) and three rendering approaches (photorealistic, non-photorealistic – …The paper presents a study that investigated the effect of rendering style on users’ perception of 3D historic architectural environments. Three architectural styles were considered (Traditional Chinese, Gothic and Classic Greek) and three rendering approaches (photorealistic, non-photorealistic – watercolor, and non-photorealistic – technical illustration) were used to render two landmark buildings for each architectural style. One hundred and fifty subjects were asked to rate the rendering results according to different aspects of perception. Findings show that photorealistic rendering was rated highest for visual appeal, suitability, and accuracy of representation of the architectural style, design elements and architectural details; recognition of the architectural style was highest for the non-photorealistic watercolor renderings.
more »
Instant Evaluation of Teaching Methods and Students’ Comprehension Level using Smart Mobile Technology
Appears in:
ct 18(16): e3

Authors:
George Tsamis, Nikos Papadakis, Evangelos Tzirakis, Maria Rousaki, Evi Katsaraki, John Nikolopoulos, Emmanouela Panteri, Kostas Vassilakis

Published:
18th Oct 2018

Abstract:
We design, implement and evaluate performance of Exantas application which is compatible with Android Operating System Smartphone devices. As Exantas tool was able to show ancients travelers the correct route to follow, we show that our application can help educational staff to improve their skills…We design, implement and evaluate performance of Exantas application which is compatible with Android Operating System Smartphone devices. As Exantas tool was able to show ancients travelers the correct route to follow, we show that our application can help educational staff to improve their skills and evaluate on the fly how efficient is the educational style that they follow. Results can help teachers measure while teaching how much of the lessons content has been successfully absorbed by students and what are the topics that need further analysis or even a completely new explanation approach. Moreover, teachers are now able to perform quickly and without effort, small evaluation tests during their lessons for each student individually and keep tracking of their overall semester performance, concluding in a more extensive, generic and reliable grading system. As experiments show, Exantas is able to reduce teaching efforts and to reveal real lessons comprehension status since teachers can make multiple Questions to all students and receive answers in seconds. Moreover, all queries are processed anonymously ensuring anonymity and integrity since students are not afraid to provide their actual answers when teaching method is evaluated, and individually for each account when students’ performance is checked.
more »
Towards a novel and LMS-free Pervasive Learning System exploiting the Experience API
Appears in:
ct 18(16): e2

Authors:
Spyros Panagiotakis, Koralia Papadokostaki, Kostas Vassilakis, Athanasios Malamos

Published:
18th Oct 2018

Abstract:
Experience API (xAPI), the evolution of SCORM (Sharable Content Object Reference Model) in e-learning content specifications, stably gains ground in education, defense and training. In this paper we shortly describe the xAPI specification, compare it to its predecessor, the SCORM, and present our n…Experience API (xAPI), the evolution of SCORM (Sharable Content Object Reference Model) in e-learning content specifications, stably gains ground in education, defense and training. In this paper we shortly describe the xAPI specification, compare it to its predecessor, the SCORM, and present our novel, Pervasive Learning System, which exploits the features offered by xAPI. Our implementation provides adapted learning content to the user according to his past activities, which are monitored via xAPI. Furthermore, our system provides the course instructor with a Dashboard and several powerful Learning Analytics. The latter offer insights into the learner‘s use of the course, average scores, actions performed and so on. Our Learning System does not involve the deployment of any Learning Management System. It is a flexible integrated system that may track and monitor the actions of users without the implication of external applications, whereas the statements may origin from diverse, scattered platforms.
more »
Evaluating Moodle use via Smart Mobile Phones. A case study in a Greek University
Appears in:
ct 18(16): e1

Authors:
Stamatios Papadakis, Michail Kalogiannakis, Eirini Sifaki, Nikolas Vidakis

Published:
18th Oct 2018

Abstract:
The use of learning management systems (LMS) has grown considerably in universities around the world. LMSs can offer a great variety of channels and workspaces to facilitate information sharing and communication among participants in a course. One of the most commonly used is Moodle, a free learnin…The use of learning management systems (LMS) has grown considerably in universities around the world. LMSs can offer a great variety of channels and workspaces to facilitate information sharing and communication among participants in a course. One of the most commonly used is Moodle, a free learning management system enabling the creation of powerful, flexible and engaging online courses and experiences. A course can consist of a number of lessons. Each lesson consists of reading materials; activities such as quizzes, tests, surveys, and projects; and social elements that encourage interaction and group work among students. This study investigated how often students used a mobile phone to access various activities on Moodle. The students’ point of view is important since they are the main users of the offered teaching technique and can cooperate in implementing and improving an e-course as a very important stakeholder in the e-learning process. A survey on self-reported usage was filled by 122 university students in a course offered by the faculty of Preschool Education at the University of Crete. Follow-up interviews were conducted to solicit students’ perceptions on mobile access to Moodle and the underlying reasons. The results show significant differences in students’ usage of various Moodle activities via mobile phones. Students’ responses also suggest that Moodle is used merely as an electronic document repository and not as an effective learning tool due to the limitations of mobile access on usability and reliability.
more »
Towards a 15.5W Si-LDMOS Energy Efficient Balanced RF Power Amplifier for 5G-LTE Multi-carrier Applications
Appears in:
ct 18(15): e5

Authors:
B. A. Mohammed, A. S. Hussaini, R. A. Abd-Alhameed, I. M. Danjuma, A. S. Asharaa, I. T. E. Elfergani, J. Rodriguez

Published:
10th Apr 2018

Abstract:
In this paper, a 15.5W Si-LDMOS balanced RF power amplifier has been designed using 2.620-2.690GHz frequency band to improve efficiency and linearity for 5G-LTE mobile applications. The amplifier was designed and simulated using large signal Si-LDMOS transistor model to achieve 53% PAE, 41dBm Pout,…In this paper, a 15.5W Si-LDMOS balanced RF power amplifier has been designed using 2.620-2.690GHz frequency band to improve efficiency and linearity for 5G-LTE mobile applications. The amplifier was designed and simulated using large signal Si-LDMOS transistor model to achieve 53% PAE, 41dBm Pout, 14 dB gain at P1dB saturation point. The proposed balanced RF power amplifier was fabricated and measurement results for phase variation of the signal between the carriers have been the main focus. At 1dB compression point power added efficiency increased to 81.5% with 19.5 gain at the Pout. The AM-AM and AM-PM measured data of the balanced RF power amplifier was extracted from the MATLAB fitting tool to produce polynomials. The polynomials were used in the proposed pre-distortion technique to compensate for the nonlinearities of the balanced power amplifier. A simple linear model was designed for behavioural modelling of the memory-less baseband digital pre-distorter. A Simulink IEEE 802.11a OFDM Transceiver system was used to demonstrate validity of the proposed pre-distorter. To the best of authors’ knowledge, this study presented excellent results of predistortion system that compensated the nonlinearity behaviour of the balanced RF power amplifier using the Simulink version R2011a.
more »
Evolutionary generation of game levels
Appears in:
ct 18(15): e4

Authors:
A. M. Connor, T. J. Greig, J. Kruse

Published:
10th Apr 2018

Abstract:
This paper outlines an approach for evolutionary procedural generation of video game content. The study deals with the automatic generation of game level designs using genetic algorithms and the development of a fitness function that describes the playability of the game level. The research explore…This paper outlines an approach for evolutionary procedural generation of video game content. The study deals with the automatic generation of game level designs using genetic algorithms and the development of a fitness function that describes the playability of the game level. The research explores whether genetic algorithms have the ability to produce outcomes that demonstrate characteristics that arise through human creativity, and whether these automated approaches offer any benefits in terms of time and effort involved in the design process. The approach is compared to a random method and the results show that the genetic algorithm is more consistent in finding levels; however analysis of the game levels indicates that the fitness function is not fully capturing level playability. The ability to produce playable levels decreases as the play area increases, however there is potential to produce larger maps that are both playable and arguably creative through a recombination method.
more »
The A-Z of Creative Technologies
Appears in:
ct 18(15): e3

Authors:
A.M. Connor, R. Sosa

Published:
10th Apr 2018

Abstract:
This paper undertakes an initial critical analysis of Creative Technologies as a means to gain insight to the nature of this as an emerging field. The paper utilises an approach previously used in the design discipline to characterise the field through the embodiment of an alphabetised narrative. …This paper undertakes an initial critical analysis of Creative Technologies as a means to gain insight to the nature of this as an emerging field. The paper utilises an approach previously used in the design discipline to characterise the field through the embodiment of an alphabetised narrative. This is extended through an analysis of the inter-relationships between the identified elements. The outcomes of this work are useful both in terms of identifying outcomes of academic programmes related to Creative Technologies and also stimulating a wider debate around the nature of the field.
more »
Auditory and Visual based Intelligent Lighting Design for Music Concerts
Appears in:
ct 18(15): e2

Authors:
E. Oxholm, E. K. Hansen, G. Triantafyllidis

Published:
10th Apr 2018

Abstract:
Playing music is about conveying emotions and the lighting at a concert can help do that. However, without a dedicated light technician, many bands have to miss out on lighting that will help them to convey the emotions of what they play. In this paper we aim to develop an intelligent system that d…Playing music is about conveying emotions and the lighting at a concert can help do that. However, without a dedicated light technician, many bands have to miss out on lighting that will help them to convey the emotions of what they play. In this paper we aim to develop an intelligent system that detects the intended emotions of the played music and in real-time adjusts the lighting accordingly. Through state-of-the-art research on music and emotion, a row of cues is defined. This includes amount, speed, fluency and regularity for the visual and level, tempo, articulation and timbre for the auditory. By assessing such cues, the system is able to detect the intended emotion. Specific lighting designs are then developed to support these specific emotions. The results suggest that the intelligent emotion-based lighting system has an advantage over a just beat synced lighting and it is concluded that there is reason to explore this idea further.
more »
New Entanglements between Instrumental, Shared and Mental Maps in the Exploration of Urban Space: an Experimental Project
Appears in:
ct 18(15): e1

Author:
B. Guelton

Published:
10th Apr 2018

Abstract:
The new access to cartographic tools (beyond specialist uses) produces new collective shared configurations and new, further mental individual and collective representations. With several years’ experiments of interactions between participants in remote cities, the aim of the research presented her…The new access to cartographic tools (beyond specialist uses) produces new collective shared configurations and new, further mental individual and collective representations. With several years’ experiments of interactions between participants in remote cities, the aim of the research presented here is a better understanding of entanglements between instrumental, shared and mental maps. More specifically the question is to know how new instrumental uses renew shared mental representations of urban spaces. How are mental maps constructed in situations of interaction with connected and dynamic uses? Consecutively, how are they developing when shared? The aim is to understand new forms of entanglements between egocentric, allocentric and distributed spaces in the mobile perception of urban space.
more »

Solitude or co-existence – or learning-together-apart with digital dialogic technologies for kids with developmental and attention difficulties
Appears in:
ct 17(12): e4

Authors:
E.K. Sorensen, H.V. Andersen

Downloads:
1109

Abstract:
An overall political vision of a prosperous society is one in which everyone has the same access and possibilities of participating in democratic processes, and in which everyone has equal access to the resources, life and learning – a society grasping the potential of diversity. This study reports…An overall political vision of a prosperous society is one in which everyone has the same access and possibilities of participating in democratic processes, and in which everyone has equal access to the resources, life and learning – a society grasping the potential of diversity. This study reports on research into the impact of digital technological interventions for including kids with attention and developmental dificulties into school class contexts. The paper describes, how the authors have approached the challenge of researching inclusion of kids with attention and developmental deficits for communication, collaboration and knowledge sharing. Some of the questions addressed in the study are: How – and in what sense - may technology and technological interventions be utilised to enhance this approach with our focus learners? In which situations does it occur in the case study? The data analysis assesses the potential of interventions with digital technology for acting as stimulating enzymes for life and learning. On the basis of a thorough discussion of the analysis and findings, the authors assess the degree to which interventions with digital technologies may promote inclusion through stimulating the participation in life and learning of kids with attention and developmental deficits.
more »
Video Streaming Analysis in Vienna LTE System Level Simulator
Appears in:
ct 16(7): e1

Authors:
Zakaria Ye, Tania Jimenez, Rachid El-Azouzi

Downloads:
940

Abstract:
The demand for multimedia services in mobile communication is increasing day by day due to the proliferation of end devices. To overcome the future needs of data communication on mobile devices, the $ 3^{rd} $ Generation Partnership Project (3GPP) has introduced a new technology which is known as L…The demand for multimedia services in mobile communication is increasing day by day due to the proliferation of end devices. To overcome the future needs of data communication on mobile devices, the $ 3^{rd} $ Generation Partnership Project (3GPP) has introduced a new technology which is known as Long Term Evolution (LTE) UMTS. In this paper, we study video streaming behavior on the LTE network. For this purpose, we use the Vienna LTE System Level Simulator which implements network features that correspond to our goal. We consider the parameters that may affect the users experience on a network and define ten scenarios for our simulations. We finally search for methods to fit the video streaming data traffic on the LTE network and exhibit its long range dependence.
more »
Development of a wearable haptic game interface
Appears in:
ct 16(6): e5

Authors:
J. Foottit, D. Brown, S. Marks, A.M. Connor

Downloads:
616

Abstract:
This paper outlines the ongoing development of a wearable haptic game interface, in this case for controlling a flight simulator. The device differs from many traditional haptic feedback implementations in that it combines vibrotactile feedback with gesture based input, thus becoming a two-way cond…This paper outlines the ongoing development of a wearable haptic game interface, in this case for controlling a flight simulator. The device differs from many traditional haptic feedback implementations in that it combines vibrotactile feedback with gesture based input, thus becoming a two-way conduit between the user and the virtual environment. The device is intended to challenge what is considered an “interface” and sets out to purposefully blur the boundary between man and machine. This allows for a more immersive experience, and a user evaluation shows that the intuitive interface allows the user to become the aircraft that is controlled by the movements of the user's hand.
more »
Multi-agent evolutionary systems for the generation of complex virtual worlds
Appears in:
ct 15(5): e5

Authors:
J. Kruse, A. M. Connor

Downloads:
568

Abstract:
Modern films, games and virtual reality applications are dependent on convincing computer graphics. Highly complex models are a requirement for the successful delivery of many scenes and environments. While workflows such as rendering, compositing and animation have been streamlined to accommodate …Modern films, games and virtual reality applications are dependent on convincing computer graphics. Highly complex models are a requirement for the successful delivery of many scenes and environments. While workflows such as rendering, compositing and animation have been streamlined to accommodate increasing demands, modelling complex models is still a laborious task. This paper introduces the computational benefits of an Interactive Genetic Algorithm (IGA) to computer graphics modelling while compensating the effects of user fatigue, a common issue with Interactive Evolutionary Computation. An intelligent agent is used in conjunction with an IGA that offers the potential to reduce the effects of user fatigue by learning from the choices made by the human designer and directing the search accordingly. This workflow accelerates the layout and distribution of basic elements to form complex models. It captures the designer’s intent through interaction, and encourages playful discovery.
more »
A conceptual framework for audio-visual museum media
Appears in:
ct 17(11): e4

Author:
M. K. L. Nielsen

Downloads:
443

Abstract:
In today's history museums, the past is communicated through many other means than original artefacts. This interdisciplinary and theoretical article suggests a new approach to studying the use of audio-visual media, such as film, video and related media types, in a museum context. The centre of in…In today's history museums, the past is communicated through many other means than original artefacts. This interdisciplinary and theoretical article suggests a new approach to studying the use of audio-visual media, such as film, video and related media types, in a museum context. The centre of interest is how history and authenticity is mediated at history museums and how museum visitors perceive this use. In this article, focus is moved away from technology and specific types of installations to concentrate on what museums do with technology. Building on disciplines such as media science and museum studies, existing case studies, and real life observations, the suggested framework instead stress particular characteristics of contextual use of audio-visual media in history museums, such as authenticity, virtuality, interativity, social context and spatial attributes of the communication design.
more »
Head pose estimation & TV Context: current technology
Appears in:
ct 15(3): e2

Authors:
Francois Rocca, Matei Mancas, Fabien Grisard, Julien Leroy, Thierry Ravet, Bernard Gosselin

Downloads:
439

Abstract:
With the arrival of low-cost high quality cameras, implicit user behaviour tracking is easier and it becomes very interesting for viewer modelling and content personalization in a TV context. In this paper, we present a comparison between three common algorithms of automatic head direction extrac…With the arrival of low-cost high quality cameras, implicit user behaviour tracking is easier and it becomes very interesting
for viewer modelling and content personalization in a TV context. In this paper, we present a comparison between three
common algorithms of automatic head direction extraction for a person watching TV in a realistic context. Those algorithms
compute the different rotation angles of the head (pitch, roll, yaw) in a non-invasive and continuous way based on 2D and/or
3D features acquired with low cost cameras. These results are compared with a reference based on the Qualisys motion
capture commercial system which is a robust marker-based tracking system. The performances of the different algorithms
are compared function of different configurations.
While our results show that full implicit behaviour tracking in real-life TV setups is still a challenge, with the arrival of next
generation sensors (as the new Kinect one sensor), accurate TV personalization based on implicit behaviour is close to
become a very interesting option.
more »
Evaluating music performance and context-sensitivity with Immersive Virtual Environments
Appears in:
ct 15(2): e3

Authors:
Donald Glowinski, Naëm Baron, Kanika Shirole, Sélim Yahia Coll, Lina Chaabi, Tamara Ott, Marc-André Rappaz, Didier Grandjean

Downloads:
426

Abstract:
This study explores a unique experimental protocol that evaluates how a musician’s sensitivity to social context during performance can be analysed through a combination of behavioral analysis, self-report and Immersive Virtual Environment (IVE). An original application has been developed to create…This study explores a unique experimental protocol that evaluates how a musician’s sensitivity to social context during performance can be analysed through a combination of behavioral analysis, self-report and Immersive Virtual Environment (IVE). An original application has been developed to create audience of avatars that display different motivational states that are known to affect musician's performance. The musicians’ body expressions have then been
recorded through a motion capture system and analysed as they relate to audience motivational state. The musician subjective experience has been captured after each performance through semi-structured interviews. Preliminary results
depict the strategies implicitly employed by four expert violinists during their performances under the various contexts (empty room and engaged and disengaged audience of avatars). Finally, this study discusses the way to improve methodology, analyses and real-world responses to musician's needs.
more »
Varianish: Jamming with Pattern Repetition
Appears in:
ct 14(1): e3

Authors:
Jort Band, Mathias Funk, Peter Peters, Bart Hengeveld

Downloads:
421

Abstract:
In music, patterns and pattern repetition are often regarded as a machine-like task, indeed often delegated to drum Machines and sequencers. Nevertheless, human players add subtle differences and variations to repeated patterns that are musically interesting and often unique. Especially when looki…In music, patterns and pattern repetition are often regarded as a machine-like task, indeed often delegated to drum Machines and sequencers. Nevertheless, human players add subtle differences and variations to repeated patterns that are musically interesting and often unique. Especially when looking at minimal music, pattern repetitions create hypnotic effects and the human mind blends out the actual pattern to focus on variation and tiny differences over time. Varianish is a musical instrument that aims at turning this phenomenon into a new musical experience for musician and audience: Musical pattern repetitions are found in live music and Varianish generates additional (musical) output accordingly that adds substantially to the overall musical expression. Apart from the theory behind the pattern finding and matching and the conceptual design, a demonstrator implementation of Varianish is presented and evaluated.
more »
PaisleyTrees: A Size-Invariant Tree Visualization
Appears in:
ct 14(1): e2

Authors:
Katayoon Etemad, Dominikus Baur, John Brosz, Sheelagh Carpendale, Faramarz F. Samavati

Downloads:
421

Abstract:
Squeezing large tree structures into suitable visualizations has been a perennial problem. In response to this challenge, we present PaisleyTrees, a size-invariant tree visualization. PaisleyTrees integrate node-of-interest focus with tree-cut presentations to support rapid tree navigation without …Squeezing large tree structures into suitable visualizations has been a perennial problem. In response to this challenge, we present PaisleyTrees, a size-invariant tree visualization. PaisleyTrees integrate node-of-interest focus with tree-cut presentations to support rapid tree navigation without resorting to zooming and panning. This visualization offers the ability to work with trees of arbitrary depth and breadth, and maintains legibility for displayed elements. These advantages are achieved by using a hybrid layout, inspired by traditional Paisley patterns, that combines node-link, nested and djacency-based tree layout techniques, and offers both depth and breadth elision.
more »
CuriousMind photographer: distract the robot from its initial task
Appears in:
ct 15(2): e4

Authors:
Vincent Courboulay, Matei Mancas

Downloads:
410

Abstract:
Mainly present in industry, robots begin to invade our every-day lives for very precise tasks. In order to reach a level where more general robots get involved in our lives, the robots' abilities to communicate and to react to unexpected situations must be improved. This paper introduces an attent…Mainly present in industry, robots begin to invade our every-day lives for very precise tasks. In order to
reach a level where more general robots get involved in our lives, the robots' abilities to communicate and to react to unexpected situations must be improved. This paper introduces an attentive computational model for robots as attention can help both in reacting to unexpected situations and to help improving human-robot communication. We propose to enhance and implement an existing real time computational model. Intensity, color and orientation are usually used but we have added information related to depth and isolation. We have built a robotic system based on LEGO Mindstorm platform and the Kinect RGB-D sensor. This robot, called CuriousMind, is able to take a picture of the most interesting part of the scene and it can also be distracted from its first goal by novel situations mimicking in that way the human (and more precisely small children) behaviour.
more »

Publisher: EAI
ISSN: 2409-9708
Number of Volumes: 5

Last Published: 18th Oct 2018

EAI Endorsed Transactions on Creative Technologies

An open access journal abstracted/indexed in DBLP, CrossRef, EBSCO Discovery Services, DOAJ, and WorldCat. It focuses on a whole industrial project or framework integrating creative technologies, creative content management and more, with no publishing fees.

Predrag K. Nikolic1

Predrag K. Nikolic¹