Multimodal Interaction in Virtual Environments

De leerstoel Multimodal Interaction in Virtual Environments focust zich op onderzoek naar de perceptuele en interactieve aspecten van gesimuleerde werelden, met serious gaming als toepassingsgebied.

Lopend AIO-onderzoek houdt zich bezig met: Affective Appraisal of Virtual Environments, Multimodal Memory and gaming, Human manoeuvring in Virtual Environments, BrainComputer Interfaces for gaming, Multimodal cue combination, and Controled game-based stress manipulation.

Strategic themes / Focus areas
Gegenereerd op 2018-02-18 02:13:36
All publications
  2017 - Scholarly publications
Rosa, N.E., Hürst, W.O., Veltkamp, R.C. & Werkhoven, P.J. (2017). Player-Avatar Link: Interdisciplinary Embodiment Perspectives. In Newton Lee (Eds.), Encyclopedia of Computer Graphics and Games Cham: Springer.
  2016 - Scholarly publications
Rosa, N.E., Werkhoven, P.J. & Hürst, W.O. (2016). (Re-)Examination of Multimodal Augmented Reality. MVAR '16 : Proceedings of the 2016 workshop on Multimodal Virtual and Augmented Reality ACM.
Rosa, N.E., Hürst, W.O., Werkhoven, P.J. & Veltkamp, R.C. (2016). Visuotactile Integration for Depth Perception in Augmented Reality. In Yukiko I. Nakano, Elisabeth André & Toyoaki Nishida (Eds.), ICMI’16: Proceedings of the 18th ACM International Conference on Multimodal Interaction - Tokyo, Japan-November 12-16, 2016 (pp. 45-52). ACM.
  2015 - Scholarly publications
van der Vijgh, Benny, Beun, Robbert Jan, van Rood, Maarten & Werkhoven, Peter (2015). Meta-analysis of digital game and study characteristics eliciting physiological stress responses. Psychophysiology (19 p.). Early View (Online Version of Record published before inclusion in an issue).
Rosa, N.E., Hürst, W.O., Vos, Wouter & Werkhoven, P.J. (2015). The Influence of Visual Cues on Passive Tactile Sensations in a Multimodal Immersive Virtual Environment. 17th ACM International Conference on Multimodal Interaction - ICMI 2015, November 9-13, 2015 (pp. 327-334) (8 p.). Seattle, WA, USA.
  2014 - Scholarly publications
Werkhoven, Peter, Philippi, Tom & van Erp, J.B.F. (2014). Audiovisual navigation in virtual mazes - The benefits of audiovisual landmarks. Displays, 35 (3), (pp. 110-117) (7 p.).
van der Vijgh, Benny, Beun, Robert-Jan, van Rood, Maarten & Werkhoven, Peter (08.12.2014). GASICA - Generic automated stress induction and control application design of an application for controlling the stress state. Frontiers in Neuroscience, 8 (400).
Thurlings, Marieke, Brouwer, Anne-Marie, Erp, van, Jan B.F. & Werkhoven, Peter (2014). Gaze-independent ERP-BCIs: augmenting performance through location-congruent bimodal stimuli. Frontiers in Neuroscience, 8 (14 p.).
van Erp, J.B.F., Philippi, Tom, de Winkel, Ksander & Werkhoven, Peter (06.03.2014). Pre- and post-stimulus EEG patterns associated with the touch-induced illusory flash. Neuroscience Letters, 562, (pp. 79-84).
  2013 - Scholarly publications
Thurlings, Marieke, Brouwer, Anne-Marie, van Erp, J.B.F. & Werkhoven, Peter (2013). Controlling a tactile ERP-BCI in a dual-task. IEEE Transactions on Computational Intelligence and AI in Games, (pp. 129-140).
de Winkel, Ksander, Soyka, Barnett-Cowan, Bülthoff, Heinrich H., Groen, Eric L. & Werkhoven, Peter (2013). Integration of Visual and Inertial Cues in the Perception of Angular Self-Motion. Experimental Brain Research, 231 (2), (pp. 209-218).
Philippi, Tom, van Erp, J.B.F. & Werkhoven, Peter (2013). Observers can reliably identify illusory flashes in the illusory flash paradigm. Experimental Brain Research, 226 (1), (pp. 73-79).
  2012 - Scholarly publications
Thurlings, Marieke, Brouwer, Anne-Marie, van Erp, J.B.F., Blankertz, B. & Werkhoven, Peter (2012). Control-Display Mapping Congruency in Brain-Computer Interfaces. Ergonomics
van der Vijgh, B.H., Beun, R.J. & Werkhoven, P.J. (2012). Controlled game-based stress manipulation. In A J Spink, F Grieco, O E Krips, P H Zimmerman, L P J J Noldus & L W S Loijens (Eds.), Proceedings of Measuring Behavior 2012, 8th International Conference on Methods and Techniques in Behavioral Research (pp. 390-393) (4 p.). Wageningen: Noldus Information Technology bv., Measuring Behavior 2012, 8th International Conference on Methods and Techniques in Behavioral Research.
Thurlings, Marieke, Brouwer, Anne-Marie, van Erp, J.B.F., Blankertz, B. & Werkhoven, Peter (2012). Does bimodal stimulus presentation increase ERP components usable in BCIs?. Journal of Neural Engineering, 9 (4).
de Winkel, Ksander, Werkhoven, Peter & Groen, Eric L. (2012). The perception of verticality in lunar and Martian gravity conditions. Neuroscience Letters, 529 (1), (pp. 7-11).
  2011 - Scholarly publications
Jansen, S.E.M., Toet, A. & Werkhoven, P.J. (2011). Human Locomotion through a Multiple Obstacle Environment: Strategy Changes as a Result of Visual Field Limitation. Experimental Brain Research, 212 (3), (pp. 449-456) (8 p.).
Philippi, Tom, van Erp, J.B.F. & Werkhoven, Peter (2011). Multisensory effects differ for counting small and large pulse numbers. Seeing and Perceiving, 24 (6), (pp. 565-578).
Jansen, S.E.M., Toet, A. & Werkhoven, P.J. (2011). Obstacle Crossing with Lower Visual Field Restriction: Shifts in Strategy. Journal of Motor Behavior, 43 (1), (pp. 55-62) (8 p.).
  2010 - Scholarly publications
de Winkel, K.N., Weesie, H.M., Werkhoven, P.J. & Groen, E.L. (2010). Integration of visual and inertial cues in perceived heading of self-motion. Journal of Vision, 10 (12), (pp. 1-10) (10 p.).
  2009 - Scholarly publications
Werkhoven, Peter, van Erp, J.B.F. & Philippi, Tom (2009). Counting visual and tactile events: The effect of attention on multisensory integration. Attention, Perception, and Psychophysics, 71 (8), (pp. 1854-1861).
van Diggelen, J., Beun, Robbert Jan, van Eijk, Rogier & Werkhoven, Peter (2009). Efficient Semantic Information Exchange for Ambient Intelligence. Computer Journal
van der Kleij, Rick, Schraagen, Jan-Maarten & Werkhoven, Peter (2009). How conversations change over time in face-to-face and Video mediated Communication. Small Group Research, 40 (4), (pp. 355-381).
  2008 - Scholarly publications
van Diggelen, J., Beun, R.J., van Eijk, R.M. & Werkhoven, P.J. (2008). Agent Communication in Ubiquitous Computing: the Ubismart Approach. Proceedings of the Seventh International Conference on Autonomous Agents and Multi-Agent Systems (pp. 813-820) (8 p.). ACM Press, AAMAS08.
van Diggelen, J., Beun, R.J., van Eijk, R.M. & Werkhoven, P.J. (2008). Information Supply Mechanisms in Ubiquitous Computing, Crisis Management and Workflow Modelling. Proceedings of the 7th International Workshop on Task Models and Diagrams (TAMODIA 2008) (pp. 72-83) (12 p.). Berlin: Springer.
van Diggelen, J., Beun, R.J., van Eijk, R.M. & Werkhoven, P.J. (2008). Modeling Decentralized Information Flow in Ambient Environments. In Carsten Rudolph Antonio Mana (Eds.), Developing Ambient Intelligence, Proceedings of the second international conference on Ambient Intelligence Developments (AmI.d'07) (pp. 23-33) (11 p.). France, Paris: Springer, Conference on Ambient Intelligence Developments.
Philippi, T.G., van Erp, J.B.F. & Werkhoven, P.J. (2008). Multisensory Temporal Numerosity Judgment. Brain Research, 1242, (pp. 116-125) (10 p.).
^ top
Gegenereerd op 2018-02-18 02:13:36

Completed projects

Sleep Care: Persuasive Technology for Personalized Sleep Coaching 15.01.2012 to 01.05.2016
General project description

Sleep disorders are among the most prevalent mental disorders in the general population. They impair daily functioning, reduce quality of life and enhance health care costs for millions worldwide. To improve the quality of sleep, we propose a non-pharmacological approach based on methods and techniques derived from cognitive behaviour therapy for insomnia (CBT-I), persuasive technology and current information and communication technology. The scientific aim of this project is to enhance the understanding of personalized self-help therapy in the domain of sleep with the aid of existing (hardware) technology. We aim in particular at a generic, scientifically-proven framework that integrates persuasion strategies for sustainable behaviour change and the technology to support these strategies. As a proof of concept, a virtual coach will be modelled and implemented that enacts a first contact in a stepped care system. The resulting implementation of the model will be called the coaching engine and may be considered as a persuasive assistant that, at an appropriate time, offers and adapts sleep relevant exercises, and that gives various types of support and advice given a personal model of the coachee and its environment. In the design process of the virtual coach, an incremental approach with short evaluation cycles will be followed. In the final year, a summative user study will be performed in a Randomized Controlled Trial. Criteria for success include (but are not restricted to) improved subjective sleep quality, sleep efficiency and daytime functioning, and reduced time to fall asleep. The expected results are 1. a generic computational coaching model scientifically validated in the domain of sleep, 2. persuasive coaching strategies for exercise adherence and cognitive restructuring in computerized mobile coaching and 3. an integrative framework for symbolic interaction, sensor data, environmental changing devices and human interaction/intervention.

Role Researcher Funding
Other grant (government funding)
Project members UU
Gegenereerd op 2018-02-18 02:13:37
Additional functions and activities
  • Managing Director Technical Sciences at TNO. 
  • Member Supervisory Board of the National Research Initiative Brain & Cognition (NWO).
Gegenereerd op 2018-02-18 02:13:37
Full name
prof. dr. P.J. Werkhoven Contact details
Buys Ballotgebouw

Princetonplein 5
Room BBL-422
The Netherlands

Phone number (direct) +31 30 253 5093
Phone number (department) +31 30 253 4109
Gegenereerd op 2018-02-18 02:13:37
Last updated 28.08.2015