Automotive user interfaces : Creating interactive experiences in the car

Human–Computer Interaction Series

Gerrit Meixner

Christian Müller Editors

Automotive

User

Interfaces

Creating Interactive Experiences in the

Car

Human–Computer Interaction Series

Editors-in-chief

Desney Tan

Microsoft Research, USA

Jean Vanderdonckt

Université catholique de Louvain, Belgium

More information about this series at http://www.springer.com/series/6033

Gerrit Meixner ⋅ Christian Müller

Editors

Automotive User Interfaces

Creating Interactive Experiences in the Car

123

Editors

Gerrit Meixner

UniTyLab

Heilbronn University

Heilbronn

Germany

Christian Müller

Automotive IUI

German Research Centre for Artificial

Intelligence (DFKI)

Saarbrücken

Germany

ISSN 1571-5035

Human–Computer Interaction Series

ISBN 978-3-319-49447-0 ISBN 978-3-319-49448-7 (eBook)

DOI 10.1007/978-3-319-49448-7

Library of Congress Control Number: 2016959404

© Springer International Publishing AG 2017

This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part

of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations,

recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission

or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar

methodology now known or hereafter developed.

The use of general descriptive names, registered names, trademarks, service marks, etc. in this

publication does not imply, even in the absence of a specific statement, that such names are exempt from

the relevant protective laws and regulations and therefore free for general use.

The publisher, the authors and the editors are safe to assume that the advice and information in this

book are believed to be true and accurate at the date of publication. Neither the publisher nor the

authors or the editors give a warranty, express or implied, with respect to the material contained herein or

for any errors or omissions that may have been made.

Printed on acid-free paper

This Springer imprint is published by Springer Nature

The registered company is Springer International Publishing AG

The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland

Preface

This book is about automotive user interfaces. In the last years the importance of

user interfaces for in-vehicle usage has increased strongly. Different studies show

that over 80% of today’s innovations in the automotive industry are based on car

electronics and its software. These innovations can be categorized into hidden

technologies (e.g., ASP, ESP), comfort functions (e.g., navigation, communication,

entertainment) or driver assistance (e.g., distance checking). Especially the last two

categories have to be configurable by the driver and therefore require a certain

amount of driver interaction. This results in a need for a modern and consistent

automotive user interface which on the one hand allows the configuration of these

systems and on the other hand conforms to the specialized requirements of the

automotive industry. Some of these requirements are: the interaction devices have

to be integrated into a limited space; the automotive user interface has to be intu￾itively usable and adaptable, since drivers generally do not get an extensive

explanation and the automotive user interface has to be very easy to use and should

distract the driver as little as possible from his main task of driving. The increased

complexity of automotive user interfaces, the importance of using consumer elec￾tronic devices like smartphones in the car as well as autonomous driving has

induced a lot of research at universities and industrial companies.

The specific chapters in this book cover a relatively broad spectrum of detailed

research topics in the area of automotive user interfaces concerning, e.g. usability

and user experience, interaction techniques and technologies, applications, etc. This

book provides an outstanding overview as well as deep insights into the area of

automotive user interfaces, which is an important topic in the field of human–

computer interaction. Besides aiming to be a reference in its area, this book is

intended as a very significant and valuable source for professional practitioners,

researchers as well as senior and postgraduate computer science and engineering

students.

v

This book could not be completed without the help of many people. We would

like to thank all the authors for their contribution to the book. Finally, we would

like to thank Beverley Ford and James Robinson at Springer (London, UK) for their

support and assistance in publishing this book in a timely fashion.

Heilbronn, Germany Gerrit Meixner

Saarbrücken, Germany Christian Müller

September 2016

vi Preface

Contents

Part I Introduction and Basics

1 Retrospective and Future Automotive Infotainment

Systems—100 Years of User Interface Evolution ............... 3

Gerrit Meixner, Carina Häcker, Björn Decker, Simon Gerlach,

Anne Hess, Konstantin Holl, Alexander Klaus, Daniel Lüddecke,

Daniel Mauser, Marius Orfgen, Mark Poguntke, Nadine Walter

and Ran Zhang

2 Engaged Drivers–Safe Drivers: Gathering Real-Time Data

from Mobile and Wearable Devices for Safe-Driving Apps ....... 55

Fabius Steinberger, Ronald Schroeter and Diana Babiac

Part II Usability and User Experience

3 Driver and Driving Experience in Cars....................... 79

Klaus Bengler

4 “It’s More Fun to Commute”—An Example of Using Automotive

Interaction Design to Promote Well-Being in Cars.............. 95

Marc Hassenzahl, Matthias Laschke, Kai Eckoldt, Eva Lenz

and Josef Schumann

5 Design to Support Energy Management for Electric

Car Drivers ............................................. 121

Anders Lundström and Cristian Bogdan

6 Cultural User Experience in the Car—Toward a Standardized

Systematic Intercultural Agile Automotive UI/UX

Design Process............................................ 143

Rüdiger Heimgärtner, Alkesh Solanki and Helmut Windl

vii

Part III Interaction Techniques and Technologies

7 The Neglected Passenger—How Collaboration in the Car

Fosters Driving Experience and Safety ....................... 187

Alexander Meschtscherjakov, Nicole Perterer, Sandra Trösterer,

Alina Krischkowsky and Manfred Tscheligi

8 The Influence of Non-driving-Related Activities on the Driver’s

Resources and Performance ................................ 215

Renate Häuslschmid, Bastian Pfleging and Andreas Butz

9 Eye and Head Tracking for Focus of Attention Control

in the Cockpit ........................................... 249

Mohammad Mehdi Moniri and Michael Feld

10 From Car-Driver-Handovers to Cooperative Interfaces:

Visions for Driver–Vehicle Interaction in Automated Driving ..... 273

Marcel Walch, Kristin Mühl, Johannes Kraus, Tanja Stoll,

Martin Baumann and Michael Weber

11 Driver in the Loop: Best Practices in Automotive Sensing

and Feedback Mechanisms................................. 295

Andreas Riener, Myounghoon Jeon, Ignacio Alvarez

and Anna K. Frison

12 Towards Adaptive Ambient In-Vehicle Displays and Interactions:

Insights and Design Guidelines from the 2015 AutomotiveUI

Dedicated Workshop...................................... 325

Andreas Löcken, Shadan Sadeghian Borojeni, Heiko Müller,

Thomas M. Gable, Stefano Triberti, Cyriel Diels, Christiane Glatz,

Ignacio Alvarez, Lewis Chuang and Susanne Boll

13 The Steering Wheel: A Design Space Exploration .............. 349

Alexander Meschtscherjakov

Part IV Tools, Methods and Processes

14 The Insight–Prototype–Product Cycle Best Practices and

Processes to Iteratively Advance In-Vehicle Interactive

Experiences Development .................................. 377

Ignacio Alvarez, Adam Jordan, Juliana Knopf, Darrell LeBlanc,

Laura Rumbel and Alexandra Zafiroglu

15 Virtual Reality Driving Simulator Based on Head-Mounted

Displays ................................................ 401

Quinate Chioma Ihemedu-Steinke, Rainer Erbach, Prashanth Halady,

Gerrit Meixner and Michael Weber

viii Contents

16 Methods to Validate Automotive User Interfaces Within

Immersive Driving Environments ........................... 429

Diana Reich, Christian Buchholz and Rainer Stark

Part V Applications

17 User Experience with Increasing Levels of Vehicle Automation:

Overview of the Challenges and Opportunities as Vehicles

Progress from Partial to High Automation .................... 457

Patrice Reilhac, Katharina Hottelart, Frederik Diederichs

and Christopher Nowakowski

18 AutoPlay: Unfolding Motivational Affordances

of Autonomous Driving.................................... 483

Sven Krome, Jussi Holopainen and Stefan Greuter

Contents ix

Part I

Introduction and Basics

Chapter 1

Retrospective and Future Automotive

Infotainment Systems—100 Years of User

Interface Evolution

Gerrit Meixner, Carina Häcker, Björn Decker, Simon Gerlach,

Anne Hess, Konstantin Holl, Alexander Klaus, Daniel Lüddecke,

Daniel Mauser, Marius Orfgen, Mark Poguntke, Nadine Walter

and Ran Zhang

Abstract The history of automotive HMI development reveals that the develop￾ment of new interactive in-car functionalities (such as infotainment systems) has

often been influenced by upcoming new technologies that customers got used to in

their daily lives. Examples of such technologies include the first in-car radio, which

was introduced around 1922, or the first in-car phone, which was introduced around

1952. Today, a car without such functionalities is hard to imagine and the auto￾motive industry is aiming to develop and integrate more and more innovative

functionality to stay competitive on the market. The development of such functions

is motivated by the construction of safer, more efficient, and more comfortable

G. Meixner (✉) ⋅ C. Häcker

UniTyLab, Heilbronn University, Max-Planck-Strasse 39, 74081 Heilbronn, Germany

e-mail: [email protected]

B. Decker

Comlet Verteilte Systeme GmbH, Amerikastrasse 27, 66482 Zweibrücken, Germany

S. Gerlach

Vorentwicklung Connected Car and Infotainment, Volkswagen AG,

38440 Wolfsburg, Germany

A. Hess ⋅ K. Holl ⋅ A. Klaus

Fraunhofer IESE, Trippstadter Strasse 121, 67663 Kaiserslautern, Germany

D. Lüddecke

Group Research/Human Factors and HMI, Volkswagen AG,

P.O. Box 1777, 38436 Wolfsburg, Germany

D. Mauser

Communications (INST-ICM/BSV-BS), Bosch Software Innovations GmbH,

Stuttgarterstrasse 130, 71332 Waiblingen, Germany

M. Orfgen

Innovative Factory Systems (IFS), DFKI, Trippstadter Strasse 122,

67663 Kaiserslautern, Germany

© Springer International Publishing AG 2017

G. Meixner and C. Müller (eds.), Automotive User Interfaces,

Human–Computer Interaction Series, DOI 10.1007/978-3-319-49448-7_1

3

vehicle systems. Current trends in the area of in-car infotainment applications

include, for instance, Internet-based applications or social network applications,

whereas extendable, hybrid, adaptive, or even personalized HMI are emerging as

future trends. Not only technologies have evolved throughout history, the devel￾opment processes themselves have also been adapted continuously due to the

challenges the automotive industry had to face with new technologies. Thus, the

authors have summarized their experiences, their knowledge, and the results of

literature studies in this article which covers the history of automotive HMI

development from the past in 1922 to the present with an outlook on upcoming

trends for future automotive user interfaces.

Whoever wishes to foresee the future must consult the past—Machiavelli

1.1 Introduction

The development of Human Machine Interfaces (HMI) is a complex, interdisci￾plinary challenge (Bader and Fallast 2012). Besides the technical aspects, the

development is also challenged by the need to adhere to cognitive principles

manifested in the need to choose interaction patterns that fit the mental model of the

user. For example, the efficient usage of electric windows by pressing a flip switch

is possible if the window is lowered when the bottom of the flip switch is pressed.

The other way around would not be intuitive. The technical realization is respon￾sible for the adequate implementation of the concept. The simplicity of developing

automotive HMIs, as in the example above, was common many decades ago.

Comparing present and future developments, the main differences to past devel￾opments are the aspects of information processing and entertainment. Hence, this

article focuses primarily on the HMI of automotive infotainment systems using the

representative term “automotive HMI” or simply “HMI.”

The types and the complexity of automotive HMIs have rapidly changed in the

last decades proportional to the development of computer systems: from

M. Poguntke

Advanced User Experience Engineering, Mercedes-Benz Research and Development

North America, Inc., 309 North Pastoria Ave, Sunnyvale, CA 94085, USA

N. Walter

Advanced Development Car Multimedia, Robert Bosch GmbH, Daimlerstrasse 6,

71226 Leonberg, Germany

R. Zhang

Diesel Gasoline Systems (DGS-EC/ECD2), Robert Bosch GmbH, Wernerstrasse 51,

70469 Stuttgart, Germany

4 G. Meixner et al.

rudimentary command line interfaces to a wide variety of graphical user interfaces,

speech dialog systems, and gesture-based systems like touch interfaces.

The first automotive HMIs were primarily mechanical. Their main purpose and

implemented functionalities aimed at providing the driver with relevant information

about the car or about driving, such as speed, gas level, or rev counter. Later on,

displaying only this information was not sufficient anymore. The drivers also

wanted to be entertained while driving.

Therefore, entertainment functions like radios were progressively integrated into

the car, leading to an increase in automotive HMI complexity. The HMI as well as

the different functions together became an infotainment system, i.e., a system that

combines the provision of information with entertainment functionalities (Bosshart

and Hellmueller 2009).

In Fig. 1.1, an example of an early infotainment system is depicted. The picture

shows the car dashboard of a Ford Taunus in 1958. Moreover, the type of infor￾mation provided to the driver has also evolved and been enhanced over time.

Besides status information about the car, information about the traffic or navigation

has been integrated as well. Today, standard functionalities of HMIs encompass the

display of vehicle-related information, advanced driver assistance functionalities,

and entertainment components like radio, media player, etc. An example of today’s

developments is shown in Fig. 1.2. It illustrates the driver’s view in a cockpit of the

Ford S-Max, which was initially delivered in 2016.

Fig. 1.1 FORD Taunus 17M P2 (TL) deluxe two door 1958 steering wheel (Wikimedia

Commons; User: Yeti.bigfoot 2009)

1 Retrospective and Future Automotive Infotainment … 5

Due to the increased complexity of the HMI, which consists of a variety of

different input and output interfaces, its usability has become a very important

quality factor (Ariza et al. 2009). Modern HMIs consist of a graphical user interface

and a control unit as well as speech dialog systems and gesture-based systems like

touch interfaces. The application of up-to-date hardware and software components

enables a steadily rising number of use cases.

Modern automobiles provide complex functionalities and can be connected to

different mobile devices. The complexity in functionality has a direct impact on the

complexity of the HMIs because the driver has to manage the provided functions.

The established HMIs of the past have to be improved and adapted to those

requirements to make them more modern and innovative and to reduce the com￾plexity. Therefore, designs from everyday interfaces of the users could be taken as

role model for the HMI in the automotive field. For example, users know the

graphical user interface of their smartphones and are used to their utilization.

Electrical interfaces have emerged and evolved rapidly and are continually

replacing their mechanical counterparts due to many advantages. For instance, the

replacement of mechanical mirrors with cameras allows expanding the field of

vision and eliminates blind angles. The range of expectations is also widening, i.e.,

simple driving support versus high-quality entertainment. This variety of func￾tionalities is always a competitive attribute for automobile manufacturers but this

requires also an optimal handling of a large number of different user qualifications.

A big challenge is for example to design infotainment systems in a way that also

people with minor technical background can easily use them. In this domain, the

ability of configuration with respect to target groups and individuals is also an

important issue when it comes to increasing usability.

Fig. 1.2 Ford S-Max 2015 Interior (Wikimedia Commons; User: Ranger 1 2016)

6 G. Meixner et al.