top of page

EVO

YOUR FRIENDLY AUTONOMOUS VEHICLE

This project explores Multimodal Interactions in the coming future of Autonomous Vehicles (AVs). 

It was a collaboration of WIPRO and NID where we explored futuristic use cases. In this particular case study we focused on how the AVs are interacting with Pedestrians and Non AVs.

FUTURISTIC DESIGN

AUTONOMOUS VEHICLE

ACADEMIC

MULTIMODAL INTERACTIONS

GROUP PROJECT

4 WEEKS - 2021

Screenshot 2021-12-21 at 1.32.27 AM.png
wipro-primary-logo-color-rbg.png
1280px-National_Institute_of_Design_logo.svg.png
Screenshot 2021-12-21 at 12.01.35 PM.png
EVO

WHY?

Screenshot 2021-12-25 at 12.08.51 PM.png

People make eye contact with the driver before crossing the road.

 

How will an AV respond in this situation?

When a person is allowed to pass, an affirmative nod makes a positive bond.

 

How does an AV respond to a gesture?

Two drivers communicate with each other through gestures, voice, gaze, expression.
 

How does a human driver communicate with an AV?

Normally cars are parked at peace without any interactions.

How can the enhanced capabilities of AV make it more delightful while it’s parked?

Screenshot 2021-12-21 at 12.01.35 PM.png

WHat is multiMODAL INTERACTION?

Multimodal design utilizes multiple modalities to improve the user experience in products and services. This includes computer-to-human and human-to-computer interactions such as voice, text, touch, and taptic feedback.

 

“Designing multimodal experiences is an interdisciplinary effort.”

INTERACT (INPUT)

PERCEIVE (OUTPUT)

Screenshot 2021-12-26 at 9.35.04 PM.png
Screenshot 2021-12-21 at 12.01.35 PM.png

The future of mobility is progressing and different vehicle communication technologies are emerging. These are the seven types of Vehicle Communication Systems that can be seen in foreseen future.

Vehicle to Network (V2N)

Screenshot 2021-12-25 at 12.49.30 PM.png

The V2N communications enables autonomous vehicles to use cellular networks to communicate with the system.

04

Vehicle to Cloud (V2C)

Screenshot 2021-12-25 at 12.49.30 PM.png

V2C communication leverages V2N access to broadband cellular mobile networks to offer data exchange with the cloud.

07

Vehicle to Grid (V2G)

V2G provides bidirectional data between plug-in hybrid vehicles, battery electric vehicles, etc with the smart grid in support of electrification of transport. 

Screenshot 2021-12-25 at 12.49.30 PM.png

02

Screenshot 2021-12-25 at 12.49.30 PM.png

Vehicle to Infrastructure (V2I)

V2I consists of bidirectional exchange of info between the vehicle & the road infrastructure like cameras, lights, speed limits, accidents, etc.

05

Screenshot 2021-12-25 at 12.49.30 PM.png

Vehicle to Pedestrian (V2P)

In V2P, vehicles behave differently near wheelchairs, bicycles, pedestrians & children playing to create awareness about its presence.

03

Screenshot 2021-12-25 at 12.49.30 PM.png

Vehicle to Vehicle (V2V)

In V2V, vehicles can share their speed, location as well as any other relevant info, giving a 360-degree representation of its surroundings with other vehicles. 

06

Screenshot 2021-12-25 at 12.49.30 PM.png

Vehicle to Device (V2D)​

V2D allow vehicles to exchange information with any smart devices around them usually via Bluetooth protocol.

Screenshot 2021-12-21 at 12.01.35 PM.png

A few questions that popped in our heads were :

  • How will AVs communicate with the pedestrians?

  • How will the pedestrians react to an AV in the street?

  • How can we make the experience seamless?

Screenshot 2021-12-21 at 7.40.51 PM.png

Vehicle to Pedestrians (V2P).

Screenshot 2021-12-21 at 12.01.35 PM.png

SECONDARY RESEARCH

Source : Research article: Pedestrian Trust in Automated Vehicles: Role of Traffic Signal and AV Driving Behavior

Conducted with 30 participants

RESEARCH PAPER ONE

This study manipulated 2 factors that affected the pedestrians :

AV Driving Behaviour​​

Screenshot 2021-12-24 at 5.16.43 PM.png
Screenshot 2021-12-24 at 5.16.43 PM.png
Screenshot 2021-12-24 at 5.16.43 PM.png

Defensive (Gap acceptance >7s)

Normal (Gap acceptance 3-7s)

Aggressive (Gap acceptance <3s)

Crosswalk Type

Screenshot 2021-12-24 at 5.16.43 PM.png

Signalised Crossings

Screenshot 2021-12-24 at 5.16.43 PM.png

Unsignalised Crossings

INSIGHTS

Pedestrian behaviour recorded in this research were :

"Non verbal communication is important for trust." Based on pedestrians and human driven vehicles through eye contact, facial expressions and hand gestures primarily.

"AVs driving behaviour is a form of implicit communication." Whether it slows down or accelerates when a pedestrian shows a hand, etc.

Screenshot 2021-12-21 at 12.01.35 PM.png

Source : Communicating Awareness and Intent in Autonomous Vehicle-Pedestrian Interaction.

DOI: https://doi.org/10.1145/3173574.3174003

RESEARCH PAPER TWO

Modes of communicating with pedestrians :

Screenshot 2021-12-21 at 7.40.51 PM.png

Vehicle

Light

Visuals

Sounds

Screenshot 2021-12-21 at 7.40.51 PM.png

Vehicle and Street

Light

Visuals

Sounds

Screenshot 2021-12-21 at 7.40.51 PM.png

Vehicle and Pedestrians

Light

Visuals

Sounds

Haptics

When talked to the participants about these modes of communication, the participants assumed that these modes would be implemented in these ways :

Visuals

Screenshot 2021-12-24 at 10.19.53 PM.png

Display with signs/symbols

They cued towards display with road signs and symbols.

Screenshot 2021-12-24 at 10.19.53 PM.png

Display with text

They also felt that relevant text would be apt for a display

LED strip on car

Led strips as display was one more choice as it would implement colours

Screenshot 2021-12-24 at 10.19.53 PM.png
Screenshot 2021-12-24 at 10.19.53 PM.png

Embodiment of human face/eyes

Humanizing the AV with face and eyes, therefore emotions.

Audio

Screenshot 2021-12-24 at 10.19.53 PM.png

Car Sounds

When talked about audio the participants felt car sound would be apt

Screenshot 2021-12-24 at 10.19.53 PM.png

Nonverbal sounds

They also felt that the sound should be non verbal and not confusing.

Physical

Screenshot 2021-12-24 at 10.19.53 PM.png

Car lowering/rising

They felt a car can physically move low and rise up to explain

Screenshot 2021-12-24 at 10.19.53 PM.png

Actual hand

An actual hand with gestures and symbol was amongst the preferred.

Screenshot 2021-12-24 at 10.19.53 PM.png

Movement/motion of car

Movement of car could also be a physical cue for pedestrians

INSIGHTS

Participants behaviour recorded in this research were :

 

  • Participants preferred to receive explicit information about the vehicle’s awareness and intent.

  • Moreover, participants preferred specific cues rather than too many of them for certain scenarios. 

  • A large number of cues negatively impacts a person's ability to make a decision.

Screenshot 2021-12-21 at 12.01.35 PM.png
Research

To start designing something, it is very important to set the context. These are the assumptions we took for the project, the design is relevant for :

  • Unsignalised crossings

  • Anyone can interact with an AV.

  • Independent of special purpose devices.

  • Looking at AV as public transport.

  • Interactions with pedestrians are very short (<3 seconds)

Screenshot 2021-12-21 at 12.01.35 PM.png

POSSIBLE INPUTS AND OUTPUTS

While an AV might have made all the calculations to navigate a situation perfectly, how will the people outside know that it has done so and can be trusted?

 

“The idea is to communicate what AV is thinking. Effectively."

POSSIBLE INPUT MODALITIES

Screenshot 2021-12-25 at 2.08.01 PM.png

POSSIBLE OUTPUT MODALITIES

Screenshot 2021-12-25 at 2.08.01 PM.png
Screenshot 2021-12-21 at 12.01.35 PM.png

The aim was building trust between AV and the pedestrians. After the hours of research and discussions we came to these factors that influences the pedestrian's behaviour
 

  • Trust builds over a period of time.

  • Small things matter.

  • Word of mouth matters.

Screenshot 2021-12-21 at 12.01.35 PM.png

POSSIBLE COMMUNICATION WITH AV

There can we two ways of communication with AV, one is IMPLICIT, where the AV slowing down to communicate intent, and the other is EXPLICIT, where the communication happens with Visual, Auditory and Physical modalities. We proceeded with Explicit Communications an made scenarios based on the same.

Screenshot 2021-12-25 at 3.04.52 PM.png
Screenshot 2021-12-21 at 12.01.35 PM.png

MOODBOARD

Before designing the Av we came up with a mood board where possible multimodal interactions can be implemented.

Screenshot 2021-12-21 at 12.01.35 PM.png
Screenshot 2021-12-25 at 3.19.39 PM.png
Design

While designing the car, we used a minimal design approach. We felt that the lives for humans in general are very complicated, therefore we tried to keep this design as simple as possible. We were more focused towards the modalities that would be used for AV interacting with the pedestrians.

These are some places where modalities will be visible in the AV :

The front panel of the car can be used to communicate with the pedestrian on the road. They can be greeted, indicated with sign/symbols.

IMG_014ccx1 5.png
IMG_014ccx1 5.png

The panels on the lower front and on the wheels can be used to project information on to the road for pedestrians.

IMG_014ccx1 5.png

The side panels of the AV has huge space, this can also be used for text or visual messages meant for the pedestrians on the street.

IMG_014ccx1 5.png

The back panels can be used to display information for pedestrians on the back or any other non AV vehicles.

Screenshot 2021-12-21 at 12.01.35 PM.png

IDEATION

Source : The effect of ad smiles on consumer attitudes and intentions: influence of model gender and consumer gender

https://bradscholars.brad.ac.uk/bitstream/handle/10454/16876/Trivedi_JoBR.pdf;jsessionid=278B5D0B4866605227E1A786656387D0?sequence=1

RESEARCH ARTICLE ONE

This study aimed to disentangle the effects of a smiling model in triggering different marketing objectives through the five steps of consumer response :

  • Awareness

  • Comprehension

  • Attitude change

  • Conviction and

  • Action

Screenshot 2021-12-27 at 1.57.53 AM.png

INSIGHTS

Participants behaviour recorded in this research were :

 

  • Smiling faces are recognised rapidly and are more closely linked to the feeling of joy than other facial expressions

  • A smiling model positively influences all five stages of consumers’ attitude and intention formation

  • A smile also positively influences interpersonal judgements.

  • Smiles can be perceived in multiple ways, like more competent and honest, friendlier and warmer, happier, more sociable, more attractive, trustworthy and communal, less dominant, calm and more optimistic.

Screenshot 2021-12-21 at 12.01.35 PM.png

RESEARCH ARTICLE TWO

Screenshot 2021-12-27 at 2.02.19 AM.png
Screenshot 2021-12-27 at 2.23.43 AM.png

Road signs are integral to keeping drivers alive. A traffic sign could mean the difference between a driver making that life-saving stop or possibly running into oncoming cars. These signs are created with the human psyche in mind. Some key components are :

Color
Studies have shown that colors can instill emotional responses in our brain, even if we don’t think about it. Our brains are wired to perceive the color red as an alert to a possibly hazardous situation. 

Shape
Signs with sharper points, such as a triangular-shaped sign or the octagon stop sign are usually associated with danger, whereas rectangular signs tend to convey standard information, like speed limits and directions. 

Shorthand Text
It’s important for signs to say what needs to be said in a short amount of time. Drivers should be able to drive by a sign having full comprehension of its message, whether they’re being told to slow down, look out for pedestrians, stop, or yield.

Images

Signs showing images of stick figures or animals (such as a deer crossing sign) can stay imprinted in drivers’ minds more than mere text.

Screenshot 2021-12-21 at 12.01.35 PM.png

MODALITIES EXPLORED

Once we decided the types of modalities we would be pursuing we started implementing the modalities in accordance to the various scenarios.

The modalities we explored were VISUAL, AUDIO and PHYSICAL ( MOVEMENT ).

Screenshot 2021-12-21 at 12.01.35 PM.png

COLOURS

Colour as a modality plays a very important role. 

Pedestrians will remember something positive that catches their eye.

Screenshot 2021-12-26 at 2.11.45 AM.png

Using bright colours to create a positive memory for people whenever they see the AV.

Screenshot 2021-12-21 at 12.01.35 PM.png

SCENARIO A : PEDESTRIANS ON THE ROAD SIDE WITH NO INTENT TO CROSS

Screenshot 2021-12-26 at 12.31.11 PM.png

VISUAL

Smile light changes from white to blue to indicate that the AV has detected the people.

AUDIO

To indicate state change.

DISPLAY

"Hi! Have a good day" a greeting message to personalise an interaction. 

Screenshot 2021-12-21 at 12.01.35 PM.png

SCENARIO B : PEDESTRIANS ON THE ROAD SIDE WITH AN INTENT TO CROSS

Screenshot 2021-12-26 at 1.21.40 PM.png

BEFORE CROSSING

VISUAL

Smile light changes from white to green to indicate that the people can safely cross.

AUDIO

To indicate state change.

MOVEMENT

AV slows down to indicate allowing passage.

DISPLAY

Animation on screen indicating right to passage.

AFTER CROSSING

VISUAL

Smile light changes back to white.

AUDIO

To indicate state change.

MOVEMENT

AV slowly picks up speed.

When the crossing happens in group, the pedestrians tend to follow the person on the front, so the interactions with AV will be similar to this.

Screenshot 2021-12-21 at 12.01.35 PM.png

SCENARIO C : PEDESTRIANS ON THE ROAD SUDDENLY DECIDES TO CROSS & JUMPS IN FRONT OF AV

Screenshot 2021-12-26 at 3.29.19 PM.png

BEFORE CROSSING

VISUAL

Smile light changes from white to red, indicating AV detects people. Indicates warning.

AUDIO

 Loud beeps to signify warning.

MOVEMENT

AV aggressively slows down to indicate allowing passage with a warning.

DISPLAY

Animation on screen indicating right to passage.

AFTER CROSSING

VISUAL

Smile light changes back to white.

AUDIO

 Loud beeps to signify warning.

MOVEMENT

AV slowly picks up speed.

Screenshot 2021-12-21 at 12.01.35 PM.png

SCENARIO D : A CYCLIST TRYING TO CROSS A ROAD WHEN A NON AV IS COMING ALONG WITH AV

Screenshot 2021-12-26 at 5.09.16 PM.png

BEFORE CROSSING

VISUAL

Smile light changes from white to green to indicate that safe crossing for the cyclist.

AUDIO

To indicate state change.

MOVEMENT

AV slows down to indicate allowing passage.

DISPLAY

Projection on the street to inform the non AV vehicle.

AFTER CROSSING

VISUAL

Smile light changes back to white.

AUDIO

To indicate state change.

MOVEMENT

AV slowly picks up speed.

Screenshot 2021-12-21 at 12.01.35 PM.png

SCENARIO E : BLIND SPOT WARNING GIVEN TO PEDESTRIANS BY PARKED AV

Screenshot 2021-12-26 at 5.09.07 PM.png

VISUAL

Smile light changes from white to yellow, indicating the incoming non AV to slow down

AUDIO

 Loud beeps to signify warning.

DISPLAY

Animation on screen indicating a car is coming, projection on street to inform the pedestrian

Screenshot 2021-12-21 at 12.01.35 PM.png

SCENARIO F : INFORMATION FOR A NON AV THAT IS FOLLOWING THE AV ON THE ROAD

Screenshot 2021-12-26 at 5.09.26 PM.png

AUDIO

Only when necessary

DISPLAY

Animation on back panels indicating the situation in the front of the road

Screenshot 2021-12-21 at 12.01.35 PM.png
Scenarios

KEY LEARNINGS

  • This project gave us an opportunity to stretch our imaginations into a new, boundary-pushing design and prototype for the future.

  • It helped us consider our preferences over a set of possible futures and the ways in which the objects we design help or hinder our attempts to build those futures.

  • It made us look at how existing design and experiences can be used for making the user experiences easier.

FUTURE SCOPE

Impromptu gestures 

 

A pedestrian can respond to an AV as they would to a human driver. It can be a simple “Thank You” for allowing someone to cross first. Still exploring ways for AV to respond to such cases.

 

Modalities: 

Visual, Auditory, Physical

The group members of this project are :​

Screenshot 2022-01-18 at 8.31.36 PM.png

DEEKSHA

Interaction Design'20.

Screenshot 2022-01-18 at 8.31.21 PM.png

KARTIKEYA GUPTA

Interaction Design'20.

Screenshot 2022-01-18 at 8.31.08 PM.png

PARTHA PARTIM DEY

Interaction Design'20.

SOME OTHER PROJECTS

bottom of page