Simulation of AEB System Testing: Czech Technical University in Prague Faculty of Mechanical Engineering
Simulation of AEB System Testing: Czech Technical University in Prague Faculty of Mechanical Engineering
I hereby declare that this thesis is my own work and that, to the best of my
knowledge and belief, it contains no material which has been accepted or
submitted for the award of any other degree or diploma. I also declare that all the
software used to solve this thesis is legal.
I also declare that, to the best of my knowledge and belief, this thesis contains
no material previously published or written by any other person except where due
reference is made in the text of the thesis.
........................... ........................................
date Bc. Patrik Zíta
Acknowledgment
I would like to thank my supervisor Ing. Václav Jirovský, Ph.D. for his guidance
and support throughout this thesis. I would like also to thank TÜV SÜD Czech s.r.o.
for support and experience which I got during five months’ internship. Lastly, I
would like to thank my whole family for their support and help during a difficult
period of last months.
Abstract: This master thesis describes a simulation tool which was created
to analyze ADAS functions and vehicle dynamics. The tool was
created in CarMaker and Microsoft Excel. The software can be
used as SIL testing to analyze sensor output data before proving
ground test.
Abbreviations ...................................................................................... 11
Introduction ........................................................................................ 12
2. Software.......................................................................................... 32
7
3.2. Maneuver description .....................................................................................40
3.3. Vehicle description ..........................................................................................41
3.4. Description of driving scenarios ....................................................................46
3.5. Parametrization of driving scenarios ............................................................51
3.6. Evaluation of driving scenarios .....................................................................59
3.7. GPS coordinates as results of simulations ...................................................72
4. Conclusion ...................................................................................... 73
4.1. Contributions....................................................................................................73
4.2. Assignment .......................................................................................................73
4.3. Future work ......................................................................................................73
CD content .......................................................................................... 77
8
List of Figures
10
Abbreviations
11
Introduction
12
Chapter 1
13
1.2. Systems and its principles
Many companies across the world are developing ADAS systems in the
automotive industry. The main players are Bosch Group, Delphi Automotive
Company, Valeo SA, Continental AG, Panasonic Corporation, TRW Automotive,
Denso Corporation etc. [3]. Those companies are developing similar systems, but
sometimes with different names.
In general, the ADAS systems can be divided into several various categories:
lateral control, longitudinal control & avoidance, parking aids and so on [36].
15
Figure 1.2 - AEB functionality [22]
The blind spot is a space where the driver is unable to see. In urban traffic,
critical situations may arise if vehicles in the so called blind spots are overlooked.
Blind spots can be either on the side or behind the vehicle and through a camera
integrated into the lateral rear window, the blind spot detection system provides
the driver with information on whether there are any vehicles, cyclists or
pedestrians in the area not visible to him.
These spots are dangerous because pedestrians or even vehicles can be
missed. The blind spot is also defined by ISO 17387:2008. This norm describes
Lane Change Decision Aid Systems (LCDAS) — Performance requirements and
test procedures and the location and size of the spots.
BSD systems use a combination of sensors/cameras to recognize objects and
provide information about an object to the driver. This information is often
provided through an orange lamp in the mirror and is generated depending on
the difference in speed between the driver’s own vehicle and others but some
automotive companies also prefer vibration of the steering wheel or a
combination of these with sound.
The latest versions of BSD systems can recognize the difference between large
or small objects and warn the driver that a car, pedestrian or motorcycle is in a
blind spot [4] [10]. Figure 1.3 shows an example of warning on the right side of
the figure and monitoring area on the left side.
16
Figure 1.3 - Blind spot detection [41][42]
17
1.2.5. Lane Departure Warning, Lane Keeping
Assistant
18
Figure 1.6 - Lane Keeping Assistant
19
Figure 1.7 - Traffic sign recognition [2]
20
1.3. Vehicle sensors [6]
Current vehicles are equipped with many sensors for different purposes. ADAS
systems need sensors to provide all necessary data from surroundings. These can
monitor driver, car, and environment. Figure 1.8 shows typical sensors used in a
modern vehicle.
RaDAR sensors usually work on frequencies 24 or 76-81 GHz. The 24GHz systems
are being used for short- and mid-range smart-driving features such as blind-spot
detection and collision avoidance in a wider area. Ranges of those sensors are around
50 – 60 m with a beam angle of 90 degrees. The 24GHz frequency band has a few
limitations. These include the potential for interference with radio astronomy and
satellite services and, as a result, these RaDARs will be phased out of new vehicles by
2022 in Europe [24]. Types of RaDARs are shown in figure 1.10.
RaDARs with frequencies around 77 GHz are used to detect obstacles in a long
range around 100 - 200 m and a beam angle of 15 - 20 degrees as it is shown in figure
1.9. The technical advantages of the 77GHz band include that the higher frequency
pairs effectively with a smaller antenna. The relationship between the antenna size
and the frequency is linear, so 77GHz systems will need antenna sizes a third of the
size of the current 24 GHz ones. The most important thing is that the wider bandwidth
available in the 77 GHz band enables greater accuracy and, as a result, provide drivers
with better object resolution [32].
21
Figure 1.9 - RaDAR sensors application [23]
All automotive RaDARs are Doppler type [37]. The signal from the RaDAR is
transmitted and received continuously and modulated to recognize stationary
obstacles. RaDAR sensors for ACC or AEB usually contain two transmitters and four
receivers or one transmitter and two receivers as a cheaper option which is used for
detection of rear vehicles [11].
LiDAR is a RaDAR which uses ultraviolet or near infrared light to image objects.
Typical automotive LiDARs have wavelengths around 850 or 900 nm. Usually, they
are pulsed with power around tens of milliwatts with peak power of pulse up to 80
W. The range of common LiDARs is from 10 to 20 m and they are used to detect
obstacles in low speed during urban driving. LiDARs were first applied as sensors
for ACC because they were smaller. Nowadays they are often replaced by RaDARs
or cameras due to excessive cost and low-resolution capabilities [6], [18]. Typical
LiDAR is shown in figure 1.11.
23
Figure 1.12 - Stereo Camera [19]
They are sensors with short and middle range. The principle is that they shoot
infra-red spectrum of light (740 - 870 nm) from reflected object in the range of
sensors and measure duration of light beam flight. It is very like LiDARs but
PMD sensors use CCD or CMOS to shoot a whole picture. The advantage of those
sensors is a detection of the scene in 3D directly and a precise image compares to
stereoscopic cameras. These sensors are used by Lexus in their luxurious models.
Ultrasonic sensors are used for low speed, especially for parking and
maneuvering like in figure 1.13. The range of such sensors is from 3 to 10 m and
their precision is around 5 cm. Sensors units which are also transmitters and
receivers send cone signal 40 times per second with frequency from 30 to 40 kHz
and beam angle 30 - 45 degrees. Although ultrasonic sensors are mainly used for
parking, some car manufacturers manage to extend their usage by integrating
them into safety systems. The problems are that wide signal cone is difficult to
direct and it leads to the discrediting of the result, so it is not feasible to create a
correct analysis of the surrounding in brief time. One of the application is blind
spot detection to recognize other cars around the vehicle.
24
Figure 1.13 - Ultrasonic sensor for parking [20]
Camera, LiDAR or RaDAR, just each system which acquires images, must be
able to acquire and analyze this image correctly. For those analyses, there are
used two methods which can be used simultaneously.
The first method is known as pattern recognition which means that it is based
on recognition of known shapes or patterns, these patterns are saved in the
database.
The second method works on the principle of comparing two or more
consecutive images and finding changes of points and for these points determine
their positions and direction of movement.
The first method does evaluate object which is not in a library as unknown,
the second one does not have to know any object and it evaluates only the
possibility of occurrence of moving points in a trajectory of the car, so it can detect
some points as dangerous but, it would be only some inappropriate group of
points which are not dangerous. Static objects are analyzed as objects with speed
of the car and can be also detected by this method.
These sensors often cooperate or use data from other basic sensors inside
vehicles to ensure safety and proper run. Nowadays a lot of effort is put into
Vehicle2Vehicle (V2V), Vehicle2Infrastructure(V2I) or generally
Vehicle2Everything (V2X) communication.
25
1.4. Sensor physics modeling
The degree of automation in the car in the form of advanced driver assistance
systems is steadily on the rise. This means the development of more complex
systems and requirements for quick feedback on viability and robustness [25]. A
significant help with these problematics can be provided by a virtual
environment. Virtualization alleviates the dependency on hardware availability
and provides a controlled environment with reproducible conditions. To fulfill
this role, a sensor model must generate the sensor data that constitutes the input
of the function algorithms in such a way as to be virtually indistinguishable from
a comparable real-world scenario.
In a real environment, sensor maps its targets (e.g. other cars, static obstacles)
onto a digital representation. Then compare it with object list (pattern
recognition) or comparing two or more consecutive images and finding changes
of points. The sensing process consists of two subsequent steps: measurement
and processing. Measurement is the detection of sensor targets by means of an
electromagnetic (RaDAR, LiDAR, camera) or acoustic (ultrasound) interaction.
From the resulting raw data, a signal processing unit extracts objects and object
properties. An example is in Figure 1.14 – (a).
26
In a virtual environment, the input consists of virtual objects provided by a
simulation framework. Direct mapping encompassing both the measurement
and processing steps is usually achieved by means of a stochastic model – Figure
1.14 – (b).
An independent treatment of effects occurring during the two steps comes at
the cost of increased complexity and requires a raw data interface – Figure 1.14 –
(c).
This opens the possibility of a hardware-in-the-loop setup with the electronic
control unit (ECU) of the sensor stimulated by simulated raw data – Figure 1.14
– (d).
27
Reasons for advanced sensor models for ADAS simulation:
• Access simulated data at any level of the processing chain for multiple
usages
o Raw sensor data
o Tracks/Objects data after signal processing
o Fused objects data
• Consider effects of the sensor technology
o Signal losses
o Detection noises
o Sensitivity
o Resolution
• Consider environment and targets interaction
o Material properties
o Multi-reflections
o Weather conditions
• Allow multi-sensor configuration
o Interferences
o Sensor fusion
Typical example of sensor output for AEB scenario is in the figure 1.15. In the
part 1 vehicle is constantly decelerating with a = - 4 m/s2 for t = 2.6 s. In the part
2 significant acceleration peak occurs with top value a = 8,9 m/s2 for t = 0.6 s.
This acceleration is caused by sensor blindness. For limited amount of time
sensor cannot see obstacle in front due to the pitch during braking. In part 3 full
brakes are applied, because sensor can see the obstacle again.
28
1 2 3
Figure 1.15 - AEB braking and graph representing acceleration and pitch [27]
29
1.4.1. Sensor modeling complexity
Each virtual simulation software has its own library of the sensor with
different level of realism. This mostly depends on the application of sensor and
on requirements. Figure 1.16 shows an example of sensors used in CarMaker and
how detailly modeled they are [30].
Ideal sensors are for rapid prototyping, proof of concept or verification. High
Fidelity (HiFi) Sensors for general function development and testing sensors are
more complex. Raw Signal Interfaces are for component/signal processing
development and testing. With increasing realism computational costs and
parametrization effort are increasing rapidly.
30
The propagation of electromagnetic waves is usually handled through ray
tracing or other SBR techniques (Shooting and Bouncing Rays). Instead of using
an ideal (isotropic) radiating source, the propagation of electromagnetic waves is
weighted according to the direction being considered using the antenna
directivity. This chaining is quite loose but allows reaching quite easily a much
more realistic modeling of the sensor performance. The electromagnetic radiation
can be assumed in free space or with the RaDAR sensor located behind the plastic
bumper and interacting with near-by metallic parts or metallized paint coatings.
31
Chapter 2
2. Software
Within this diploma thesis is mainly used software CarMaker by company IPG
Automotive. CarMaker is real-time simulation software for virtual testing of
automobiles and light-duty vehicles. Using this software, we can accurately model
real-world test scenarios, including the entire surrounding environment, in the
virtual world. CarMaker is an open integration and test platform and can be applied
throughout the entire development process – from the model- to software- to
hardware- to vehicle-in-the-loop.
32
2.1. CarMaker
CarMaker includes a complete model environment comprising an intelligent
driver model, a detailed vehicle model and highly flexible models for roads and
traffic. With the aid of this model environment, one can build complete and
realistic test scenarios with ease, taking the test run off the road and directly to
the computer. The event and maneuver-based testing method ensure that the
necessary flexibility and realistic execution of real-world test driving are also
features of virtual test driving.
A TestRun is a test scenario which collects all the information required to
parameterize the virtual vehicle environment and to start a simulation.
Depending on the complexity of the simulated test case, the TestRun composes
of a different number of modules. As a minimum requirement to be able to
simulate, the following modules must be parameterized within the TestRun:
33
Additionally, the following modules can be defined in the TestRun,
depending on the field of application:
• Trailer: To simulate a test car with trailer configuration.
• Tires: Overwrite the default tire data set referred to the vehicle model.
• Traffic: Add other static or moving traffic objects.
• Environment: Configuration of the test environment with date, time and
ambient conditions.
In figure 2.3 is shown a list of available sensors. The majority of them are for
ADAS application, so we can test almost any setup of nowadays vehicles. This
approach can be used also for rest of car parts such as suspensions, steering,
powertrain etc.
A similar setup is in road definition like in figure 2.4. We can create any kind
of road including bridges, crossroads, traffic lights, sign and so on.
34
Figure 2.4 - CarMaker - road setup
Export
35
2.3. Research of other automotive simulation tools
36
2.3.2. CarSim
37
Chapter 3
38
Figure 3.2 – Test track Hradčany u Mimoně in CarMaker
39
Figure 3.3 - Google Earth view from CarMaker
40
Figure 3.4 - Maneuver dialog
• DemoCar VW Beetle
• Demo BMW 5-series
Volkswagen Beetle has setup for AEB testing and BMW 5-series for ACC
testing. Vehicle data set has many possibilities of tuning of the vehicle starting
with body, engine, suspension, steering, tires, brakes, powertrain, aerodynamics
and sensors along with vehicle control. Last two are most important for our
applications.
41
• Autonomous emergency braking (AEB)
The Autonomous Emergency Braking system has the task to decelerate
safely the vehicle to the velocity of the target object ahead. For this, the
system compares the time-to-collision ttc with a time-threshold-brake ttb to
decide if a braking intervention is required.
42
Figure 3.6 - VW Beetle vehicle control
BMW 5-series uses Acceleration control + ACC for controlling the vehicle. ACC
controls the longitudinal acceleration of the vehicle by changing the position of the
brake and gas pedal. If ACC is deactivated there is no manipulation of the pedal
position by the controller – figure 3.7. The controller distinguishes two cases:
• If there is no target detected, the velocity will be controlled.
• If there is a relevant target detected, the distance will be controlled.
44
Figure 3.9 - BMW 5-series vehicle control
45
3.4. Description of driving scenarios
Every driving scenario has been simulated individually. A detailed
description of each is below. All these scenarios are based on dissertation [11]
from my supervisor.
This test run is focused on the analysis of the behavior of the automatic
emergency brake system and the adaptive cruise control reaction. Reactions of
the eGo vehicle being tested always behind the target vehicle – case B. Distance
of about 15 m behind the target vehicle is maintained and no automatic braking
response is expected.
In the Adaptive Cruise Control, however, the reaction to the newly
discovered obstacle is desirable - the test vehicle should start to brake. The cruise
speed is set at 5 km/h higher than the speed of the target vehicle and its distance
from the adaptive cruise control system is set to the shortest possible. These tests
are marked T02 - CTU 02/2013 B for the Integrated Safety System Test and T02 -
CTU 02/2013 C for Adaptive Cruise Control.
46
3.4.2. T05 - CTU 02/2013 E - Adaptive cruise control
adaptation
The test is focused on adaptive cruise control adaptation when driving multiple
vehicles with this system in a row. For all vehicles, the speed at the beginning is set
to 70 km/h, then the first vehicle will slow down to 50 km/h and the response of
other cars is monitored. After stabilization of the speed, the first vehicle accelerates
in the same way to 70 km/h and the response of other vehicles is re-analysed. All
vehicles in the row traveling behind the first vehicle, have a cruise control always
set to a speed of 10 km/h higher than the vehicle ahead. This test is labeled as T05 -
CTU 02/2013 E.
The test is focused on the analysis of the behavior of the ADAS system in the
context of other traffic. The behavior of the interactive technology interface of the
autonomous system and other vehicles is evaluated. The eGo vehicle maintains a
constant speed of 80 km/h through adaptive cruise control which is set at a
maximum distance from the vehicle in front. Outside the axis of the eGo vehicle,
the target vehicle moves at the same constant speed. After the distance between
vehicles is between 15 and 20 m, the eGo vehicle moves to the target lane. Vehicle
and the alignment of the distance are monitored to match the set distance. This
should be smooth without using the car's brakes. The test is designated as T06 -
CTU 02/2013 F.
47
3.4.4. T07 - CTU 02/2013 G - Consistency of system
behavior
The purpose of the test is to verify the behavior of the automatic emergency
brake system according to the manufacturer's specification. The tested vehicle
again moves outside the obstacle axis with a speed of 20 km/h, maintained by the
driver, and approximately 100 m before the obstacle enters its axis. The
manufacturer's prescribed reaction response is expected, for example, automatic
braking before the obstacle, while the driver does not change the driving speed.
The first standardized test is part of European Union Regulation No. 347/2012,
prescribing the characteristics of the automatic braking system for trucks and
buses. The test verifies whether the detection system can recognize the space
between two side-by-side standing vehicles whose rear parts are aligned in one
plane.
48
The prescription defines the passage without the adaptive cruise control only
for automatic braking systems. For greater clarity and the possibility of merging
similar tests, the adaptive cruise control is on and set to maintain the 50km/h with
maximum distance.
The test is one of the tests defined by ISO 15623. The test determines whether
the eGo vehicle recognizes two near-running vehicles that do not overlap
completely. During the test, the main target vehicle (center) is driven at a constant
speed outside of the eGo driving axis (however, it is necessary to reach at least 0.5 m
of its width in the test vehicle strip). The eGo vehicle accelerates until the warning
system alerts and then decelerates until the warning system disappears. Then
begins to decelerate the middle target vehicle and decelerates until the warning
system of the eGo vehicle again responds.
The experiment is defined by ISO 22178 and focuses on the ability of the
detection subsystem to distinguish between parallel driving vehicles. The column
The test is based on ISO 22179 and is focused on tracking the target vehicle via
adaptive cruise control until it stops if the manufacturer specifies this function. The
test combines a column test with an adaptive cruise control running from zero
speed. The faster eGo vehicle arrives at the slower target vehicle, which then
continuously decelerates until it stops.
50
3.4.10. T19 - ISO 22179 B: Resolution of the target vehicle
from the overtaking car
The test is based on the ISO 22179 standard. It is focused on the analysis of the
ability to discretize two parallel-running vehicles without stabilizing the relative
position of the target and the parallel vehicle. The objective is to verify the
capabilities of the detection subsystem. The test was performed according to the
specification in the standard. The eGo vehicle, with the adaptive cruise control on,
set at a higher speed than the target vehicle, moves behind the target vehicle. The
target and eGo vehicles are gradually overtaking a parallel slower car. The eGo
vehicle does not have responded to the overtaken vehicle.
51
All the TestRuns, variations and scripts that make up a test series in the Test
Manager are executed consecutively starting from top to bottom. An overview of
the execution order is given in the figure 3.21, marked as box A in the picture below.
In box B, we can find a description of the current test series (if activated under
View) or we can place settings such as select a TestRun or enter a value for a
variation.
Figure 3.21 - Clear view (A) and description window (B) of the Test Manager GUI
Every driving scenario has been parametrized to three cases from A to C. These
cases have different values for every variable. These values were chosen with
regards to vehicle dynamics and driving scenario definition.
52
Explanatory notes for variables with units:
TestRun: T02_CTU_02_2013B_testrun
Car: DemoCar_EuroNCAP_GLC_T02_CTU_02_2013B
Test manager: Parametrization_ T02_CTU_02_2013B.ts
53
TestRun: T02_CTU_02_2013C_testrun
Car: Demo_BMW_5_ACC_T02_CTU_02_2013C
Test manager: Parametrization_ T02_CTU_02_2013C.ts
TestRun: T05_CTU_02_2013E_testrun
Car: Demo_BMW_5_ACC_T05_CTU_02_2013E
Test manager: Parametrization_T05_CTU_02_2013E.ts
54
3.5.3. T06 - CTU 02/2013 F - Secure and predictable
vehicle interaction
TestRun: T06_CTU_02_2013F_testrun
Car: Demo_BMW_5_ACC_T06_CTU_02_2013F
Test manager: Parametrization_T06_CTU_02_2013E.ts
TestRun: T07_CTU_02_2013G_testrun
Car: DemoCar_EuroNCAP_GLC_T07_CTU_02_2013G
Test manager: Parametrization_T07_CTU_02_2013G.ts
55
3.5.5. T08 – ES 347/2012 A - Recognizing the trajectory
between standing vehicles
TestRun: T08_ES_347_2012A_testrun
Car: Demo_BMW_5_ACC_T08_ES_347_2012A
Test manager: Parametrization_T08_ES_347_2012A.ts
TestRun: T12_ISO_15623B_testrun
Car: Demo_BMW_5_ACC_T12_ISO_15623B
Test manager: Parametrization_T12_ISO_15623B.ts
56
3.5.7. T15 - ISO 22178 B: Column slow ride: Target
vehicle recognition from overtaking car
TestRun: T15_ISO_22178B_testrun
Car: Demo_BMW_5_ACC_ T15_ISO_22178B
Test manager: Parametrization_ T15_ISO_22178B.ts
57
3.5.9. T18 - ISO 22179 A: Tracking the target vehicle to
stop
TestRun: T18_ISO_22179A_testrun
Car: Demo_BMW_5_ACC_ T18_ISO_22179A
Test manager: Parametrization_ T18_ISO_22179A.ts
58
3.6. Evaluation of driving scenarios
The evaluation was done with help of IPGMovie tool, which graphically
represents all the simulations and IPGControl. IPGControl offers the functionality
of an online result management. This means that the current simulation data is
provided without delay, which enables us to display diagrams directly during the
simulation.
The goal of this test for T02 – CTU 02/2013 B was to test reactions of AEB
system. eGo vehicle should not start braking when target vehicle exits its lane and
new static target (SCT) appears because eGo vehicle exits this lane also.
Limit distances (eGo does not brake) between SCT and eGo vehicle are:
Name of parameter Case A Case B Case C
LongCtrl.AEB.dDist [m] 18.4 25 9
59
(1) LongCtrl.FCW.SwitchedOn: Flat if FCW system is switched on
(2) LongCtrl.FCW.WarnLevel: Warning level of FCW system: 0=no warning, 1-
2=warning level 1-2
(3) LongCtrl.AEB.IsActive: Flat if AEB system is active (=braking)
(4) LongCtrl.AEB.SwitchedOn: Flat if AEB system is switched on
(5) DM.Brake: Brake/decelerator activity, relative pedal force (0..1)
(6) LongCtrl.AEB.dDist [m]: Relative distance to relevant target object
(7) LongCtrl.AEB.Time2Collision [s]: Time to collision with the target vehicle
(7) LongCtrl.AEB.Time2Brake [s]: Time threshold to brake to equal velocity of the
target object
This test has a limit of 25 m and it has been reached in all of these cases. In
Case C, the relative distance was shortest - 9 meters to the target vehicle. In Case B,
the relative distance was 25 m, so on the limit, but still acceptable. Variable
DM.Brake represent inactivity of braking pedal during whole simulation.
For version T02 – CTU 02/2013 C limit of 25 m was met. The required behavior
of the vehicle was braking when it recognizes a new target. This behavior was met
in every test case. DM.Brake shows that vehicle was braking for 1.5 s
The goal of this test was to verify adaptation of ACC. The response of other cars
was monitored. In every case, ACC of every car adapts to the new situation. ACC
of target vehicles has default setup, which cannot be tuned, but eGo vehicle has the
possibility to improve the response of ACC. In the figure 3.25 is described the list
of parameters. For Case B graph with speeds is plotted in figure 3.24. In the first
part vehicles have default starting positions and must create 1.5 s gaps between
each other. Traffic object T04 is leading the column and rest is setting up right
distance. In part two all speeds are same and vehicles travel simultaneously. In part
three it is clearly visible, that target T04 starts braking first and every following
object copies its behavior until steady state in part four. In the last fifth part vehicles
start to accelerate again.
2
5
1 3 4
The goal of this test was the analysis of the behavior of the autonomous system
in the context of other traffic. eGo vehicle with ACC set to the maximum distance
merges into target’s lane 15 – 20 m behind it. The reaction of ACC controller is
monitored. Setting up of required ACC distance should be done continuously and
without using of brakes.
Limit distances (eGo does not brake) between target and eGo vehicle are:
Name of parameter Case A Case B Case C
Distance_eGo_target [m] 44 32 19
ACC maximum distance is set to 3 s gap between eGo and target. For smoother
spacing acceleration controller factor, I [-] is changed from 0.001 to 0.0001 and
minimal distance is 10 m – figure 3.26. In the default setup merging was always
accompanied by braking independently on distance between eGo and target. After
tuning controller factor I, values in the table were reached. Only for Case C limit
between 15 – 20 m was met. Rest of TestRuns don’t suit.
62
Figure 3.27 – ACC parameters tuning
The goal of the test is to verify the behavior of the automatic emergency brake
system according to the manufacturer's specification. In all three cases, AEB system
avoided a collision. Figure 3.28 shows moment right before upcoming collision.
64
In figure 3.28 is described Case B with time sample of 6 s when collision
situation occurs. At the time 86 s variable LongCtrl.AEB.Time2Collision is
calculated for about 7 s and it is linearly decreasing along with LongCtrl.AEB.dDist.
At the time 90.4 s LongCtrl.FCW.WarnLevel 1 is active and at the time 91.4 s
LongCtrl.FCW.WarnLevel 2 is active. When LongCtrl.AEB.Time2Collision and
LongCtrl.AEB.Time2Brake are equal LongCtrl.AEB.IsActive is turned on and
vehicle starts braking.
The goal of the test is to verify whether the detection system can recognize the
space between two side-by-side vehicles whose rear parts are aligned in one plane.
Values in the table below representing the lateral distance between target
driving axis and eGo driving axis. Actual gaps between vehicles are slightly
different.
Smallest gap between two side-by-side standing target vehicle, which eGo
vehicle can go through is 2.65 m. Smaller gap is evaluated as an obstacle and vehicle
stops. In all three cases, eGo passed.
65
3.6.6. T12 - ISO 15623 B - Recognition of the target
vehicle from two consecutive targets
The goal of the test is to determine whether the eGo vehicle recognizes two
near-running vehicles that do not overlap completely.
During Case A eGo vehicle does not manage to break when the target starts to
decelerate. This is caused by small eGo and target time gap 1 s and low friction
coefficient 0.5 s. Target overlap does not have any effect on this failure.
In rest of cases, everything works fine and eGo reacts correctly and starts
braking.
66
Figure 3.29 shows whole Case B TestRun. AccelCtrl.ACC.IsActive represents
activated ACC control. DASensor.RadarL.relvTgt.dtct show that some relevant
target(s) is detected. ACC reacts to target behavior with braking. This braking is
represented by Car.ax – red curve. DASensor.RadarL.relvTgt.Id detect for whole
period of simulation 2 targets altogether.
The goal is to test the ability of the detection subsystem to distinguish between
parallel driving vehicles. In all three cases, eGo vehicle acts correctly and does not
react to parallel driving target.
67
(1) AccelCtrl.ACC.IsActive: Flat if the ACC controller is activated
(2) DASensor.RadarL.relvTgt.dtct: Flat if a relevant target is detected (boolean)
(3) DASensor.RadarL.relvTgt.Id: Traffic object number of the relevant target
(integer)
(4) Car.ax [m/s2]: Translational acceleration of eGo vehicle connected body
(5) Traffic.T03.LongAcc [m/s2]: Longitudinal acceleration of the traffic object in
object frame
The test is aimed at detecting the new target vehicle. eGo vehicle always
continuously accepts new target.
68
Figure 3.31 – eGo detecting new target and set desired distance – Case B
The goal of the test is focused on tracking the target vehicle via adaptive cruise
control until it stops.
Except for Case A eGo vehicle always managed to stop successfully without
colliding with the target vehicle. Case A had a crash and the reason is small time
gap 2 s and low friction coefficient 0.5.
69
Figure 3.32 – eGo reaction to decelerating target – Case B
70
3.6.10. T19 - ISO 22179 B: Resolution of the target vehicle
from the overtaking car
The goal of the test is to analyze the ability to discretize two parallel-running
vehicles without stabilizing the relative position of the target and the parallel
vehicle. eGo vehicle never responds to the overtaken vehicle.
Figure 3.33 shows whole simulation. eGo vehicle does not respond to slower
overtaken vehicle by any kind of action and follow target vehicle continuously.
71
3.7. GPS coordinates as results of simulations
Every single scenario provides us results in form of speed and World Geodetic
System - WGS 84 coordinates, which can, for example, be used with Google Earth.
These values are exported from CarMaker into Excel sheet.
Due to the small driving ranges (max. 1000 m) these coordinates do not change
so much, there are only minor differences.
GCS Lat [deg]: Specifies the latitude of the geographic coordinates of the reference
point.
GCS Long [deg]: Specifies the longitude of the geographic coordinates of the
reference point.
GCS Height [m]: Specifies the elevation of the geographic coordinates of the
reference point.
Car Velocity [km/h]: velocity of vehicle
These results can be used for procedure validation in proving ground test.
Another option is to use Differential GPS with different output quantities.
72
Chapter 4
4. Conclusion
4.1. Contributions
This master thesis introduces new simulation possibilities for ADAS system
testing with help of IPG CarMaker software tool. We can simulate almost any kind
of driving scenario with minimal costs and relevant results. The most crucial things
are vehicle models, these should be ideally the same as a real vehicle for getting
correct results. We used predefined models.
Road modeling is another very important part of the simulation because we can
create any kind road with specific parameters (friction coefficient, elevation, curbs
etc.). GPS coordinates can be used in both ways for import and export.
All predefined driving scenarios were successfully simulated and
parametrized.
4.2. Assignment
The first part of the assignment was to do research of state-of-the-art in the field
of ADAS system software testing with regards to sensor physics modeling. This
part was fully accomplished with sensor research in general. This means types of
sensor and its usage in vehicles or typical parameters. Sensor physics modeling is
pretty much the know-how of companies developing these systems, but few
remarks about modeling in general are introduced along with modeling
complexity.
The second part of the thesis was to model predefined scenarios in IPG
CarMaker and coupling with other software tools. As another software tool was
chosen Microsoft Excel. Along with modeling, parameterization with respect to
vehicle dynamics was necessary. All scenarios were simulated with success.
The last part was export of geodetic coordinates and speeds for final test
procedure validation in proving ground test. These results were exported for every
single scenario.
73
List of sources
[1] What is an Automatic Braking System? [online]. [cit. 2017-07-25] Available at:
https://www.lifewire.com/what-is-automatic-braking-system-534823.
[2] Traffic sign recognition [online]. [cit. 2017-07-25] Available at:
https://www.cartrade.com/blog/2015/car-automobile-technology/traffic-signs-
recognition-1309.html
[3] Top 20 Automotive Advanced Driver Assistance Systems (ADAS) Companies
2016 [online]. [cit. 2017-07-25] Available at: http://1url.cz/htW8D
[4] Decoding Blind Spot Detection and Warning Systems [online]. [cit. 2017-07-25]
Available at: https://www.lifewire.com/decoding-blind-spot-detection-534803
[5] What Are Lane Departure Warning Systems? [online]. [cit. 2017-07-25] Available
at: https://www.lifewire.com/what-are-lane-departure-warning-systems-534822
[6] JIROVSKÝ. Václav. Metodika hodnocení systémů integrované bezpečnosti
osobních automobilů. Praha. 2015. Disertační práce. České Vysoké Učení Technické v
Praze
[7] Sensor Models for Automated and Assisted Driving – A Testing Concept. 2017.
Dr. Andreas Höfer. IPG Automotive GmbH
[8] Advanced Driver Assistance Systems [online]. [cit. 2017-07-25] Available at:
https://www.continental-automotive.com/en-gl/Passenger-Cars/Chassis-
Safety/Advanced-Driver-Assistance-Systems
[9] What is adaptive cruise control and how does it work? [cit. 2017-07-25] Available
at: http://www.extremetech.com/extreme/157172-what-is-adaptive-cruise- control-
and-how-does-it-work
[10] Blind spot detection: Car tech that watches where you can’t [online]. [cit. 2017-
07-27] Available at: http://www.extremetech.com/extreme/165742-blind-spot-
detection- car-tech-that-watches-where-you-cant
[11] Type of radars on vehicles [online]. [cit. 2017-07-27] Available at:
http://www.fujitsu-ten.com/business/automotive/lineup/index.html
[12] Lidar Continental [online]. [cit. 2017-07-27] Available at:
http://www.allaboutcircuits.com/uploads/articles/contental_driving_sensor9.jpg
[13] ABS (Anti-lock Braking System) [online]. [cit. 2017-07-27] Available at:
http://www.autolexicon.net/cs/articles/abs-anti-lock-braking- system/
[14] Autonomous Emergency Braking [online]. [cit. 2017-07-25] Available at:
https://www.euroncap.com/en/vehicle-safety/the-rewards-
explained/autonomous-emergency-braking
74
[15] Subaru Adaptive Cruise Control [online]. [cit. 2017-07-25] Available at:
http://www.subaru.com.au/about/eyesight/adaptive-cruise-control
[16] ACC [online]. [cit. 2017-07-25] Available at: http://www.proctorcars.com/how-
does-adaptive-cruise-control-work/
[17] Active cruise control systems: Road trip tech series #1 [online]. [cit. 2017-07-17]
Available at: http://openroadautogroup.com/blog/active-cruise-control-systems
[18] Lidars [online]. [cit. 2017-07-27] Available at: https://www.continental-
automotive.com/en-gl/Passenger-Cars/Chassis-Safety/Advanced-Driver-
Assistance-Systems/Lidars
[19] Camera Continental [online]. [cit. 2017-07-27] Available at:
https://www.continental-automotive.com/en-gl/Passenger-Cars/Chassis-
Safety/Advanced-Driver-Assistance-Systems/Cameras
[20] An introduction to ultrasonic sensors for vehicle parking [online]. [cit. 2017-07-
27] Available at: http://www.newelectronics.co.uk/electronics-technology/an-
introduction-to-ultrasonic-sensors-for-vehicle-parking/24966/
[21] CarMaker [online]. [cit. 2017-07-28] Available at: https://ipg-
automotive.com/products-services/simulation-software/carmaker
[22] DRIVE REVIEW: AUDI A4 (2015) [online]. [cit. 2017-07-25] Available at:
https://www.driving.co.uk/car-reviews/first-drive-review-audi-a4-2015/
[23] Smart Driving [online]. [cit. 2017-07-27] Available at:
http://smarter.st.com/smart-driving/adas/
[24] Automotive Radar – A Tale of Two Frequencies [online]. [cit. 2017-07-27]
Available at: http://blog.st.com/automotive-radar-tale-two-frequencies/
[25] Generic Architecture for Simulation of ADAS Sensors [online]. [cit. 2017-07-28]
Available at: http://ieeexplore.ieee.org/document/7226306
[26] Sensor models for Automated and Assisted Driving. IPG. Stuttgart.
Autonomous Vehicle Test & Development 2017 [cit. 2017-07-28]
[27] Probabilistic sensor models for simulation of ADAS. BASELABS. Stuttgart.
Autonomous Vehicle Test & Development 2017 [cit. 2017-07-28]
[28] Advanced RADAR Sensors Modeling for Driving Assistance Systems Testing
[online]. [cit. 2017-07-28] Available at: http://ieeexplore.ieee.org/document/7481398
[29] Modeling and validation of a new generic virtual optical sensor for ADAS
prototyping [online]. [cit. 2017-07-28] Available at:
http://ieeexplore.ieee.org/abstract/document/6232260
[30] Sensor Models for Virtual ADAS Sensors [online]. [cit. 2017-07-28] Available at:
https://www.baselabs.de/sensor-models-for-a-more-realistic-simulation/#c-157
[31] Lane departure warning system [online]. [cit. 2017-08-14] Available at:
https://en.wikipedia.org/wiki/Lane_departure_warning_system
75
[32] FMCW Radar in Automotive Applications [online]. [cit. 2017-08-14] Available
at: https://www.cst.com/~/media/cst/landing-
pages/2016automotive/understanding--testing-fmcw-automotive-radar-
devices.ashx?la=en
[33] Automotive Simulation Models [online]. [cit. 2017-08-14] Available at:
https://www.dspace.com/en/inc/home/products/sw/automotive_simulation_
models.cfm
[34] CarSim [online]. [cit. 2017-08-14] Available at:
https://en.wikipedia.org/wiki/CarSim
[35] CarSim Mechanical Simulator [online]. [cit. 2017-08-14] Available at:
https://www.carsim.com/products/carsim/index.php
[36] Human Factors and Economic Aspects on Safety [online]. [cit. 2017-08-14]
Available at:
http://www.humanfactorsnetwork.se/Publications/Proceedings2006.pdf
[37] Driver Assistance Systems with focus on Automatic Emergency Brake
[online]. [cit. 2017-08-14] Available at: https://www.diva-
portal.org/smash/get/diva2:618217/FULLTEXT01.pdf
76
CD content
• Simulated TestRuns
• Car models
• Parametrization
77