Agent Based Approaches For Behavioural M
Agent Based Approaches For Behavioural M
ABSTRACT
Behavioral modeling of combat entities in given. At the same time, the maturity of ABM in
military simulations by creating synthetic agents agent-based applications has also been
in order to satisfy various battle scenarios is an considered.
important problem. The conventional modeling Keywords: ABM, CGF, Behavior Modeling
tools are not always sufficient to handle complex
situations requiring adaptation. To deal with
this Agent-Based Modeling (ABM) is employed, 1. INTRODUCTION
as the agents exhibit autonomous behavior by
adapting and varying their behavior during the Agent-based modeling comprising of interacting
course of the simulation whilst achieving the autonomous agents have been used to develop
goals. Synthetic agents created by means of models for a wide range of applications.
Computer Generated Force (CGF) is a Applications range from modeling agent
relatively recent approach to model behavior of behavior in voting during elections, to predicting
combat entities for a more realistic training and price variations within stock market trading,
effective military planning. CGFs, are also from modeling the growth and decline of ancient
sometimes referred to as Semi- Automated civilizations to modeling the growth of bacterial
Forces (SAF) and enables to create high-fidelity colonies etc.
simulations. Agents are used to control and The human behavior has been modeled in a very
augment the behavior of CGF entities, hence basic manner in the synthetic battlefield
converting them into Intelligent CGF (ICGF). environment. The latest technological advances
The intelligent agents can be modeled to exhibit made in the agent-based approaches, applied to
cognitive abilities. military wargaming and simulation offers
For this review paper, extensive papers on state- promising advantage in behavioral modeling
of-the-art in agent-based modeling approaches while improving training effectiveness at the
and applications were surveyed. The paper same time. This advantage is driven by
assimilates issues involved in ABM with CGF as emerging trends in learning using agent-based
an important component of it. It reviews modeling and essentials from the field of
modeling aspects with respect to the inter- computer generated forces (CGF), arti ficial
relationship between ABM and CGF, which is intelligence, game-theory etc. The agents are
required to carry out behavioral modeling. autonomous entities which observe through
Important CGFs have been examined and a list sensors and act upon the environment using
with their significant features is given. Another actuators and direct their activity towards
issue that has been reviewed is that how the achieving goals. To be called intelligent, an
synthetic agents having different capabilities are agent also has to be reactive, proactive and
implemented at different battle levels. Brief social; meaning it must be able to react to
mention of state-of-the-art integrated cognitive changes in the environment, pursue goals and be
architectures and a list of significant cognitive able to communicate with other agents
applications based on them with their features is (Wooldridge 2004). Intelligent agents model
both individual human reasoning and team An emergent phenomenon can have properties
behavior, performing tasks without any human that are decoupled from the properties of the
intervention as in constructive simulations. part. The emergent phenomena can be counter-
intuitive and thus it can be difficult to
understand and predict. Eg. In a traffic jam,
taking place due to interactions between
individual car drivers, a car may be moving in
the direction opposite to that of the cars that
cause it.
dynamics simulation model for a four-rank of a number of agents which interact with one
military workforce [1], Application of RT- another in the same environment (Wooldridge
DEVS in military [2] and Military applications 2002); each of the agents has its own strategy in
of agent-based simulations [3] respectively. order to achieve its objective. Due to the MAS
Jay Forrester, the founder of SDS, defined it as structure, ABS has the ability to be autonomous,
the study of information feedback characteristic responsive, proactive and social (Jennings et al.
of industrial activity to show how organizational 1998). There are two approaches to ABS [6]:
structure, amplification (in policies) and time Context Based Reasoning (CxBR) and BDI
delay (in decision and action) interact to reasoning. CxBR is a reasoning paradigm for
influence the success of enterprise [4]". In other representation of tactical behavior in agents
words, SDS is an approach used to understand (Gonzales and Ahlers 1998; Gallagher et al.
the dynamic behaviour of complex systems over 2000; Gonzales et al. 2008). The motivation
time at aggregate level. The modeling effort is behind CxBR is the realization that people only
usually a set of state equations. DES is a use a fraction of their knowledge at any given
dynamic, stochastic and discrete simulation time. The idea is to divide the knowledge into
technique (Banks et al. 2005). In DES, contexts in order to limit the number of
simulation time plays an important role possibilities for the action selection process. For
(dynamic model) and DES is a stochastic model example, an agent representing a military
as it consists of random input components. In platoon will require a different set of capabilities
addition, DES is discrete because it models a and knowledge when it is performing an attack
system in which the state of entities in the versus when moving along a road. In BDI
system change at a discrete time (Carson 2003). reasoning, set to work, the agent pursues its
The DES model uses a top-down approach to given goals, adopting the appropriate plans,
model system behaviour. One of the advantages according to its current beliefs of the state of the
of using DES [5] compared to other simulation world, so as to perform the role it has been
techniques such as SDS or ABS is it models a given.
system in an ordered queue of events (Siebers et
al. 2010). Another advantage of DES is that it Top-Down/ Discrete/ Reactive,
Bottom-Up Continuous Pro-Active
has the ability to be combined with other
simulation methods, such as continuous
simulation (Zaigler et al. 2000) and agent-based SDS Top-Down Continuous Reactive
simulation for studying complex systems DES Top-Down Discrete Reactive
(Parunak et al. 1998; Darley et al. 2004). Note: Can be
combined with
Entities in DES are not autonomous. This issue Continuous and
of autonomy (Bakken 2006) which relies upon Agent-Based
the capability to make independent decisions has Simulations
made DES a less preferred choice to represent ABS Bottom-Up Discrete Reactive,
Note: AnyLogic Pro-Active
complex human behaviour such as proactive s/w package
behaviour (Borshchev and Filippov 2004). In supports hybrid
DES, people are usually implemented as continuous/discrete
logic
resources or passive entities. Passive entities are
unable to initiate events in order to perform
Table 1: Modeling and simulation paradigms
proactive behaviour. Therefore, a proactive comparison
event that requires self-initiated behaviour by an
individual entity is difficult to implement in Reactive behaviour is a response to the
DES (Borshchev and Filippov 2004). This is environment i.e. the employees respond to
where agent-based simulations have a decisive requests from their customers when they are
edge in modeling proactive entities. These available. Proactive behaviour relates to
systems have many interacting entities and non- personal initiative in identifying and solving a
linear interactions among them. The problem. Many agent-based software and
corresponding computational technique is called toolkits have been developed and are widely
multi-agent simulation (MAS). A MAS consists used. Packages such as Repast, SWARM,
could be described as forming a new CGF entity 3.1.2 CGF as a Simulation and Wargame
from two or more existing CGF units all of
whose numeric parameters are redefined by the The application Close Action ENvironment
Commander of the new CGF entity. Similarly, (CAEN) [16] can be run as either a simulation
Force Deagregating is described as forming two and wargame. It is both a means of simulation of
or more new CGF entities from a single one. weapons effects and an interactive wargame
The parameters of the new CGF entities should (operational analysis) between opposing forces
be defined by the old CGF Commander before of up to platoon level strength. It can operate
the deagregating takes place. In the case of either as an automatically replicated constructive
Force Aggregating, the military hierarchy simulation with no user intervention, or as an
coherence is maintained by comparing the old interactive game in which two or more
CGF units Commanders level and assigning the independent players control the actions of their
command to the highest in rank; in case of own forces. Thus a combination of wargame and
deagregating, the old CGF unit Commander simulation is more amenable to cater to the
chooses the new CGF unit Commanders changing requirements for one-on-one to
assigning to each of them a Command position. divisional and corps battles.
The aggregation /deaggregation process enables
to simulate the desired effects. Eg. The paper 3.2 Examples of CGFs
[12] describes the ABM approach used to
simulate strategic effects at the operational level Some of the significant CGFs developed so far,
of war. CGFs have also been modeled in a with their features have been listed in the
Synthetic Theatre Of War (STOW) where CGFs following table.
and intelligent synthetic agents are brought to
theater-level exercises [13]. STOW [14] is a S. Architecture Features
no
program to construct synthetic environments for
1. JointSAF U.S. Tri-service simulation system,
numerous defence functions. Its primary (JSAF) including detailed modeling of air, land,
objective is to integrate virtual simulation and sea assets. JSAF lacks a
(troops in simulators fighting on a synthetic comprehensive dismounted infantry
model.
battlefield), constructive simulation (war 2. MOD-SAF ModSAF simulates an extensive list of
games), and live maneuvers to provide a training [17] entities. For fixed wing aircraft, it
environment for various levels of exercise. simulates the F-14D, MIG-29, A-10
and SU-25. For rotary wing aircraft, it
simulates the AH-64, OH-58D, Mi-24,
3.1.1 CGF as Battle Force Representation and and Mi-28. For its ground forces,
Simulation Modeling ModSAF can simulate tanks (M-I and
T-72), infantry fighting vehicles (M-2
Current and planned CGF capabilities were and BMP), ADA (ZSU-23/4), &
dismounted infantry. Enhancements
evaluated [15] on the basis of two evaluation could result in the support of additional
criteria: Battle Force representation and physical models such as Cavalry,
Simulation Modeling features. Howitzers, Mortars, Mine- fields, CSS,
Scud Patriot.
Battle force representation assesses the ability of 3. OTB-SAF OTB primarily caters for land-based
the CGF to represent different types of weapon [18] behaviors and interactions, however it
systems/military equipment for all services (Air does include the representation of air
Force, Army, Navy); levels of military and sea assets. In addition, OTB
includes specialized Dismounted
organizations (platoon through Division); Infantry SAF (DISAF) extensions and
Command, Control, Communications, and behaviors developed to support US
Intelligence (C3I); behaviors of entities and Army simulations.
units; tactics and doctrine. Simulation modeling 4. ONESAF A composable, next generation
[19] simulation architecture supporting both
features characterize simulation models and data Computer Generated Forces (CGF) and
bases used to represent system performance and SAF operations. Capable of replacing
the environment. US Army legacy entity-based
simulations: BBS, OTB/ ModSAF,
CCTT /AVCATT SAF, Janus (A&T),
JCATS MOUT.
CONTRIBUTOR