LQG-Optimal Versus Simple Event-Based PID Controllers
LQG-Optimal Versus Simple Event-Based PID Controllers
3679
Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY ROURKELA. Downloaded on January 16,2025 at 15:41:08 UTC from IEEE Xplore. Restrictions apply.
vz vx v
ud := u̇ P w P x y
1 k k
s s s ud θ Kalman
LQR, ηa Process, η
filter, η̂
Fig. 3. Modified version of the system in Fig. 2, where the input disturbance
and control signal have been merged into a single, controllable state.
3680
Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY ROURKELA. Downloaded on January 16,2025 at 15:41:08 UTC from IEEE Xplore. Restrictions apply.
where the “measurement” ya and integral action zi,a are
generated by the intermittently reset simulation
ÿa + klx ẏa + k 2 ly ya = 0, ya (ti ) = y(ti ), ẏa (ti ) = ẏ(ti ),
K
żi,a = ya , zi,a (ti ) = ẑi (ti ).
Ti
(19)
On the sensor side, the signals y and ẏ are directly available,
while ẑi is given by (13). At sampling times {ti }, the data
(y, ẏ, ẑi ) is transmitted to the actuator side and resets the
simulation according to (19).
Naturally, this continuous-time scheme is difficult to re-
alize in practice, but from a theoretical point of view it Fig. 5. Numerical approximation of the optimal sampling threshold (blue
provides a useful performance baseline for comparisons to surface) for the LQG-optimal controller described in Sec. III. A line parallel
more practical implementations. to the LQ feedback gain vector [lx , ly , 1] (red) is plotted for reference. The
threshold was obtained using the method described in [20].
C. Event-Based Sampling
Define the error η̃ := ηa − η̂. Whenever η̃ = 0 holds, signal generators infeasible. Arguably, this is the case for the
the optimal sampled-data controller will behave identically optimal controller of the previous section, which motivates
to its continuous-time counterpart. This is the case just after the need for suboptimal but simpler implementations. In
sampling, but in between sampling actions the error will drift this section we will highlight some features of previously
due to disturbances in the system. The dynamics of η̃ will proposed event-based PID controllers from the literature, and
fundamentally determine the closed-loop performance, and discuss which features are useful yet practical to achieve
it can be shown that (16) can be re-expressed as [8, Thm. 1] good LQG performance.
2 A. Årzén’s Simple Event-Based PID Controller
Jmod = γ0 + qud E{ La η̃ }, (20)
Most proposals of event-based PID controllers in the
where γ0 is continuous-time LQG optimal cost. The value literature can be traced back to the seminal paper of Årzén
of the second term in (20) is determined by the choice of [2]. We therefore start by giving a brief review of the
sampling policy, which ideally should be as small as possible algorithm here.
for a given average sampling rate. On the sensor side, the system output y is monitored
As detailed in [14], the event-based sampling policy that periodically with a fixed, short period hnom , and the decision
minimizes (20) is in the form of a threshold on η̃. Finding to transmit data to the controller on the actuator side is based
the optimal threshold for a given setup generally requires on a simple send-on-delta condition combined with a time-
computationally demanding numerical methods. However, as out hmax . The sensor operation is described by the following
seen in Fig. 5, the optimal threshold can in this case be pseudo-code, in which h act denotes the actual sampling
well approximated by two parallel hyperplanes, orthogonal period:
to the vector [lx , ly , 1]⊺ . This approximation corresponds to y := AnalogIn();
a policy which triggers sampling whenever h_act := h_act + h_nom;
IF abs(y - y_old) >= delta OR h_act >= h_max THEN
|ũ| > ∆. (21) Send(y);
y_old := y;
where ũ := K(y − ya ) + KTd (ẏ − ẏa ) + (ẑi − zi,a ) is the ENDIF
difference in control signal between two ideal PID controllers An on-the-fly discretized version of the PID algorithm is
with feedback from the true process and the simulation (19) then implemented on the actuator side. It runs at each sensor
respectively. event and is represented by the following pseudo code:
We will use (21) as the (near optimal) event-based thresh-
y := Receive();
old policy for the optimal controller structure, where the h_act := Time() - time_old;
design parameter ∆ > 0 is chosen as a trade-off between u_p := -K * y;
LQG-cost and average sampling rate. a_d := T_d / (N * h_act + T_d);
u_d := a_d * u_d - K * N * a_d * (y - y_old);
IV. S IMPLE E VENT-BASED PID I MPLEMENTATIONS u := u_p + u_i + u_d;
AnalogOut(u);
Event-based implementations of PID controllers are usu- u_i := u_i - K / T_i * h_act * y;
ally motivated by improved resource efficiency, especially y_old := y;
time_old := Time();
in networked control systems, where savings in energy
and bandwidth can be achieved by transmitting data less Here, N represents the maximum derivative gain in the
often. However, the computational capacity in the sensor controller. If there is no measurement noise, we can let
and actuator nodes are usually limited in embedded imple- N → ∞ and the derivative part becomes a pure backward
mentations, which makes complex triggering conditions and difference.
3681
Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY ROURKELA. Downloaded on January 16,2025 at 15:41:08 UTC from IEEE Xplore. Restrictions apply.
B. Choice of Measurement Filter and Triggering Rule vz
Årzén’s event-based controller and many subsequent ones
uses the send-on-delta rule [9], possibly after filtering out 1
measurement noise [10]. It has been pointed out in several s
works, e.g., [12], [13] that integral sampling is less sensitive z vx
to noise and also eliminates the deadband effect. u P w P 1 y
The optimal solution contains a Kalman-Bucy filter at the (s + 1)3
sensor that filters out measurement noise and estimates the
full state vector. It triggers on the difference in control signal Fig. 6. Process considered for Setup B in the performance comparisons.
between the sensor and actuator side, hence utilizing the
entire state vector. utilize a simplified model in the actuator [15]. A further
For PID control, it would seem like a reasonable com- possible solution is to use ZOH but adapt the feedback gain
promise to trigger on the PD part of the control signal, i.e., according to the recently experienced hold intervals. We will
whenever refer to this heuristic method as adaptive PD gain.
K(y − yold ) + KTd (ẏ − ẏold ) > ∆. V. P ERFORMANCE E VALUATION
This would also be relatively simple to implement in analog In this section we evaluate the performance of several
electronics, in conjunction with a second-order anti-aliasing combinations of the heuristic event-based methods discussed
filter (see [18]). We will refer to this option as PD triggering. in the previous section and compare the results to Mirkin’s
To avoid stationary errors in the case of zero process noise optimal controller with event-based sampling. Higher re-
and no events, the trigger needs to be combined with a time- source efficiency being one of the main motivators for event-
out hmax , similar to Årzén’s solution. based control, we focus on the trade-off between average
sampling rate (equivalent to mean network or CPU usage)
C. Choice of Data to Communicate and the LQG cost as measured by (1). Two different setups
Most heuristic methods only communicate the sensor are considered:
value y to the actuator side at events, although some works A. The double integrator process in Fig. 2 with the gain,
have proposed separate triggers and transmissions for the cost, and noise parameters k = 1, qy = 4, qyw = 0,
different parts of the PID controller, e.g., [11]. rz = 1. The LQG-optimal controller is a PID controller
The optimal solution, however, transmits an estimate of with the parameters K = 4, Ti = 2, Td = 0.75.
the full state vector. Sending a few extra bytes in a network
B. The stable third-order process in Fig. 6 with the cost
packet costs very little, and, if PD triggering is used, both
and noise parameters qy = 5.5, qyw = 0, rz = 0.1. For
y and ẏ are already available in the sensor node and should
this higher-order process, the LQG-optimal controller
be communicated to the actuator.
is not a PID controller. We can however find the best
D. Choice of Integrator Implementation possible PID parameters using nonlinear optimization,
Årzén’s integrator implementation does not work well for yielding K = 2.15, Ti = 2.67, Td = 1.23.
long inter-event times. Durand & Marchand therefore pro- Setup A matches the studied problem exactly, while Setup B
posed to include a forgetting factor to alleviate the problem is representative of a lag-dominated stable process from
[21]. Another solution is to implement the integrator in the process industry. In both cases, the LQG costs found in the
form of an automatic reset, Eq. (14). This has for instance evaluation have been normalized so that the continuous PID
been adopted in the PIDplus commercial controller [22] and controller has a relative cost of 1.0.
has been proven to work well for event-based PI control [13]. The performance of the different controllers were evalu-
The optimal solution estimates the integral state as part of ated by Monte Carlo simulations in TrueTime [23]. Through-
the full state vector. It is however of practical advantage to out, hnom = 0.01 s was used as the simulation timestep
have the integrator separately, since it becomes easier to deal (and hence smallest possible event detection interval). For
with practical issues such as anti-reset windup and controller each scenario, a 1000 s simulation was run using the same
mode switches [18]. noise input sequences. For the event-triggered algorithms,
the trigger parameter ∆ was swept over a range of values,
E. Choice of Control Signal Generator generating different average sampling rates and LQG costs.
At the actuator side, zero-order hold (ZOH) between
events is often assumed in heuristic implementations. Setting A. Triggers and Sent Information
the correct feedback gain for each output however requires We first study how the choice of event trigger (send-on-
knowledge of the next hold interval. Better choices may delta or PD trigger) and the information sent between sensor
therefore be impulse generators or general control signal and actuator (only y or y and ẏ) impact the performance of
generators as discussed in [16]. the event-based PID controller. The rest of the PID controller
The optimal solution includes a full-state plant model at is implemented like Årzén’s (see Sec. IV-A). Results for
the actuator as a control generator. One compromise is to Case A are reported in Fig. 7. It is seen that PD triggering
3682
Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY ROURKELA. Downloaded on January 16,2025 at 15:41:08 UTC from IEEE Xplore. Restrictions apply.
Fig. 7. Trade-off between LQG cost and average sampling rate for Setup A Fig. 9. Trade-off between LQG cost and average sampling rate for Setup A
using different triggers and sent information. using different integrator algorithms and fixed or adaptive feedback gain.
3683
Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY ROURKELA. Downloaded on January 16,2025 at 15:41:08 UTC from IEEE Xplore. Restrictions apply.
R EFERENCES
[1] K. J. Åström and B. Bernhardsson, “Comparison of periodic and event
based sampling for first-order stochastic systems,” in Preprints 14th
World Congress of IFAC, Beijing, P.R. China, Jul. 1999.
[2] K.-E. Årzén, “A simple event-based PID controller,” in Preprints 14th
World Congress of IFAC, Beijing, P.R. China, Jul. 1999.
[3] W. P. M. H. Heemels, K. H. Johansson, and P. Tabuada, “An introduc-
tion to event-triggered and self-triggered control,” in IEEE Conference
on Decision and Control, Dec 2012.
[4] Q. Liu, Z. Wang, X. He, and D. Zhou, “A survey of event-based
strategies on control and estimation,” Systems Science & Control
Engineering, vol. 2, no. 1, pp. 90–97, 2014.
[5] A. Cervin, “LQG-optimal PI and PID control as benchmarks for event-
based control,” in Proc. 2nd International Conference on Event-Based
Control, Communication and Signal Processing, Krakow, Poland,
2016.
[6] L. Mirkin, “Intermittent redesign of analog controllers via the Youla
parameter,” IEEE Trans. Autom. Control, vol. 62, no. 4, pp. 1838–
1851, 2017.
[7] M. Braksmayer and L. Mirkin, “H2 optimization under intermit-
tent sampling and its application to event-triggered control,” IFAC-
PapersOnLine, vol. 50, no. 1, pp. 7869–7874, 2017, 20th IFAC World
Fig. 10. Trade-off between LQG cost and average sampling rate for Setup A Congress.
using different optimal and suboptimal PID and LQG controllers. [8] A. Goldenshluger and L. Mirkin, “On minimum-variance event-
triggered control,” IEEE Control Syst. Lett., vol. 1, no. 1, pp. 32–37,
2017.
[9] M. Miskowicz, “Send-on-delta concept: An event-based data reporting
strategy,” Sensors, vol. 6, no. 1, p. 49, 2006.
[10] V. Vasyutynskyy and K. Kabitzsch, “Implementation of PID controller
with send-on-delta sampling,” in International Conference Control,
2006, pp. 4423–4428.
[11] P. G. Otanez, J. R. Moyne, and D. M. Tilbury, “Using deadbands to
reduce communication in networked control systems,” in Proceedings
of the 2002 American Control Conference (IEEE Cat. No.CH37301),
vol. 4, 2002, pp. 3015–3020 vol.4.
[12] M. Miskowicz, “Asymptotic effectiveness of the event-based sampling
according to the integral criterion,” Sensors, vol. 7, no. 1, pp. 16–37,
2007.
[13] U. Tiberi, J. Araujo, and K. H. Johansson, “On event-based PI control
of first-order processes,” in 2nd IFAC Conference on Advances in PID
Control, 2012.
[14] M. T. Andrén, B. Bernhardsson, A. Cervin, and K. Soltesz, “On event-
based sampling for LQG-optimal control,” in 2017 IEEE 56th Annual
Conference on Decision and Control (CDC), Dec 2017, pp. 5438–
5444.
[15] V. Vasyutynskyy and K. Kabitzsch, “First order observers in event-
based PID controls,” in 2009 IEEE Conference on Emerging Tech-
nologies Factory Automation, Sep. 2009, pp. 1–8.
Fig. 11. Trade-off between LQG cost and average sampling rate for Setup B [16] K. Åström, “Event based control,” in Analysis and Design of Nonlinear
using different optimal and suboptimal PID and LQG controllers. Control Systems, A. Astolfi and L. Marconi, Eds. Springer, 2008,
pp. 127–147.
measurement y but also on its derivative ẏ, here referred [17] K. J. Åström, Introduction to stochastic control theory, ser. Mathe-
matics in science and engineering. Academic Press, 1970, vol. 70.
to as ”PD triggering”. Furthermore, the sensor should also [18] K. J. Åström and T. Hägglund, Advanced PID Control. ISA – The
transmit both y and ẏ to the controller at events. Small further Instrumentation, Systems and Automation Society, 2006.
improvements can be achieved if the integral action uses [19] K. Zhou, J. C. Doyle, and K. Glover, Robust and Optimal Control.
Englewood Cliffs, NJ: Prentice-Hall, 1996.
the automatic reset realization. Adapting the controller gain [20] M. T. Andrén, “Using radial basis functions to approximate the LQG-
based on the length of the recent sampling period is probably optimal event-based sampling policy,” in 2019 18th European Control
not worth the extra implementation complexity, however. Conference (ECC), June 2019, pp. 2832–2838.
[21] S. Durand and N. Marchand, “Further results on event-based PID
One possible direction for further performance improve- controller,” in Proc. European Control Conference, 2009.
ments is to experiment with other control signal generators [22] J. Song, A. K. Mok, D. Chen, M. Nixon, T. Blevins, and W. Wojsznis,
than ZOH. The downside of more sophisticated signal gener- “Improving PID control with unreliable communications,” in ISA
EXPO Technical Conference, 2006, pp. 17–19.
ators is that they require a process model to be implemented, [23] D. Henriksson, A. Cervin, and K.-E. Årzén, “TrueTime: Simulation of
which is often not available in applications where PID control loops under shared computer resources,” in Proceedings of the
control is considered. Another research direction would be to 15th IFAC World Congress on Automatic Control, Barcelona, Spain,
Jul. 2002.
examine how well PD triggering actually approximates the [24] K. J. Åström and B. Wittenmark, Computer-Controlled Systems (3rd
optimal event trigger for the full-model system. Ed.). Upper Saddle River, NJ: Prentice-Hall, 1997.
3684
Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY ROURKELA. Downloaded on January 16,2025 at 15:41:08 UTC from IEEE Xplore. Restrictions apply.