Abstract

We consider the linear quadratic regulator (LQR) for linear constant-coefficient delay differential equations (DDEs) with multiple delays. The Hamiltonian approach is used instead of an algebraic Riccati partial differential equation. Two coupled DDEs governing the state and control input are derived using the calculus of variations. This coupled system, with infinitely many roots in both left and right half-planes, defines a boundary value problem. Its left half-plane roots are the exact closed-loop poles of the controlled system. These closed-loop poles have not been used to compute the optimal feedback before. Here, the distributed delay kernel that yields exactly those poles is first computed using an eigenfunction expansion. Increasing the number of terms in the truncated expansion yields a highly oscillatory kernel. However, the oscillatory kernel's antiderivative converges to a piecewise smooth function on the delay interval plus a Dirac delta function at zero. Discontinuities in the kernel coincide with discrete delay values in the original DDE. Using this insight, a fitted piecewise polynomial kernel matches the exact closed-loop poles very well. The twofold contribution of the Hamiltonian approach is thus clarity on the form of the feedback kernel as well as the exact closed-loop poles. Subsequently, the fitted piecewise polynomial kernel can be used for a much simpler control calculation. The polynomial coefficients can be fitted by solving a few simultaneous linear equations. Two detailed numerical examples of the LQR for DDEs, one with two delays and one with three delays, show excellent results.

References

1.
Anderson
,
B. D.
, and
Moore
,
J. B.
,
2007
,
Optimal Control: Linear Quadratic Methods
,
Courier Corporation
,
New York
.
2.
Stengel
,
R. F.
,
1994
,
Optimal Control and Estimation
,
Courier Corporation
,
New York
.
3.
Azimi
,
V.
,
Farzan
,
S.
, and
Hutchinson
,
S.
,
2022
, “
A Robust Time-Varying Riccati-Based Control for Uncertain Nonlinear Dynamical Systems
,”
ASME J. Dyn. Syst., Meas., Control
,
144
(
10
), p.
101001
.10.1115/1.4054884
4.
Gibson
,
J. S.
,
1983
, “
Linear-Quadratic Optimal Control of Hereditary Differential Systems: Infinite Dimensional Riccati Equations and Numerical Approximations
,”
SIAM J. Control Optim.
,
21
(
1
), pp.
95
139
.10.1137/0321006
5.
Banks
,
H. T.
,
Burns
,
J. A.
, and
Cliff
,
E. M.
,
1981
, “
Parameter Estimation and Identification for Systems With Delays
,”
SIAM J. Control Optim.
,
19
(
6
), pp.
791
828
.10.1137/0319051
6.
Burns
,
J. A.
,
Sachs
,
E. W.
, and
Zietsman
,
L.
,
2008
, “
Mesh Independence of Kleinman–Newton Iterations for Riccati Equations in Hilbert Space
,”
SIAM J. Control Optim.
,
47
(
5
), pp.
2663
2692
.10.1137/060653962
7.
Sun
,
J. Q.
,
2009
, “
A Method of Continuous Time Approximation of Delayed Dynamical Systems
,”
Commun. Nonlinear Sci. Numer. Simul.
,
14
(
4
), pp.
998
1007
.10.1016/j.cnsns.2008.02.008
8.
Sun
,
J. Q.
, and
Song
,
B.
,
2009
, “
Control Studies of Time-Delayed Dynamical Systems With the Method of Continuous Time Approximation
,”
Commun. Nonlinear Sci. Numer. Simul.
,
14
(
11
), pp.
3933
3944
.10.1016/j.cnsns.2009.02.011
9.
Morris
,
K.
, and
Navasca
,
C.
,
2004
, “
Solution of Algebraic Riccati Equations Arising in Control of Partial Differential Equations
,”
Control Boundary Anal.
,
240
, pp.
257
268
.10.1201/9781420027426
10.
Saak
,
J.
,
2009
, “
Efficient Numerical Solution of Large Scale Algebraic Matrix Equations in PDE Control and Model Order Reduction
,” Ph.D. thesis,
Chemnitz University of Technology
,
Chemnitz, Germany
.
11.
Fridman
,
E.
,
2014
,
Introduction to Time-Delay Systems: Analysis and Control
,
Springer
,
Birkhäuser, Switzerland
.
12.
Li
,
N.
,
Wang
,
G.
, and
Wu
,
Z.
,
2020
, “
Linear–Quadratic Optimal Control for Time-Delay Stochastic System With Recursive Utility Under Full and Partial Information
,”
Automatica
,
121
, p.
109169
.10.1016/j.automatica.2020.109169
13.
Kandala
,
S. S.
,
Uchida
,
T. K.
, and
Vyasarayani
,
C. P.
,
2019
, “
Pole Placement for Time-Delayed Systems Using Galerkin Approximations
,”
ASME J. Dyn. Syst., Meas., Control
,
141
(
5
), p.
051012
.10.1115/1.4042465
14.
Wahi
,
P.
, and
Chatterjee
,
A.
,
2005
, “
Galerkin Projections for Delay Differential Equations
,”
ASME J. Dyn. Syst., Meas., Control
,
127
(
1
), pp.
80
87
.10.1115/1.1870042
15.
Wahi
,
P.
, and
Chatterjee
,
A.
,
2005
, “
Asymptotics for the Characteristic Roots of Delayed Dynamic Systems
,”
ASME J. Appl. Mech.
,
72
(
4
), pp.
475
483
.10.1115/1.1875492
You do not currently have access to this content.