An actively adaptive control policy based on the prediction of posterior densities

Rok, strany: 1996, 297 - 304

For a linear system with unknown parameters the control action affects both, the future behaviour of the system and the precision of the future state and parameter estimates. When the model parameters are known and a quadratic control objective is used, the Certainty Equivalence Principle leads to classical LQG feedback control laws. This principle no longer holds true in the case of unknown parameters, and the corresponding stochastic dynamic programming problem cannot in general be solved analytically. Suboptimal policies have thus to be retained. Most of them are passively adaptive, i.e., at stage $k$ they take into account the information collected from previous measurements $y(1),…,y(k)$ (a benefit of feedback), but do not take into account the influence of the present action on the precision of future estimations. Each new observation is thus considered to be the last one to be performed. On the opposite, prediction of precision is a basic idea in optimal experiment design. Using the information matrix, we can predict the future posterior uncertainty on the parameters and thus design an actively adaptive control policy. The case of autoregressive models is considered and illustrative examples are presented.

ISO 690:

Pronzato, L., Kulcsár, C., Walter, E. 1996. An actively adaptive control policy based on the prediction of posterior densities. In Tatra Mountains Mathematical Publications, vol. 7, no.1, pp. 297-304. 1210-3195.

APA:

Pronzato, L., Kulcsár, C., Walter, E. (1996). An actively adaptive control policy based on the prediction of posterior densities. Tatra Mountains Mathematical Publications, 7(1), 297-304. 1210-3195.