Math 839  Topics in Control: Information and Control (Fall 2008)

Instructor:  Serdar Yüksel (yuksel(at]mast.queensu.ca), Office: 415 Jeffrey, Phone: x32429,

This course will be a reading seminar/course. Depending on the enrollment, we will either have regular meetings or the instructor will be meeting with students working on a common problem separately due to the large variety of the topics. Students will either submit a precisely written report on a paper/theme or provide original research results which they will present at the end of the semester. The presentation should be accessible by  the control and communications / applied mathematics graduate students.

Please contact the instructor if you have any questions.

A few topics of interest:

Team Decision Theory
Control under Communication Constraints
Information Theory with Feedback
Decentralized Stabilization and Optimization
Consensus and Agreement

For other topics that you might be interested in, please arrange a meeting with the instructor.

An incomplete list of representative papers to allow you to browse the literature is given below :

On Team Decision Theory and Decentralized Optimization

Y. C. Ho, ``Team decision theory and information structures,”  Proc. IEEE , vol. 68, no. 6, pp. 644–654, 1980.

 Y. C.  Ho, K. C. Chu ``Team decision theory and information structures in optimal control problems - Part I"  IEEE Transactions on Automatic Control , 17, pp. 15 - 22, Feb. 1972.

 R. Radner, ``Team decision problems,''  Annals of Mathematical Statistics , 33: 857 - 881, 1962

 T.  Basar, ``Decentralized multicriteria optimization of linear stochastic systems'',  IEEE Transactions on Automatic Control , vol. 23, pp. 233 - 243, April 1978.

 P. Varaiya and J. Walrand, ``On delayed-sharing patterns",  IEEE Trans Automatic Cotrol , vol. 23. pp. 44345, June 1978.

 H. S. Witsenhausen, ``A counterexample in stochastic optimum control",  SIAM Journal on Control and Optimization  vol. 6, pp. 131-147, 1968.

 P. G. Voulgaris, ``A convex characterization of classes of problems in control with specific interaction and communication structures,” in  Proc. IEEE American Control Conference , pp. 3128-3133, Arlington, VA, June 2001.

 N. Sandell and M. Athans, ``Solution of some nonclassical LQG stochastic decision problems",  IEEE Trans. Automatic Control , vol. 19, pp. 108-116, 1974.

B. Kurtaran, ``Corrections and extensions to `Decentralized control with delayed sharing information pattern”  IEEE Trans. Automatic Control , vol 24, pp. 656-657, Aug. 1979.

 J. Ooi, S. Verbout, J. Ludwig and G. Wornell, ``A separation theorem for periodic sharing information patterns in decentralized control",  IEEE Trans. Automatic Control , vol. 42, pp. 1546 – 1550, Nov 1997.

 H. S. Witsenhausen, ``Equivalent stochastic control problems,”  Mathematics of Control, Signals, and Systems , vol. 1, pp. 3-11, Springer-Verlag, 1988.

 D. Teneketzis, ``On information structures and nonsequential stochastic control,”  CWI Quarterly, vol. 9, pp. 241-260, 1996.

S. Yuksel, "Stochastic Nestedness and the Belief Sharing Information Pattern", 2009.

On Decentralized Stability

 J. P. Corfmat and A. S. Morse, ``Decentralized control of linear multivariable systems," Automatica , vol. 11, pp. 479-497, Sep. 1976.

 B. D. O. Anderson and J. B. Moore,  ``Time-varying feedback decentralized control,"  IEEE Trans. Automatic Control  vol.26, pp. 1133-1139, Oct. 1981.
 
S. Wang and E.J.  Davison, ``On the stabilization of decentralized control. systems,   IEEE Trans. Automatic Control , vol. 18, pp. 473-478, Oct. 1973.

 H. Kobayashi, H. Hanafusa and T. Yoshikawa, ``Controllability under decentralized information structure,"  IEEE Trans. Automatic Control  vol. 23, pp. 182-188, Apr. 1978.

On Control under Information Constraints

R. Bansal and T. Basar, “Solutions to a class of linear-quadratic-Gaussian LQG stochastic team problems with nonclassical information," Systems & Control Letters, 9:125 - 130, 1987.

W. S. Wong and R. W. Brockett, Systems with finite communication bandwidth constraints - part II: Stabilization with limited information feedback, IEEE Trans. Automatic Control., 42(9):1294-1299, September 1997. 

A.S. Matveev and A. V. Savkin, "Shannon zero error capacity and the problem of almost sure observability over noisy communication channels", in Proc. IEEE CDC and ECC, 2005, Seville, Spain, pp. 3219-3224.

S. Tatikonda, A. Sahai, and S. Mitter, “LQG control problems under communication constraints", in Proc. IEEE Conf. Decision and Control, Dec. 1998, Florida, pp. 1165{1170.

D. Liberzon, “On stabilization of linear systems with limited information", IEEE Trans. Automatic Control, 48(2):304{307, February 2003. 

D. F. Delchamps, “Stabilizing a linear system with quantized state feedback," IEEE Trans. Aut. Control, 35:916{924, August 1990.

G. N. Nair and R. J. Evans, “Stabilizability of stochastic linear systems with finite feedback data rates", SIAM J Control and Optimization, 43:413{436, July 2004. 

N. Elia and S. K. Mitter, “Stabilization of linear systems with limited information," IEEETrans. Automatic Control, 46(9):1384{1400, September 2001.

O. C. Imer, S. Yuksel, and T. Basar, "Optimal Control of LTI Systems over Communication Networks", Automatica, 42(9):1429{1440, September 2006. 

R. Bansal and T. Basar, "Simultaneous design of measurement and control strategies for stochastic systems with feedback," Automatica, 25(9):679{694, September 1989.

S. Tatikonda, "Control Under Communication Constraints", PhD Dissertation, MIT, 2000.

 J. A. Fax and R. M. Murray, ``Information flow and cooperative control of vehicle formations,"  IEEE Trans. Automatic Control , vol. 49, pp. 1465--1476, Sept. 2004.

S. Yuksel and T. Basar, ``Optimal signaling policies for decentralized multi-controller stabilizability over communication channels",  IEEE Trans. Automatic Control , vol. 52, pp. 1969-1974, October 2007.
 
N. C. Martins and M. A. Dahleh, ``Feedback Control in the Presence of Noisy Channels: “Bode-Like” Fundamental Limitations of Performance,  IEEE Transactions on Automatic Control,  Volume 52, August 2008, Pages: 1604-1615.

On Consensus and Related Formation Control Problems

Chapter 5 of the dissertation of J.N. Tsitsiklis, "Problems in Decentralized Decision Making and Computation" Ph.D. Thesis, EECS, MIT, 1984
 
V. D. Blondel, J. M. Hendrickx, A. Olshevsky, and J. N. Tsitsiklis Convergence in Multiagent Coordination, Consensus, and Flocking Proceedings of the Joint 44th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC'05), Seville, Spain, December 2005.
 
S. Boyd, A. Ghosh, B. Prabhakar, and D. Shah "Gossip algorithms: Design, analysis, and applications", Proceedings IEEE Infocomm 2005, 3:1653-1664, Miami, March 2005.  

S. Boyd, A. Ghosh, B. Prabhakar, and D. Shah, "Randomized Gossip Algorithm", IEEE Transactions on Information Theory, vol. 52, no. 6, June 2006

A. Kashyap, T. Basar and R. Srikant "Quantized Consensus" Automatica, vol. 43, no. 7, July 2007.  

R. Olfati-Saber and R. M. Murray  , “Consensus problems in networks of agents with switching topology and time-delays”, IEEE Transactions on Automatic Control, vol. 49, pp. 1520- 1533, Sept. 2004.

J. R. Marden, G. Arslan and J. S. Shamma, "Joint strategy fictitious play with inertia for potential games", IEEE Transaction on Automatic Control, Volume 54, Issue 2, February  2009, pp. 208-220

On Communications, Capacity and Error Exponents with Feedback

J. P. M. Schalkwijk and T. Kailath, ``A coding scheme for additive noise channels with feedback. I: No bandwidth constraint'', IEEE Trans. Inform. Theory, vol. 12, no. 2, pp. 172-182, Apr. 1966. 

S. Tatikonda and  S. Mitter, ``The Capacity of Channels with Feedback," preprint, av. at http://arxiv.org/abs/cs/0609139, 2006.

Anant Sahai and Sanjoy Mitter,  "The necessity and sufficiency of anytime capacity  for control over a noisy communication link: Part I: scalar systems" IEEE Transactions on Information Theory, 2006.

B. Nakiboglu, R. G. Gallager, ``Error exponents for variable-length block codes with feedback and cost constraints'', preprint, av. at http://arxiv.org/abs/cs.IT/0612097, 2006.

F. Alajaji, ``Feedback Does Not Increase the Capacity of Discrete Channels with Additive Noise,'' IEEE Transactions on Information Theory, Vol. 41, pp. 546-549, March 1995.

M. Horstein, ``Sequential transmission using noiseless feedback'', IEEE Trans. Inform. Theory, vol. 9, no. 3, pp. 136-143. July 1963. 

C. E. Shannon, ``Channels with Side Information at the Transmitter'', IBM Journal of Research and Development, vol. 2, no. 4, pp. 289-293, 1958.

H. Yamamoto, K. Itoh, ``Asymptotic performance of a modified Schalkwijk-Barron scheme for channels with noiseless feedback”, IEEE Trans. Inf. Theory, vol. 25, pp. 729-733, 1979.

and other papers of interest.