Performance Analysis of Positive Systems and Optimization Algorithms with Time-delays

Abstract

    Time-delay dynamical systems are used to model many real-world engineering systems, where the future evolution of a system depends not only on current states but also on the history of states. For this reason, the study of stability and control of time-delay systems is of theoretical and practical importance. In this thesis, we develop several stability analysis frameworks for dynamical systems under communication and computation time-delays, and apply our results to different challenging engineering problems.

    The thesis first considers delay-independent stability of positive monotone systems with time-delays. We show that the global asymptotic stability of positive monotone systems whose vector fields are homogeneous is independent of the magnitude and variation of bounded and unbounded time-varying delays. We present explicit expressions that allow us to give explicit estimates of the decay rate for various classes of time-varying delays. We demonstrate that the best decay rate of positive linear systems that our results guarantee can be found via convex optimization. We also derive a set of necessary and sufficient conditions for asymptotic stability of general positive monotone (not necessarily homogeneous) systems with time-delays. As an application of our theoretical results, we discuss delay-independent stability of continuous-time power control algorithms in wireless networks.

    The thesis continues by studying the convergence of asynchronous fixed-point iterations involving maximum norm pseudo-contractions. We present a powerful approach for characterizing the rate of convergence of totally asynchronous implementations, where both the update intervals and communication delays may grow unbounded. When specialized to partially asynchronous algorithms (where the update intervals and communication delays have a fixed upper bound), or to particular classes of unbounded delays and update intervals, our approach allows to quantify how the degree of asynchronism affects the convergence rate. In addition, we use our results to analyze the impact of asynchrony on the convergence rate of discrete-time power control algorithms in wireless networks.

    The thesis finally proposes an asynchronous algorithm that exploits multiple processors to solve regularized stochastic optimization problems with smooth loss functions. The algorithm allows the processors to work at different rates, perform computations independently of each other, and update global decision variables using out-of-date gradients. We characterize the iteration complexity and the convergence rate of the proposed algorithm, and show that these compare favourably with the state of the art. Furthermore, we demonstrate that the impact of asynchrony on the convergence rate of the algorithm is asymptotically negligible, and a near-linear speedup in the number of workers can be expected.

    Thesis Download (PDF)

Papers covered by this thesis

Journal Papers

  1. H. R. Feyzmahdavian, A. Aytekin, M. Johansson, “ An Asynchronous Mini-Batch Algorithm for Regularized Stochastic Optimization ”, Submitted. [arXiv]

  2. H. R. Feyzmahdavian, T. Charalambous, M. Johansson, “ Asymptotic Stability and Decay Rates of Homogeneous Positive Systems with Bounded and Unbounded Delays ”, SIAM Journal on Control and Optimization, 2014. [SIAM][arXiv]

  3. H. R. Feyzmahdavian, T. Charalambous, M. Johansson, “ Stability and Performance of Continuous-Time Power Control in Wireless Networks ”, IEEE Transactions on Automatic Control, 2014. [IEEEXplore][pdf]

  4. H. R. Feyzmahdavian, T. Charalambous, M. Johansson, “ Exponential Stability of Homogeneous Positive Systems of Degree One with Time-Varying Delays ”, IEEE Transactions on Automatic Control, 2014. [IEEEXplore][arXiv]

  5. H. R. Feyzmahdavian, M. Johansson, T. Charalambous, “ Contractive Interference Functions and Rates of Convergence of Distributed Power Control Laws ”, IEEE Transactions on Wireless Communications, 2012.[IEEEXplore][arXiv]

Conference Papers

  1. H. R. Feyzmahdavian, A. Aytekin, M. Johansson, “ An Asynchronous Mini-Batch Algorithm for Regularized Stochastic Optimization”, 54th IEEE Conference on Decision and Control, Osaka , Japan, December 2015.

  2. H. R. Feyzmahdavian, M. Johansson, “ On the Convergence Rates of Asynchronous Iterations”, 53rd IEEE Conference on Decision and Control, Los Angeles, California, USA, December 2014. [IEEEXplore][pdf] [slides]

  3. H. R. Feyzmahdavian, T. Charalambous, M. Johansson, “ Sub-homogeneous Positive Monotone Systems are Insensitive to Heterogeneous Time-Varying Delays ”, in Proc. of the 21st International Symposium on Mathematical Theory of Networks and Systems (MTNS), Groningen, the Netherlands, July 2014. [MTNS][arXiv]

  4. H. R. Feyzmahdavian, T. Charalambous, M. Johansson, “ Asymptotic Stability and Decay Rates of Positive Linear Systems with Unbounded Delays ”, 52st IEEE Conference on Decision and Control, Florence, Italy, December 10-13, 2013. [IEEEXplore][pdf]

  5. H. R. Feyzmahdavian, T. Charalambous, M. Johansson, “ Asymptotic and Exponential Stability of a General Class of Continuous-Time Power Control Laws in Wireless Networks ”, 52st IEEE Conference on Decision and Control, Florence, Italy, December 10-13, 2013. [IEEEXplore][pdf]

  6. H. R. Feyzmahdavian, T. Charalambous, M. Johansson, “ On the Rate of Convergence of Continuous-Time Linear Positive Systems with Heterogeneous Time-Varying Delays ”, European Control Conference (ECC13), Switzerland, July 2013. [IEEEXplore][pdf]

  7. H. R. Feyzmahdavian, M. Johansson, T. Charalambous, “ Contractive Interference Functions and Rates of Convergence of Distributed Power Control Laws ”, IEEE International Conference on Communications (ICC), June 10-15, 2012, Ottawa, Canada (Best Paper Award). [IEEEXplore][arXiv]