• Login
    View Item 
    •   SMARTech Home
    • Georgia Tech Theses and Dissertations
    • Georgia Tech Theses and Dissertations
    • View Item
    •   SMARTech Home
    • Georgia Tech Theses and Dissertations
    • Georgia Tech Theses and Dissertations
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Stochastic nonlinear control: A unified framework for stability, dissipativity, and optimality

    Thumbnail
    View/Open
    RAJPUROHIT-DISSERTATION-2018.pdf (3.336Mb)
    Date
    2018-02-06
    Author
    Rajpurohit, Tanmay
    Metadata
    Show full item record
    Abstract
    In this work, we develop connections between stochastic stability theory and stochastic optimal control. In particular, first we develop Lyapunov and converse Lyapunov theorems for stochastic semistable nonlinear dynamical systems. Semistability is the property whereby the solutions of a stochastic dynamical system almost surely converge to (not necessarily isolated) Lyapunov stable in probability equilibrium points determined by the system initial conditions. Then we develop a unified framework to address the problem of optimal nonlinear analysis and feedback control for nonlinear stochastic dynamical systems. Specifically, we provide a simplified and tutorial framework for stochastic optimal control and focus on connections between stochastic Lyapunov theory and stochastic Hamilton-Jacobi-Bellman theory. In particular, we show that asymptotic stability in probability of the closed-loop nonlinear system is guaranteed by means of a Lyapunov function which can clearly be seen to be the solution to the steady-state form of the stochastic Hamilton-Jacobi-Bellman equation, and hence, guaranteeing both stochastic stability and optimality. Moreover, extensions to stochastic finite-time and partial-state stability and optimal stabilization are also addressed. Finally, we extended the notion of dissipativity theory for deterministic dynamical systems to controlled Markov diffusion processes and show the utility of the general concept of dissipation for stochastic systems.
    URI
    http://hdl.handle.net/1853/59856
    Collections
    • Georgia Tech Theses and Dissertations [23877]
    • School of Aerospace Engineering Theses and Dissertations [1440]

    Related items

    Showing items related by title, author, creator and subject.

    • Large scale stochastic control: Algorithms, optimality and stability 

      Bakshi, Kaivalya Sanjeev (Georgia Institute of Technology, 2018-11-29)
      Optimal control of large-scale multi-agent networked systems which describe social networks, macro-economies, traffic and robot swarms is a topic of interest in engineering, biophysics and economics. A central issue is ...
    • Finite Time Stability, Semistability, and Optimality of Discrete-Time Nonlinear Deterministic and Stochastic Dynamical Systems with Application to Network Consensus 

      Lee, Junsoo (Georgia Institute of Technology, 2022-06-06)
      In this dissertation, we develop Lyapunov theorems for finite time and fixed time stability of discrete-time nonlinear dynamical systems. The regularity properties of the Lyapunov functions satisfying the sufficient ...
    • Stochastic dynamical system identification applied to combustor stability margin assessment 

      Cordeiro, Helio de Miranda (Georgia Institute of Technology, 2008-12-16)
      A new approach was developed to determine the operational stability margin of a laboratory scale combustor. Applying modern and robust techniques and tools from Dynamical System Theory, the approach was based on three basic ...

    Browse

    All of SMARTechCommunities & CollectionsDatesAuthorsTitlesSubjectsTypesThis CollectionDatesAuthorsTitlesSubjectsTypes

    My SMARTech

    Login

    Statistics

    View Usage StatisticsView Google Analytics Statistics
    facebook instagram twitter youtube
    • My Account
    • Contact us
    • Directory
    • Campus Map
    • Support/Give
    • Library Accessibility
      • About SMARTech
      • SMARTech Terms of Use
    Georgia Tech Library266 4th Street NW, Atlanta, GA 30332
    404.894.4500
    • Emergency Information
    • Legal and Privacy Information
    • Human Trafficking Notice
    • Accessibility
    • Accountability
    • Accreditation
    • Employment
    © 2020 Georgia Institute of Technology