• Login
    View Item 
    •   SMARTech Home
    • Georgia Tech Theses and Dissertations
    • Georgia Tech Theses and Dissertations
    • View Item
    •   SMARTech Home
    • Georgia Tech Theses and Dissertations
    • Georgia Tech Theses and Dissertations
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Learning Nash equilibria in zero-sum stochastic games via entropy-regularized policy approximation

    Thumbnail
    View/Open
    ZHANG-THESIS-2020.pdf (2.238Mb)
    Date
    2020-07-27
    Author
    Zhang, Qifan
    Metadata
    Show full item record
    Abstract
    In this thesis, we explore the use of policy approximation for reducing the computational cost of learning Nash Equilibria in Multi-Agent Reinforcement Learning. Existing multi-agent reinforcement learning methods are either computationally demanding or do not necessarily converge to a Nash Equilibrium without additional stringent assumptions. We propose a new algorithm for zero-sum stochastic games in which each agent simultaneously learns a Nash policy and an entropy-regularized policy.The two policies help each other towards convergence: the former guides the latter to the desired Nash equilibrium, and the latter serves as an efficient approximation of the former. We demonstrate the possibility of transferring previous training experience to a different environment, which enables the agents to adapt quickly. We also provide a dynamic hyper-parameter scheduling scheme for further expedited convergence. Empirical results applied to a number of stochastic games show that the proposed algorithm converges to the Nash equilibrium while exhibiting an order of magnitude speed-up over existing algorithms.
    URI
    http://hdl.handle.net/1853/63651
    Collections
    • College of Computing Theses and Dissertations [1134]
    • Georgia Tech Theses and Dissertations [23127]

    Browse

    All of SMARTechCommunities & CollectionsDatesAuthorsTitlesSubjectsTypesThis CollectionDatesAuthorsTitlesSubjectsTypes

    My SMARTech

    Login

    Statistics

    View Usage StatisticsView Google Analytics Statistics
    facebook instagram twitter youtube
    • My Account
    • Contact us
    • Directory
    • Campus Map
    • Support/Give
    • Library Accessibility
      • About SMARTech
      • SMARTech Terms of Use
    Georgia Tech Library266 4th Street NW, Atlanta, GA 30332
    404.894.4500
    • Emergency Information
    • Legal and Privacy Information
    • Human Trafficking Notice
    • Accessibility
    • Accountability
    • Accreditation
    • Employment
    © 2020 Georgia Institute of Technology