• Login
    View Item 
    •   SMARTech Home
    • Georgia Tech Theses and Dissertations
    • Georgia Tech Theses and Dissertations
    • View Item
    •   SMARTech Home
    • Georgia Tech Theses and Dissertations
    • Georgia Tech Theses and Dissertations
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Manipulating state space distributions for sample-efficient imitation-learning

    Thumbnail
    View/Open
    SCHROECKER-DISSERTATION-2020.pdf (3.928Mb)
    Date
    2020-03-16
    Author
    Schroecker, Yannick Karl Daniel
    Metadata
    Show full item record
    Abstract
    Imitation learning has emerged as one of the most effective approaches to train agents to act intelligently in unstructured and unknown domains. On its own or in combination with reinforcement learning, it enables agents to copy the expert's behavior and to solve complex, long-term decision making problems. However, to utilize demonstrations effectively and learn from a finite amount of data, the agent needs to develop an understanding of the environment. This thesis investigates estimators of the state-distribution gradient as a means to influence which states the agent will see and thereby guide it to imitate the expert's behavior. Furthermore, this thesis will show that approaches which reason over future states in this way are able to learn from sparse signals and thus provide a way to effectively program agents. Specifically, this dissertation aims to validate the following thesis statement: Exploiting inherent structure in Markov chain stationary distributions allows learning agents to reason about likely future observations, and enables robust and efficient imitation learning, providing an effective and interactive way to teach agents from minimal demonstrations.
    URI
    http://hdl.handle.net/1853/62755
    Collections
    • College of Computing Theses and Dissertations [1191]
    • Georgia Tech Theses and Dissertations [23878]
    • School of Interactive Computing Theses and Dissertations [144]

    Related items

    Showing items related by title, author, creator and subject.

    • On sparse representations and new meta-learning paradigms for representation learning 

      Mehta, Nishant A. (Georgia Institute of Technology, 2013-05-15)
      Given the "right" representation, learning is easy. This thesis studies representation learning and meta-learning, with a special focus on sparse representations. Meta-learning is fundamental to machine learning, and it ...
    • USING A HANDS-ON ROBOTICS PROJECT TO AFFECT SKILL DEVELOPMENT IN A CONTROL ANALYSIS COURSE 

      Inghilleri, Niccolo (Georgia Institute of Technology, 2021-05-05)
      This study aims to assess the impact on skill development of a hands-on experimentation and learning device within the undergraduate aerospace control analysis curriculum at Georgia Institute of Technology. The Transportable ...
    • New insights on the power of active learning 

      Berlind, Christopher (Georgia Institute of Technology, 2015-07-22)
      Traditional supervised machine learning algorithms are expected to have access to a large corpus of labeled examples, but the massive amount of data available in the modern world has made unlabeled data much easier to ...

    Browse

    All of SMARTechCommunities & CollectionsDatesAuthorsTitlesSubjectsTypesThis CollectionDatesAuthorsTitlesSubjectsTypes

    My SMARTech

    Login

    Statistics

    View Usage StatisticsView Google Analytics Statistics
    facebook instagram twitter youtube
    • My Account
    • Contact us
    • Directory
    • Campus Map
    • Support/Give
    • Library Accessibility
      • About SMARTech
      • SMARTech Terms of Use
    Georgia Tech Library266 4th Street NW, Atlanta, GA 30332
    404.894.4500
    • Emergency Information
    • Legal and Privacy Information
    • Human Trafficking Notice
    • Accessibility
    • Accountability
    • Accreditation
    • Employment
    © 2020 Georgia Institute of Technology