Show simple item record

dc.contributor.advisorKemp, Charles C.
dc.contributor.authorPark, Daehyung
dc.date.accessioned2018-05-31T18:13:18Z
dc.date.available2018-05-31T18:13:18Z
dc.date.created2018-05
dc.date.issued2018-03-16
dc.date.submittedMay 2018
dc.identifier.urihttp://hdl.handle.net/1853/59860
dc.description.abstractAssistive robots have the potential to serve as caregivers, providing assistance with activities of daily living to people with disabilities. Monitoring when something has gone wrong could help assistive robots operate more safely and effectively around people. However, the complexity of interacting with people and objects in human environments can make challenges in monitoring operations. By monitoring multimodal sensory signals, an execution monitor could perform a variety of roles, such as detecting success, determining when to switch behaviors, and otherwise exhibiting more common sense. The purpose of this dissertation is to introduce a multimodal execution monitor to improve safety and success of assistive manipulation services. To accomplish this goal, we make three main contributions. First, we introduce a data-driven anomaly detector, a part of the monitor, that reports anomalous task executions from multimodal sensory signals online. Second, we introduce a data-driven anomaly classifier that recognizes the type and cause of common anomalies through an artificial neural network after fusing multimodal features. Lastly, as the main testbed of the monitoring system, we introduce a robot-assisted feeding system for people with disabilities, using a general-purpose mobile manipulator (a PR2 robot). We evaluate the monitoring system with haptic, visual, auditory, and kinematic sensing during household tasks and human-robot interactive tasks including feeding assistance. We show multimodality improves the performance of monitoring methods by detecting and classifying a broader range of anomalies. Overall, our research demonstrates the multimodal execution monitoring system helps the assistive manipulation system to provide safe and successful assistance for people with disabilities.
dc.format.mimetypeapplication/pdf
dc.language.isoen_US
dc.publisherGeorgia Institute of Technology
dc.subjectExecution monitor
dc.subjectAssistive robot
dc.titleA multimodal execution monitor for assistive robots
dc.typeDissertation
dc.description.degreePh.D.
dc.contributor.departmentInteractive Computing
thesis.degree.levelDoctoral
dc.contributor.committeeMemberBoots, Byron
dc.contributor.committeeMemberChernova, Sonia
dc.contributor.committeeMemberRehg, James M.
dc.contributor.committeeMemberTrumbower, Randy
dc.date.updated2018-05-31T18:13:18Z


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record