Human Robot Collaboration

Learning Diverse Strategies for Human Robot Collaboration via GAIL

This is a GaTech course research project that focus on Human-robot collaboration. Here’s the project paper link: Learning Diverse Strategies for Human Robot Collaboration via GAIL.

Abstract

Human-robot collaboration will largely improve human efficiency in the future. But it’s a hard problem for the robot to sense the diverse strategies that human could adopt and take corresponding actions. A recent approach provides a possible solution to this problem. The Co-GAIL method, which can handle diverse human behaviors for training robot assistants, optimizes human and robot strategies collaboratively during interactive learning. In this paper, we improved the actual collaboration experience between human and robot by proposing two alphas. One is to create a more separable strategy space for the Co-GAIL method. The other one is to introduce a pre-trained role detector to make the flexible switch between human and robot be possible. We don’t see a clear improvement in the alpha-1, but a follow-up experiments could indirectly explain the possible reasons. But alpha-2 achieves a nearly similar performance as a pre-defined upper bound.

Methodology

On the left, Co-GAIL architecture. On the right, role detector architecture.

Results

On the left, successful rate with respect to the number of epochs. On the right, comparison between upper bound and alpha-2.