I am particularly interested in studying four major challenges faced by reinforcement learning agents:

  • Learning state representations for partially observable environments;
  • Building environment models that enable planning;
  • Exploring alternative ways to achieve goals;
  • Generalizing knowledge across environments.

Here is some of my work.

Before focusing on reinforcement learning, I worked on the intersection between machine learning, image analysis, and information visualization.