Search |  Contact |  SRI Home Do not follow this link, or your host will be blocked from this site. This is a spider trap. Do not follow this link, or your host will be blocked from this site. This is a spider trap. Do not follow this link, or your host will be blocked from this site. This is a spider trap.A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A ASRI International.  333 Ravenswood Avenue.  Menlo Park, CA 94025-3493. SRI International is a nonprofit corporation.

AIC Seminar Series

Planning and Learning with Abstract Markov Decision Processes

Marie desJardinsUniversity of Maryland, Baltimore County[Home Page]

Notice:  Hosted by Karen Myers

Date:  Friday, February 3rd 2017 at 10:30am

Location:  EK255 (SRI E building)  (Directions)


Robots acting in human-scale environments must plan under uncertainty in large state–action spaces and face constantly changing reward functions as requirements and goals change. We introduce a new hierarchical planning framework called Abstract Markov Decision Processes (AMDPs) that can plan in a fraction of the time needed for complex decision making in ordinary MDPs. AMDPs provide abstract states, actions, and transition dynamics in multiple layers above a base-level “flat” MDP. AMDPs decompose problems into a series of subtasks with both local reward and local transition functions used to create policies for subtasks. The resulting hierarchical planning method is independently optimal at each level of abstraction, and is recursively optimal when the local reward and transition functions are correct.

I will present empirical results in several domains showing significantly improved planning speed, while maintaining solution quality. I will also discuss related work within the same project on automated option discovery, abstraction construction, language learning, and initial steps towards automated methods for learning AMDPs from base MDPs, from teacher demonstrations, and from direct observations in the domain.

If time permits, I will also discuss recent work at UMBC and in Maryland on the state of K-12 CS education, particularly focusing on the new AP CS Principles course and the recently published draft K-12 CS framework.

This work is collaborative research with Dr. Michael Littman and Dr. Stefanie Tellex of Brown University, and Dr. Smaranda Muresan of Columbia University. Dr. James MacGlashan of SIFT and Dr. Smaranda Muresan of Columbia University collaborated on earlier stages of the project. The following UMBC students have also contributed to the project: Tadewos Bellete, Michael Bishoff, Rose Carignan, Nick Haltemeyer, Nathaniel Lam, Shawn Squire, Tenji Tembo, Nicholay Topin, and John Winder.

   Bio for Marie desJardins

Dr. Marie desJardins is a Professor of Computer Science and the Associate Dean for Academic Affairs in the College of Engineering and Information Technology at the University of Maryland, Baltimore County. Prior to joining the faculty at UMBC in 2001, she was a Senior Computer Scientist in the AI Center at SRI International. Her research is in artificial intelligence, focusing on the areas of machine learning, multi-agent systems, planning, interactive AI techniques, information management, reasoning with uncertainty, and decision theory. Current research projects include learning in the context of planning and decision making, intelligent tutoring systems, and analyzing and visualizing uncertainty in machine learning.

As a 2014-15 American Council of Education Fellow, Dr. desJardins spent a semester at Worcester Polytechnic Institute working with President Laurie Leshin studying academic leadership, institutional transformation, and data-driven decision making. She was the 2014-17 UMBC Presidential Teaching Professor and an inaugural Hrabowski Academic Innovation Fellow. She is active in the computer science education community, and leads the CS Matters in Maryland project to develop curriculum and train high school teachers to teach the new AP CS Principles course.

Dr. desJardins has published over 120 scientific papers in journals, conferences, and workshops. She was recently elected as a Member-at-Large-elect for Section T (Information, Computing, and Communication) of the American Association for the Advancement of Science. She is an Associate Editor of the Journal of Artificial Intelligence Research, is a member of the editorial board of AI Magazine, and was the Program Cochair for AAAI-13. She has previously served as AAAI Liaison to the Board of Directors of the Computing Research Association, Vice-Chair of ACM’s SIGART, and AAAI Councillor. She is an ACM Distinguished Member, is a AAAI Senior Member, is a member and former chair of UMBC’s Honors College Advisory Board, is the former chair of UMBC’s Faculty Affairs Committee, and serves on the advisory board of UMBC’s Center for Women in Technology.

   Note for Visitors to SRI

Please arrive at least 10 minutes early as you will need to sign in by following instructions by the lobby phone at Building E (or call Wilma Lenz at 650 859 4904, or Vicenta at Lopez at 650 859 5750). SRI is located at 333 Ravenswood Avenue in Menlo Park. Visitors may park in the parking lots off Fourth Street. Detailed directions to SRI, as well as maps, are available from the Visiting AIC web page. There are two entrances to SRI International located on Ravenswood Ave. Please check the Building E entrance signage.

SRI International
©2017 SRI International 333 Ravenswood Avenue, Menlo Park, CA 94025-3493
SRI International is an independent, nonprofit corporation. Privacy policy