Projects per year
Abstract
Solving complex planning problems has been a long-standing challenge in computer science. Learning-based subgoal search methods have shown promise in tackling these problems, but they often suffer from a lack of completeness guarantees, meaning that they may fail to find a solution even if one exists. In this paper, we propose an efficient approach to augment a subgoal search method to achieve completeness in discrete action spaces. Specifically, we augment the high-level search with low-level actions to execute a multi-level (hybrid) search, which we call complete subgoal search. This solution achieves the best of both worlds: the practical efficiency of high-level search and the completeness of low-level search. We apply the proposed search method to a recently proposed subgoal search algorithm and evaluate the algorithm trained on offline data on complex planning problems. We demonstrate that our complete subgoal search not only guarantees completeness but can even improve performance in terms of search expansions for instances that the high-level could solve without low-level augmentations. Our approach makes it possible to apply subgoal-level planning for systems where completeness is a critical requirement.
| Original language | English |
|---|---|
| Title of host publication | Advances in Neural Information Processing Systems 36 - 37th Conference on Neural Information Processing Systems, NeurIPS 2023 |
| Publisher | Curran Associates Inc. |
| Number of pages | 14 |
| ISBN (Electronic) | 978-1-7138-9992-1 |
| Publication status | Published - 2024 |
| MoE publication type | A4 Conference publication |
| Event | Conference on Neural Information Processing Systems - Ernest N. Morial Convention Center, New Orleans, United States Duration: 10 Dec 2023 → 16 Dec 2023 Conference number: 37 https://nips.cc/ |
Publication series
| Name | Advances in Neural Information Processing Systems |
|---|---|
| Publisher | Morgan Kaufmann Publishers |
| Volume | 36 |
| ISSN (Print) | 1049-5258 |
Conference
| Conference | Conference on Neural Information Processing Systems |
|---|---|
| Abbreviated title | NeurIPS |
| Country/Territory | United States |
| City | New Orleans |
| Period | 10/12/2023 → 16/12/2023 |
| Internet address |
Keywords
- reinforcement learning
- planning
- search
- subgoal search
- Hierarchical reinforcement learning model for task interleaving
Fingerprint
Dive into the research topics of 'Hybrid Search for Efficient Planning with Completeness Guarantees'. Together they form a unique fingerprint.Projects
- 2 Finished
-
Safe: Turvallinen vahvistusoppiminen epästationaarisissa ympäristöissä nopealla sopeutumisella ja häiriöennustuksella
Pajarinen, J. (Principal investigator), Zhao, Y. (Project Member) & Kostin, N. (Project Member)
01/01/2022 → 31/12/2024
Project: RCF Other
-
-: Finnish Center for Artificial Intelligence
Kaski, S. (Principal investigator)
01/01/2019 → 31/12/2022
Project: Academy of Finland: Other research funding