RLlib: Abstractions for Distributed Reinforcement Learning (original) (raw)
Abstract:Reinforcement learning (RL) algorithms involve the deep nesting of highly irregular computation patterns, each of which typically exhibits opportunities for distributed computation. We argue for distributing RL components in a composable way by adapting algorithms for top-down hierarchical control, thereby encapsulating parallelism and resource requirements within short-running compute tasks. We demonstrate the benefits of this principle through RLlib: a library that provides scalable software primitives for RL. These primitives enable a broad range of algorithms to be implemented with high performance, scalability, and substantial code reuse. RLlib is available at this https URL.
Submission history
From: Richard Liaw [view email]
[v1] Tue, 26 Dec 2017 19:43:59 UTC (1,130 KB)
[v2] Wed, 10 Jan 2018 02:40:19 UTC (1,130 KB)
[v3] Mon, 19 Mar 2018 00:01:53 UTC (1,577 KB)
[v4] Fri, 29 Jun 2018 00:19:24 UTC (1,747 KB)