论文标题

D2RL:强化学习中的深度建筑

D2RL: Deep Dense Architectures in Reinforcement Learning

论文作者

Sinha, Samarth, Bharadhwaj, Homanga, Srinivas, Aravind, Garg, Animesh

论文摘要

尽管深度学习体系结构的改进在改善计算机视觉和自然语言处理中的监督和无监督学习的状态方面发挥了至关重要的作用,但用于增强学习的神经网络体系结构选择仍然相对较小。我们从计算机视觉和生成建模中成功的建筑选择中汲取灵感,并研究更深的网络和密集连接在各种模拟的机器人学习基准环境上的增强学习。我们的发现表明,目前的方法从密集的连接和更深的网络,跨越一系列的操纵和运动任务中都受益匪浅。我们希望我们的结果能够成为强大的基准,并进一步激发对增强学习神经网络体系结构的未来研究。带代码的项目网站在此链接上https://sites.google.com/view/d2rl/home。

While improvements in deep learning architectures have played a crucial role in improving the state of supervised and unsupervised learning in computer vision and natural language processing, neural network architecture choices for reinforcement learning remain relatively under-explored. We take inspiration from successful architectural choices in computer vision and generative modelling, and investigate the use of deeper networks and dense connections for reinforcement learning on a variety of simulated robotic learning benchmark environments. Our findings reveal that current methods benefit significantly from dense connections and deeper networks, across a suite of manipulation and locomotion tasks, for both proprioceptive and image-based observations. We hope that our results can serve as a strong baseline and further motivate future research into neural network architectures for reinforcement learning. The project website with code is at this link https://sites.google.com/view/d2rl/home.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源