Danijar Hafner

TalkRL: The Reinforcement Learning Podcast

Danijar Hafner is a PhD student at the University of Toronto, and a student researcher at Google Research, Brain Team and the Vector Institute. He holds a Masters of Research from University College London.

Featured References

• A deep learning framework for neuroscience
  Blake A. Richards, Timothy P. Lillicrap , Philippe Beaudoin, Yoshua Bengio, Rafal Bogacz, Amelia Christensen, Claudia Clopath, Rui Ponte Costa, Archy de Berker, Surya Ganguli, Colleen J. Gillon , Danijar Hafner, Adam Kepecs, Nikolaus Kriegeskorte, Peter Latham , Grace W. Lindsay, Kenneth D. Miller , Richard Naud , Christopher C. Pack, Panayiota Poirazi , Pieter Roelfsema , João Sacramento, Andrew Saxe, Benjamin Scellier, Anna C. Schapiro , Walter Senn, Greg Wayne, Daniel Yamins, Friedemann Zenke, Joel Zylberberg, Denis Therien, Konrad P. Kording
• Learning Latent Dynamics for Planning from Pixels
  Danijar Hafner, Timothy Lillicrap, Ian Fischer, Ruben Villegas, David Ha, Honglak Lee, James Davidson
• Dream to Control: Learning Behaviors by Latent Imagination
  Danijar Hafner, Timothy Lillicrap, Jimmy Ba, Mohammad Norouzi
• Planning to Explore via Self-Supervised World Models
  Ramanan Sekar, Oleh Rybkin, Kostas Daniilidis, Pieter Abbeel, Danijar Hafner, Deepak Pathak

Additional References

• Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model Schrittwieser et al
• Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm Silver et al
• Shaping Belief States with Generative Environment Models for RL Gregor et al
• Model-Based Active Exploration Shyam et al

Errata

• [Robin] Around 1:37 I say "some ... world models get confused by random noise". I meant "some curiosity formulations", not "world models"