Intro to Deep Learning focusing on LSTMs and GRUs

Purpose

Provide basic background info to follow the forthcoming.

Reading suggestions

“Current Advances in Neural Networks” provides a broad overview of key concepts and issues in relation to NNs (link)” including Transformers. An overview of sequence modeling techniques and an empirical comparison of different algorithms is in “Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling” by Chung et al. (link). We shall basically be making a summary of this course to facilitate follow up of the remaining sessions.

Date

April 9th at 11.30 @ICMAT-CSIC

Facilitator

David Ríos Insua (ICMAT-CSIC)

Discussion Topics

Introduction to sequence modeling, overview of neural networks, and the role of recurrent neural networks (RNNs) in handling sequential data.

Session recording

You can watch the session here.

Slides

Available here.