Introduction

Deep Learning Basics

Word embeddings

• Mikolov et al. (2013a), Efficient estimation of word representations in vector space
• Mikolov et al. (2013b), Distributed representations of words and phrases and their compositionality
• Xin Rong, word2vec parameter learning explained

Convolutional and recurrent NNs

• Goodfellow et al. (2016a), Deep Learning Book - Chapter 9 (CNNs), sections 9.6ff are optional
• Goodfellow et al. (2016b), Deep Learning Book - Chapter 10 (RNNs), mainly up to 10.6

More on recurrent NNs

Attention

• Sutskever et al. (2014), Sequence to Sequence Learning with Neural Networks
• Bahdanau et al. (2015), Neural machine translation by jointly learning to align and translate

Questions and project discussion