datascience.stackexchange.com
Training an RNN with examples of different lengths in Keras
1 min read · 2020-01-04 · I am trying to get started learning about RNNs and I'm using Keras. I understand the basic premise of vanilla RNN and LSTM layers, but I'm having trouble understanding a certain technical point for
peterbloem.nl
Transformers from scratch
20+ min read · From 2019 · Transformers are a very exciting family of machine learning architectures. Many good tutorials exist (e.g. [1, 2]) but in the last few years, transformers have mostly become simpler, so that it is now…
devopedia.org
Attention Mechanism in Neural Networks
~16 min read · 2019-12-14 · In machine translation, the encoder-decoder architecture is common. The encoder reads a sequence of words and represents it with a high-dimensional real-valued vector. This vector, often called the…
lilianweng.github.io
Attention? Attention!
~12 min read · From 2018 · Attention has been a fairly popular concept and a useful tool in the deep learning community in recent years. In this post, we are gonna look into how attent...
Towards Data Science
Attn: Illustrated Attention
~12 min read · From 2019 · Attention in GIFs and how it is used in machine translation like Google Translate
youtube.com
A friendly introduction to Recurrent Neural Networks
From 2019 · A friendly explanation of how computers predict and generate sequences, based on Recurrent Neural Networks. For a brush up on Neural Networks, check out this...
sites.google.com
Neural Machine Translation
3 min read · 2019-12-10 · Welcome to the homepage for our ACL 2016 tutorial, with more information and updated material to supplement the official ACL page! The presenters were Thang Luong @lmthang, Kyunghyun Cho @kchonyc, and…
kurious.pub
Illustrated Guide to Recurrent Neural Networks
2019-12-08 · Understand the intuition with this illustrated guide to recurrent neural networks
karpathy.github.io
The Unreasonable Effectiveness of Recurrent Neural Networks
From 2015 · Musings of a Computer Scientist.
victorzhou.com
An Introduction to Recurrent Neural Networks for Beginners
~20 min read · From 2019 · A simple walkthrough of what RNNs are, how they work, and how to build one from scratch in Python.
Machine Learning Mastery
A Gentle Introduction to RNN Unrolling
5 min read · From 2017 · Recurrent neural networks are a type of neural network where the outputs from previous time steps are fed as input to the current time step. This creates a network graph or circuit diagram with cycles, which can make it difficult to understand how information moves through the network. In this post, you will discover the …
