datascience.stackexchange.com
Training an RNN with examples of different lengths in Keras
datascience.stackexchange.com
Jan 4th · I am trying to get started learning about RNNs and I'm using Keras. I understand the basic premise of vanilla RNN and LSTM layers, but I'm having trouble understanding a certain technical point for
peterbloem.nl
Transformers from scratch
peterbloem.nl
20+ min read · 13 saves · 2019-08-21 · Transformers are a very exciting family of machine learning architectures. Many good tutorials exist (e.g. [1, 2]) but in the last few years, transformers have mostly become simpler, so that it is now…
devopedia.org
Attention Mechanism in Neural Networks
devopedia.org
~15 min read · 2019-11-15 · In machine translation, the encoder-decoder architecture is common. The encoder reads a sequence of words and represents it with a high-dimensional real-valued vector. This vector, often called the…
lilianweng.github.io
Attention? Attention!
lilianweng.github.io
~11 min read · 13 saves · From 2018 · Attention has been a fairly popular concept and a useful tool in the deep learning community in recent years. In this post, we are gonna look into how attent...
Towards Data Science
Attn: Illustrated Attention
Towards Data Science
~11 min read · 2019-01-20 · Raimi Karim · Attention in GIFs and how it is used in machine translation like Google Translate
youtube.com
A friendly introduction to Recurrent Neural Networks
youtube.com
From 2017 · Luis Serrano · A friendly explanation of how computers predict and generate sequences, based on Recurrent Neural Networks. For a brush up on Neural Networks, check out this...
sites.google.com
Neural Machine Translation
sites.google.com
3 min read · 2019-12-10 · Welcome to the homepage for our ACL 2016 tutorial, with more information and updated material to supplement the official ACL page! The presenters were Thang Luong @lmthang, Kyunghyun Cho @kchonyc, and…
kurious.pub
Illustrated Guide to Recurrent Neural Networks
kurious.pub
2019-12-08 · Understand the intuition with this illustrated guide to recurrent neural networks
karpathy.github.io
The Unreasonable Effectiveness of Recurrent Neural Networks
karpathy.github.io
168 saves · From 2015 · Musings of a Computer Scientist.
victorzhou.com
An Introduction to Recurrent Neural Networks for Beginners
victorzhou.com
~19 min read · 67 saves · 2019-07-25 · Victor Zhou · A simple walkthrough of what RNNs are, how they work, and how to build one from scratch in Python.
Machine Learning Mastery
A Gentle Introduction to RNN Unrolling
Machine Learning Mastery
4 min read · From 2017 · Recurrent neural networks are a type of neural network where the outputs from previous time steps are fed as input to the current time step. This creates a network graph or circuit diagram with cycles, which can make it difficult to understand how information moves through the network. In this post, you will discover the …
