RNNs
Follow along on Refind to get notified when they have new links.
Collection by Dayyan Smith
Public
11
Links
datascience.stackexchange.com
Training an RNN with examples of different lengths in Keras
datascience.stackexchange.com
2020-01-04 · I am trying to get started learning about RNNs and I'm using Keras. I understand the basic premise of vanilla RNN and LSTM layers, but I'm having trouble understanding a certain technical point for
peterbloem.nl
Transformers from scratch
peterbloem.nl
20+ min read · 15 saves · 2019-08-21 · Transformers are a very exciting family of machine learning architectures. Many good tutorials exist (e.g. [1, 2]) but in the last few years, transformers have mostly become simpler, so that it is now…
devopedia.org
Attention Mechanism in Neural Networks
devopedia.org
~15 min read · 2019-11-15 · In machine translation, the encoder-decoder architecture is common. The encoder reads a sequence of words and represents it with a high-dimensional real-valued vector. This vector, often called the…
lilianweng.github.io
Attention? Attention!
lilianweng.github.io
~11 min read · 13 saves · From 2018 · Attention has been a fairly popular concept and a useful tool in the deep learning community in recent years. In this post, we are gonna look into how attent...
Towards Data Science
Attn: Illustrated Attention
Towards Data Science
~11 min read · From 2019 · Raimi Karim · Attention in GIFs and how it is used in machine translation like Google Translate
youtube.com
A friendly introduction to Recurrent Neural Networks
youtube.com
From 2017 · Luis Serrano · A friendly explanation of how computers predict and generate sequences, based on Recurrent Neural Networks. For a brush up on Neural Networks, check out this...
sites.google.com
Neural Machine Translation
sites.google.com
3 min read · 2019-12-10 · Welcome to the homepage for our ACL 2016 tutorial, with more information and updated material to supplement the official ACL page! The presenters were Thang Luong @lmthang, Kyunghyun Cho @kchonyc, and…
kurious.pub
Illustrated Guide to Recurrent Neural Networks
kurious.pub
2019-12-08 · Understand the intuition with this illustrated guide to recurrent neural networks
karpathy.github.io
The Unreasonable Effectiveness of Recurrent Neural Networks
karpathy.github.io
168 saves · From 2015 · Musings of a Computer Scientist.
victorzhou.com
An Introduction to Recurrent Neural Networks for Beginners
victorzhou.com
~19 min read · 67 saves · 2019-07-25 · Victor Zhou · A simple walkthrough of what RNNs are, how they work, and how to build one from scratch in Python.
Machine Learning Mastery
A Gentle Introduction to RNN Unrolling
Machine Learning Mastery
4 min read · From 2017 · Recurrent neural networks are a type of neural network where the outputs from previous time steps are fed as input to the current time step. This creates a network graph or circuit diagram with cycles, which can make it difficult to understand how information moves through the network. In this post, you will discover the …