ruder.io
The State of Transfer Learning in NLP
13+ min · · This post expands on the NAACL 2019 tutorial on Transfer Learning in NLP. It highlights key insights and takeaways and provides updates based on recent work. · Shared by 24, including Alexander Seifert, Mark Tabladillo PhD, Pete Skomoroch
pouannes.github.io
How to initialize deep neural networks? Xavier and Kaiming initialization
14+ min · · Initialization of neural networks isn’t something we think a lot about nowadays. It’s all hidden behind the different Deep Learning frameworks we use, like TensorFlow or PyTorch. However, it’s at the… · Shared by 4, including Alexander Seifert
prateekvjoshi.com
Understanding Xavier Initialization In Deep Neural Networks
4 min · · I recently stumbled upon an interesting piece of information when I was working on deep neural networks. I started thinking about initialization of network weights and the theory behind it. Does th… · Shared by 4, including Alexander Seifert
colah.github.io
Visual Information Theory
· I love the feeling of having a new way to think about the world. I especially love when there’s some vague idea that gets formalized into a concrete concept. Information theory is a prime example of… · Shared by 40, including rohit, sircharlsxavier, 瑞拿頭, Gordon, Alexander Seifert, kaywa, Jeff Ammons