ResNet

HighwayNet

ResidualConnection

IdentityMap in ResNet

Improving Inception

Multiplicative LSTM

Role of RNN for Image Caption Generation

Initialization DNN

Net2Net

Regularization: https://openreview.net/pdf?id=BJRIA3Fgg https://www.aaai.org/ocs/index.php/AAAI/AAAI16/paper/view/11840/11800 https://openreview.net/pdf?id=HkO-PCmYl