Normalization LayerΒΆ
Implementing normalization was much simpler than using theano. All I had to do was
output = tf.nn.lrn(input)
tf.nn.lrn()
is an implementation of the local response normalization [LS08].
This layer definition could also be found in the lenet.layers.local_response_normalization_layer()
method.