LRN(Local Response Normalization)
- applied this normalization after applying the ReLU nonlinearity in certain layers
Overlapping Pooling
- We generally observe during training that models with overlapping pooling find it slightly more difficult to overfit
Overall Architecture
Data Augmentation
- image translations
- horizontal reflections
- perform PCA on the set of RGB pixel values