This directory contains image classification model based on novel regularizer rooted in Local Rademacher Complexity (LRC). The regularization by LRC and [DARTS](https://arxiv.org/abs/1806.09055) are combined in this model and it achieves 97.3% accuracy on CIFAR-10 dataset.
Regularization of Deep Neural Networks(DNNs) for the sake of improving their generalization capability is important and chllenging. This directory contains image classification model based on a novel regularizer rooted in Local Rademacher Complexity (LRC). We appreciate the contribution by [DARTS](https://arxiv.org/abs/1806.09055) for our research. The regularization by LRC and DARTS are combined in this model on CIFAR-10 dataset. Code accompanying the paper
> [An Empirical Study on Regularization of Deep Neural Networks by Local Rademacher Complexity](https://arxiv.org/abs/1902.00873)\
> Yingzhen Yang, Xingjian Li, Jun Huan.\
> _arXiv:1902.00873_.
---
---
# Table of Contents
# Table of Contents
...
@@ -7,7 +10,6 @@ This directory contains image classification model based on novel regularizer ro
...
@@ -7,7 +10,6 @@ This directory contains image classification model based on novel regularizer ro
-[Installation](#installation)
-[Installation](#installation)
-[Data preparation](#data-preparation)
-[Data preparation](#data-preparation)
-[Training](#training)
-[Training](#training)
-[Model performances](#model-performances)
## Installation
## Installation
...
@@ -66,9 +68,7 @@ After data preparation, one can start the training step by:
...
@@ -66,9 +68,7 @@ After data preparation, one can start the training step by:
* Initalize bias in batch norm and fc to zero constant and do not add bias to conv2d.
* Initalize bias in batch norm and fc to zero constant and do not add bias to conv2d.