The Lottery Ticket Hypothesis
THE MOTIVATION
Pruned network is difficult to train from the start.
THE MAIN WORK
This paper states “the lottery ticket hypothesis” and proposes “iterative pruning” to identify "winning tickets"
The Lottery Ticket Hypothesis
Iterative pruning
What’s more, they stressed the importance of winning ticket initialization.
LIMITATIONS
- only magnitude pruning methods used. structured puning and non-magnitude pruning methods need to be tested.
- Iterative pruning is computationally intensive, requiring training a network 15 or more times.