How Well Do Sparse ImageNet Models Transfer?

We investigate the effect of the pruning method on transfer learning, finding that for fixed-feature transfer, sparse training method substantially improve the downstream model quality as compared to dense models.

arXiv