pdfcoffee

Advanced Convolutional Neural Networks
Summary
In this chapter we have seen many applications of CNNs across very different
domains, from traditional image processing and computer vision, to close-enough
video processing, to not-so-close audio processing and text processing. In a relatively
few number of years, CNNs took machine learning by storm.
Nowadays it is not uncommon to see multimodal processing, where text, images,
audio, and videos are considered together to achieve better performance, frequently
by means of CNNs together with a bunch of other techniques such as RNNs and
reinforcement learning. Of course, there is much more to consider, and CNNs have
recently been applied to many other domains such as Genetic inference [13], which
are, at least at first glance, far away from the original scope of their design.
In this chapter, we have discussed all the major variants of ConvNets. In the next
chapter, we will introduce Generative Nets: one of the most innovative deep learning
architectures yet.
References
1. J. Yosinski and Y. B. J Clune, How transferable are features in deep neural
networks?, in Advances in Neural Information Processing Systems 27, pp. 3320–
3328.
2. C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, Rethinking
the Inception Architecture for Computer Vision, in 2016 IEEE Conference on
Computer Vision and Pattern Recognition (CVPR), pp. 2818–2826.
3. M. Sandler, A. Howard, M. Zhu, A. Zhmonginov, L. C. Chen, MobileNetV2:
Inverted Residuals and Linear Bottlenecks (2019), Google Inc.
4. A Krizhevsky, I Sutskever, GE Hinton, ImageNet Classification with Deep
Convolutional Neural Networks, 2012
5. Gao Huang, Zhuang Liu, Laurens van der Maaten, Kilian Q. Weinberger,
Densely Connected Convolutional Networks, 28 Jan 2018 http://arxiv.org/
abs/1608.06993.
6. François Chollet, Xception: Deep Learning with Depthwise Separable
Convolutions, 2017, https://arxiv.org/abs/1610.02357.
7. Leon A. Gatys, Alexander S. Ecker, Matthias Bethge, A Neural Algorithm
of Artistic Style, 2016, https://arxiv.org/abs/1508.06576.
8. Mordvintsev, Alexander; Olah, Christopher; Tyka, Mike. DeepDream -
a code example for visualizing Neural Networks. Google Research, 2015.
[ 188 ]