Scribd
Upload
124 views

Cs3027 Deep Learning Syllabus

This document provides an overview of a course on deep learning. The course aims to teach students how to apply deep learning techniques to problems in computer vision and natural language processing. It is a 3 credit course that requires machine learning as a prerequisite. The course covers topics like convolutional neural networks, unsupervised deep learning, deep learning applications in computer vision and natural language processing. It includes 4 units covering these topics over 45 contact hours. The document lists textbooks and reference papers for the course.

Uploaded by

vasu dev
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
124 views

Cs3027 Deep Learning Syllabus

This document provides an overview of a course on deep learning. The course aims to teach students how to apply deep learning techniques to problems in computer vision and natural language processing. It is a 3 credit course that requires machine learning as a prerequisite. The course covers topics like convolutional neural networks, unsupervised deep learning, deep learning applications in computer vision and natural language processing. It includes 4 units covering these topics over 45 contact hours. The document lists textbooks and reference papers for the course.

Uploaded by

vasu dev
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 2

DEEP LEARNING L T P C

Total Contact Hours - 45 3 0 0 3


CS3027
Prerequisite

Machine Learning

PURPOSE

To learn how deep learning can be applied to real worldComputer vision problems.

INSTRUCTIONAL OBJECTIVE

1 Be able to take on projects such as image classification and


Object detection.

2 Be able to train the different CNN networks on large scale datasets.

3 Be able to participate in state-of-the-art image classification challenges and


competitions.

UNIT-I INTRODUCTION (6 hrs)


Feed forward Neural networks - Gradient descent - Back propagation algorithm - Activation
Functions - ReLU Heuristics for avoiding bad local minima - Regularization.

UNIT-II CONVOLUTIONAL NEURAL NETWORKS (10 hrs)


CNN building blocks – common architecture – Training Pattern - LSTM - GRU - Encoder
Decoder architectures – LeNet – miniVGGNet – learning rate scheduler - Spotting under
fitting and over fitting – Architecture visualization

UNIT-III DEEP UNSUPERVISED LEARNING (9 hrs)


Auto encoders(standard, sparse, de noising, contractive) - Variational Auto encoders-
Adversarial Generative Networks - Auto encoder and DBM - Attention and memory models -
Dynamic memory networks

UNIT-IV DEEP LEARNING IN COMPUTER VISION (8 hrs)


Image segmentation - Object detection –Classification pipeline - Automatic image captioning
- Image generation with Generative adversarial networks- LSTM models - Attention models
for computer vision tasks.

UNIT-V APPLICATIONS OF DEEP LEARNING TO NLP (12 hrs)


Introduction to NLP and Vector Space Model of Semantics - Word Vector Representations
(Continuous Skip-Gram Model, Continuous Bag-of-Words model (CBOW), Glove) – Smile
Detection -Sentence Classification using Convolutional Neural Networks - Dialogue
Generation with LSTMs.
Total : 45 hrs
Text Books:
1. Dr.AdrianRosebrock“Deep learning for computer vision with python”.StarterBundle,
ST
I Edition.2017.
2. Bengio, Yoshua, Ian J. Goodfellow, and Aaron Courville. "Deep learning" An MIT
Press book in preparation. (2015).

Reference Papers:

1. Bengio, Yoshua. "Learning deep architectures for AI." Foundations and trends in
Machine Learning 2.1 (2009): 1127.
2. Hochreiter, Sepp, and JargenSchmidhuber. "Long short-term memory." Neural
computation 9.8 (1997): 17351780.
3. Oquab, Maxime, et al. "Learning and transferring midlevel image representations
using convolutional neural networks." Proceedings of the IEEE conference on computer
vision and pattern recognition. 2014.
4. Bengio, Yoshua, et al. "A neural probabilistic language model." journal of machine
learning research 3.Feb (2003).
5. Collobert, Ronan, et al. "Natural language processing (almost) from scratch." Journal
of Machine Learning Research 12.Aug (2011): 2493-2537.
6. Mikolov, Tomas, et al. "Efficient estimation of word representations in vector space."
arXiv preprint arXiv:1301.3781 (2013).
7. Pennington, Jeffrey, Richard Socher, and Christopher D. Manning. "Glove: Global
Vectors for Word Representation."EMNLP. Vol. 14.
8. Kim, Yoon. "Convolutional neural networks for sentence classification." EMNLP
(2014).
9. Oquab, Maxime, et al. "Learning and transferring mid-level image representations
using convolutional neural networks." Proceedings of the IEEEconference on computer
vision and pattern recognition. 2014.
10. Kumar, Ankit, et al. "Ask me anything: Dynamic memory networks for natural
language processing." arXiv preprint arXiv:1506.07285 (2015). Sutskever, Ilya,
OriolVinyals, and Quoc V. Le. "Sequence to sequencelearning with neural networks."
Advances in neural information processing systems. 2014.
11. Kalchbrenner, Nal, Edward Grefenstette, and Phil Blunsom. "A convolutional neural
network for modelling sentences." ACL (2014).
12. Socher, Richard, et al. "Recursive deep models for semantic compositionality over a
sentiment treebank." Proceedings of the conference on empirical methods in natural language
processing (EMNLP). Vol. 1631. 2013.
13. Socher, Richard, et al. "Parsing with Compositional Vector Grammars."
ACL. 2013.
14. Abadi, Martın, et al. "Tensorflow: Large-scale machine learning on heterogeneous
distributed systems." arXiv preprint arXiv:1603.04467 (2016).

You might also like