MTech Deep Learning Syllabus
MTech Deep Learning Syllabus
L T P C
II Year - I Semester
3 0 0 3
Deep Learning
Course Objectives:
At the end of the course, the students will be expected to:
Learn deep learning methods for working with sequential data,
Learn deep recurrent and memory networks,
Learn deep Turing machines,
Apply such deep learning mechanisms to various learning problems.
Know the open issues in deep learning, and have a grasp of the current research directions.
Course Outcomes:
After the completion of the course, student will be able to
Demonstrate the basic concepts fundamental learning techniques and layers.
Discuss the Neural Network training, various random models.
Explain different types of deep learning network models.
Classify the Probabilistic Neural Networks.
Implement tools on Deep Learning techniques.
UNIT I: Introduction: Various paradigms of learning problems, Perspectives and Issues in deep learning
framework, review of fundamental learning techniques. Feed forward neural network: Artificial Neural
Network, activation function, multi-layer neural network.
UNIT II: Training Neural Network: Risk minimization, loss function, back propagation,
regularization, model selection, and optimization.
Conditional Random Fields: Linear chain, partition function, Markov network, Belief propagation,
Training CRFs, Hidden Markov Model, Entropy.
UNIT III: Deep Learning: Deep Feed Forward network, regularizations, training deep models, dropouts,
Convolution Neural Network, Recurrent Neural Network, and Deep Belief Network.
UNIT IV: Probabilistic Neural Network: Hopfield Net, Boltzmann machine, RBMs, Sigmoid net,
Auto encoders.
UNIT V: Applications: Object recognition, sparse coding, computer vision, natural language
processing. Introduction to Deep Learning Tools: Caffe, Theano, Torch.
Text Books:
1. Goodfellow, I., Bengio,Y., and Courville, A., Deep Learning, MIT Press, 2016..
2. Bishop, C. ,M., Pattern Recognition and Machine Learning, Springer, 2006.
Reference Books:
1. Artificial Neural Networks, Yegnanarayana, B., PHI Learning Pvt. Ltd, 2009.
2. Matrix Computations, Golub, G.,H., and Van Loan,C.,F, JHU Press,2013.
3. Neural Networks: A Classroom Approach, Satish Kumar, Tata McGraw-Hill Education, 2004.