Machine Learning (EC 332) - Department of Computer Science

Course Title: Machine Learning
Course Code: EC 332
Credits: 3
Instructor: Dr. Nazar Khan
Semester: Spring 2025
Location: FCIT, Allama Iqbal Campus, Room 9
Class Times: Tuesdays and Thursdays, 10:15 AM - 11:45 AM
Join Google Classroom 		Textbook:
Deep Learning: Foundations and Concepts (Bishop)
by Chris Bishop and Hugh Bishop.
Springer Nature
2024
dlfaccover 		Reference Books:
  1. Machine Learning: A Probabilistic Perspective (Murphy), Kevin P. Murphy, MIT Press, 2022.
  2. Reinforcement Learning: An Introduction (Sutton), 2nd Edition, Richard S. Sutton and Andrew G. Barto, MIT Press, 2018.
  3. Data Mining and Machine Learning: Fundamental Concepts and Algorithms (Zaki), 2nd Edition, Mohammed J. Zaki, Wagner Meira, Jr., Cambridge University Press, 2020.

dlfaccover
dlfaccover
dlfaccover

Welcome to the Machine Learning course page! Machine learning is a field of AI that focuses on the development of algorithms that can learn from and make predictions on data. In this course, you will study both the theoretical underpinnings and practical applications of machine learning techniques. This course covers the theory and practice of supervised learning, unsupervised learning, neural networks, deep learning, and reinforcement learning.

Lectures

Lecture No. Topics Covered Reading Material Quiz/Assign./H.W./Project
1 Introduction to Machine Learning
Introduction to Neural Computation 		Bishop 1.1
2 Brief History of Machine Learning Bishop 1.3
3 Curve Fitting Bishop 1.2 Quiz 1
Tutorial 1: Linear Regression
4 Rules of Probability Bishop 2.1
5 Statistics Bishop 2.2
6 Gaussian Distribution and Maximum-Likelihood Bishop 2.3, 3.2, 4.1 Quiz 2
Tutorial 2: Gaussian Density Estimation
7 Matrix Calculus Bishop Appendix A, C Quiz 3
8 Universal Approximation Theorem Quiz 4
9 Loss Functions and Activation Functions for Machine Learning Bishop 6.4 Quiz 5
10 Neural Networks Bishop 6.3 Quiz 6
11 Backpropagation and Vanishing Gradients Bishop 6.3 Quiz 7
12 Gradient Descent and its Variations Bishop Ch 7 Quiz 8
13 Momentum-based Gradient Descent Bishop Ch 7
14 Automatic Differentiation Bishop 8.2 Quiz 10
Tutorial 3: Neural Network using PyTorch
Mid-term Exam
15 Regularization Bishop Ch 9
16 Convolutional Neural Networks (CNNs) Bishop 10.2 Assignment 1
17 Variations of CNNs
18 Transformers Bishop 12.1
19 Transformer Language Models Bishop 12.2, 12.3 Tutorial 4: Sentiment Classification using a Transformer
Assignment 2
20 K-Means Clustering Bishop 15.1 Tutorial 5: K-Means Clustering with Automatic Estimattion of K
21 Gaussian Mixture Models Bishop 15.2 Assignment 3
20 DBSCAN Zaki 15.1 Tutorial 6: Clustering via DBSCAN
Project 1
21 Principal Component Analysis Bishop 16.1 Tutorial 7: Face Recognition via PCA
22 Generative Adversarial Networks Bishop Ch 17
23 Reinforcement Learning: Q-Learning
UntrainedTrained
Slides Tutorial 8: CartPole Balancing using Q-Learning, (HTML, PDF)
Untrained agent, Trained agent
24 Deep Q-Learning
UntrainedTrained
Slides Tutorial 9: CartPole Balancing using Deep Q-Learning, (HTML, PDF)
Untrained DQN agent, Trained DQN agent
25 Bandit Problems vs QL DQL Slides
Final-term Exam

Grading

Assignments Project Quizzes Midterm Exam Final Exam
Weight 12% 8% 5% 35% 40%