COL774: Machine Learning

General Information

Instructor: Parag Singla (email: parags AT

Class Timings (Slot F):
  • Tue, 11:00 am - 11:50am
  • Thu, 11:00 am - 11:50am
  • Fri, 11:00 am - 11:50am
Venue: LHC 526.

Teaching Assistants (TAs)
TA Assignment


  • [May 2, 2016]: Pratice Questions for the major exam available now!
  • [Apr 10, 2016]: Assignment 4 is out! It is due on Sunday May 1, 11:50 pm.
  • [Mar 26, 2016]: Assignment 3 is out! It is due on Sunday April 10, 11:50 pm.
  • [Feb 26, 2016]: Assignment 2 is out! It is due on Wednesday Mar 16, 11:50 pm.
  • [Jan 23, 2016]: Assignment 1 is out! It is due on Sunday Feb 7, 11:50 pm.
  • [Jan 23, 2016]: Check out the updated assignment late submission policy below!
  • [Jan 4, 2016]: First Class on Tuesday Jan 5, 2016 in LHC 526

    Course Content

    WeekTopic Book ChaptersSupplementary Notes
    1 Introduction Duda, Chapter 1
    2,3 Linear and Logistic Regression, Gaussian Discriminant Analysis Bishop, Chapter 3.1, 4 lin-log-reg.pdf, gda.pdf
    4,5 Support Vector Machines Bishop, Chapter 7.1 svm.pdf
    6 Neural Networks Mitchell, Chapter 4 nnets.pdf nnets-hw.pdf
    7 Decision Trees Mitchell, Chapter 3 dtrees.pdf
    8,9 Naive Bayes, Bayesian Statistics Mitchell, Chapter 6 nb.pdf, bayes.pdf Conjugate Prior model.pdf
    10,11 K-Means, Gaussian Mixture Models, EM kmeans.pdf gmm.pdf em.pdf
    12 PCA pca.pdf
    13 Learning Theory, Model Selection Mitchell, Chapter 7 theory.pdf model.pdf
    14 Application of Machine Learning

    Additional Resources

    Review Material

    Topic Notes
    Probability prob.pdf
    Linear Algebra linalg.pdf
    Gaussian Distribution gaussians.pdf
    Convex Optimization (1) convex-1.pdf


    1. Machine Learning: A Probabilistic Perspective. Kevin Murphy. MIT Press, 2012.
    2. Pattern Recognition and Machine Learning. Christopher Bishop. First Edition, Springer, 2006.
    3. Pattern Classification. Richard Duda, Peter Hart and David Stock. Second Edition, Wiley-Interscience, 2000.
    4. Machine Learning. Tom Mitchell. First Edition, McGraw-Hill, 1997.

    Assignment Submission Instructions

    1. You are free to discuss the problems with other students in the class. You should include the names of the people you had a significant discussion with in your submission.
    2. All your solutions should be produced independently without referring to any discussion notes or the code someone else would have written.
    3. All the programming should be done in MATLAB (unless otherwise allowed explicitly). Include comments for readability.
    4. Code should be submitted using Moodle Page.
    5. Create a separate directory for each of the questions named by the question number. For instance, for question 1, all your submissions files should be put in the directory named Q1 (and so on for other questions). Put all the Question sub-directories in a single top level directory. This directory should be named as "yourentrynumber_firstname_lastname". For example, if your entry number is "2013anz7535" and your name is "Nilesh Pathak", your submission directory should be named as "2013anz7535_nilesh_pathak". You should zip your directory and name the resulting file as "" e.g. in the above example it will be "". This single zip file should be submitted online.
    6. Honor Code: Any cases of copying will be awarded a zero on the assignment and a penalty of -10. More severe penalties may follow.
    7. Updated: Jan 23, 2016. Late Policy: You are allowed a total of 5 late days acorss all the assignments. You are free to decide how you would like to use them. You will get a zero on an assignment once you exceed the (total) allowed exemption of 5 days.

    Practice Questions


    1. Assignment 4. Due: Sunday May 1, 2016. 11:50 pm.
    2. Assignment 3. Due: Sunday April 10, 2016. 11:50 pm.
    3. Assignment 2. Due: Wednesday Mar 16, 2016. 11:50 pm.
    4. Assignment 1. Due: Sunday February 7, 2016. 11:50 pm.

    Grading Policy (Tentative)

    Assignments (4) 30-36%
    Quiz (May be) 0-4%
    Minor I 15%
    Minor II 15%
    Major 36-40%