COL774: Machine Learning

Course Objectives

Class Notes/Videos (Date-Wise)

Additional Resources

• Stochastic Gradient Descent: Algorithm, On Convergence (Youtube Videos by Andrew Ng)
• On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes. Andrew Y. Ng and Michael Jordan. NIPS 2001.
• Generative and Discrminative Classifiers: Naive Bayes and Logistic Regression. Chapter 1, Machine Learning. Tom Mitchell.
• Notes on Avoiding Overfitting in Decision Trees [This is on internal network. For students who need to access from outside IIT Delhi, you find this in resources section on Piazza.]
• Deep Learning Book
  

Review Material

Topic	Notes
Probability	prob.pdf
Linear Algebra	linalg.pdf
Gaussian Distribution	gaussians.pdf
Convex Optimization (1)	convex-1.pdf

References

1. Machine Learning: A Probabilistic Perspective. Kevin Murphy. MIT Press, 2012.
2. Pattern Recognition and Machine Learning. Christopher Bishop. First Edition, Springer, 2006.
3. Pattern Classification. Richard Duda, Peter Hart and David Stock. Second Edition, Wiley-Interscience, 2000.
4. Machine Learning. Tom Mitchell. First Edition, McGraw-Hill, 1997.

1. You are free to discuss the assignment problems with other students in the class. But all your code should be produced independently without looking at/referring to anyone else's code.
2. Python is the default programming languages for the course. You should use it for programming your assignments unless otherwise explicitly allowed.
3. Code should be submitted using Moodle Page. Make sure to include commenrs for readability.
4. Create a separate directory for each of the questions named by the question number. For instance, for question 1, all your submissions files should be put in the directory named Q1 (and so on for other questions). Put all the Question sub-directories in a single top level directory. This directory should be named as "yourentrynumber_firstname_lastname". For example, if your entry number is "2020anz7535" and your name is "Nitika Rao", your submission directory should be named as "2017anz7535_nitika_rao". You should zip your directory and name the resulting file as "yourentrynumber_firstname_lastname.zip" e.g. in the above example it will be "2020anz7535_nitika_rao.zip". This single zip file should be submitted online.
5. Honor Code: Any cases of copying will be awarded a zero on the assignment and a penalty of -10. More severe penalties may follow.
6. Late Policy: You are allowed a total of 5 late (buffer) days acorss all the assignments. You are free to decide how you would like to use them. You will get a penalty of 10% deduction in marks (per day) for every additional late day in submission used beyond the allowed 5 buffer days. This applies to the first 3 assignments in the course (i.e., leaving out the last assigment based on a competition).

• Major (2020-21, Sem I offering)
• Minor (2020-21, Sem I offering)
• Major (2019-20, Sem II offering) (new!)
• Minor 1 (2019 offering)
• Minor 2 (2019 offering)
• Major (2019 offering)
• Minor 1 (2018 offering)
• Minor 2 (2018 offering)
• Major (2018 offering)
• Minor 1 (2017 offering)
• Minor 2 (2017 offering)
• Major (2017 offering)
• Pratice Questions for Minor 1 (from 2017)
• Pratice Questions for Minor 2 (from 2017)
• Pratice Questions for Major (from 2017)

1. Assignment 4
   Due Date:Friday November 26, 2021. 11:50 pm
2. Assignment 3
   Dataset (Part 1 - Decision Trees): bank_dataset.zip
   Due Date (updated): Wednesday October 27, 2021. 11:50 pm
3. Assignment 2
   Due Date:Wednesday October 6, 2021. 11:50 pm
4. Assignment 1
   Datasets: ass1_data.zip
   Due Date:Sunday September 12, 2021. 11:50 pm

Grading Policy (Tentative)