CSE 40625: Machine Learning (2026 Spring)

Machine Learning is a science of getting machines to learn, more specifically, designing algorithms that allow computers to learn from empirical data. In the past decade, Machine Learning has successfully made computers to recognize speeches and hand-written characters, to convert spoken words to text, to effectively understanding and generating human language. In this class, you will learn the most important and up-to-date machine learning techniques, not only the theoretical foundations of these techniques, but also the practice implementation of them. The main topics cover the key questions such as what could be learned by an ML model? what are the factors affecting machine learning model? how to address these training challenges? how have LLMs extended the capabilities of machine learning models and how have they been trained under the schema of reinforcement learning, as well as the future of machine learning in advancing Artificial General Intelligence (AGI).

Class time and location: Tuesday/Thursday 9:30am-10:45am in DeBartolo Hall 244 (1/12 to 4/29)

Office Hours: Prof. Xiangliang Zhang, xzhang33@nd.edu, 354 Fitzpatrick Hall. Tuesdays from 1:00 PM to 2:00 PM, or by appointment.

TA: Weijiang Li wli27@nd.edu; Yujun Zhou yzhou25@nd.edu Wednesday/Fridays 2-3 pm, 150B..

Assignment and Grading:

Homework Mid-term exam  Final exam   
70%    15% 15%

Numeric grades are computed as percentages, and correspond to letter grades as follows:

 87≤B+<90%77≤C+<80%67≤D+<70%    F<60%
94≤A≤100%84≤B<87%74≤C<77%64≤D<67% 
90≤A-<94%80≤B-<84%70≤C-<74%60≤D-<64%      

There will be regular homework assignments, in the forms of reading and questions-answering, math derivation, implementation of machine learning models. Details of the assignments will be provided later. All assignments must be completed individually. The implementation codes and reports (.ipynb file) should be submitted to Canvas prior to the due date. There are no late submissions, and no partial credit will be given if the submission is after the due date. Any extensions must require extenuating circumstances or a priori negotiation. In principle, each one can at most have an extension to only one submission. Inquiries about grades must be made in writing within one week after they are posted. No exceptions. ChatGPT or other AI generative models should not be used for completing assignments, unless their use is explicitly permitted in the assignment instructions. More details can be found in the course syllabus.  

Course Schedule:

ClassesTopicAssignment
Jan 13 (Tue)Welcome & IntroductionReading assignment HW1, due 11:59pm on Jan 15
Jan 15 (Thu):  No class due to an NSF project meeting
Unit 1  What could be learned by an ML model?
Jan 20 (Tue)Learn for prediction Unit1-HW1 Prediction Models, due 11:59pm on Jan 30

Unit1-HW2 Generation, due 11:59pm on Feb 10
Jan 22 (Thu)Learn for representation
Jan 27,29 (T/Th)Learn for generation
Feb 3 (Tue)Learn for decision-making
Unit 2 What are the factors affecting machine learning model?
Feb 5 (Thu)Data qualityUnit2-HW1 Loss Functions, due 11:59pm on Feb 19   
Feb 10,12 (T/Th)Loss functions
Feb 17 (Tue)Over-fitting, model complexity, regularization
Feb 19 (Thu)Hyperparameter setting, auto machine learning
 
Feb 24 (Tue)Midterm Review
Feb 26 (Thu)Midterm Exam (classroom)
 
Unit 3   Training ML models with limited data samples?
Mar 3 (Tue)Active learningUnit3-HW Active Learning, Transfer Learning, due 11:59pm on Mar 27
Mar 5 (Thu)Semi-supervised learning
Mar 7-15 Mid-term break (no class)
Mar 17,19 (T/Th)Transfer learning, Pre-training + fine-tuning
Unit 4   How have LLMs extended the capabilities of machine learning models?
Mar 24 (Tue)  Prior work: word representation 
Mar 26,31 (Th/T)LLMs’ generation architectureUnit4-HW1, due 11:59pm on Apr 12
Apr 2,7 (Thu/T)LLMs’ training/fine-tuning 
Apr 9 (Thu)  LLMs’ continual trainingUnit4-HW2-SFT, due 11:59pm on Apr 18
Apr 14 (Tue)LLMs as agentsUnit4-HW3-Agents, due 11:59pm on Apr 23
Unit 5   Reinforcement Learning
Apr 16 (Thu)RL problem setting, Q-learningUnit5-HW-RL, due 11:59pm on May 5
Apr 21 (Tue)Policy gradient
Apr 23 (Thu)RL for LLMs
 
Apr 28 (Tue)Review class
Final exam:     Friday, May 8 1:45 PM – 3:45 PM DeBartolo Hall 244