Post

CMU 10-414/714: Deep Learning Systems

Learning how to implement a MLsys like pytorch

CMU 10-414/714: Deep Learning Systems

Course Info

DLsys is an excellent open source introduction course to machine learning system. In this course, you are going to build a toy MLsys called needle from scratch to implement the modules like pytorch.

Lecturer: Tianqi Chen, Personal Website

Course Website/Lectures

Assignments

I’ve completed hw0-2, which are the foundational parts for a dlsys:

Completed Forward Pass Operators, Topological Sort, Automatic Backward Propagation, …

Completed several nn.Module like modules, like initialization, loss, activations, layer norm, …


Later assignments has been suspended since I joined a research group.

This post is licensed under CC BY 4.0 by the author.