Machine Learning 2022-1

Assignments and Final Project in SNU ECE Machine Learning Fundamentals & Applications (M2608.001300) lecture, at 2022 spring.

HW1: Logistic Regression

Training logistic regression with scikit-learn library
To implement logistic regression with numpy (from scratch)
Logistic regression with regularization
Multi-class classification with logistic regression

HW2: Support Vector Machine

Hard margin SVM
Soft margin SVM
Non-linear classification with kernel trick

HW3: Convolutional Neural Network

Report / Dataset

Image classification model design and training
Combining GoogLeNet and ResNet method
72% accuracy on CIFAR-10 dataset

HW4

Pt1: Hidden Markov Model

Word generation model
Implement HMM forward algorithm
Implement Viterbi algorithm

Pt2: Recurrent Neural Network

Word generation model
Implement RNN model

Final Project

Report / Easy Dataset / Normal Dataset

Recognizing letter images
Predicting next letter of a letter sequence
Combining VGG and LSTM method
98.89% accuracy on the easy dataset
96.15% accuracy on the normal dataset