Machine Learning Algorithms

(Programming Assignments)

all algorithms implemented in Python v3.6.4
Packaged limited to:
- Numpy (1.13.1)
- Scipy (0.19.1)
- Matplotlib (2.0.2)
- Pandas (0.20.3)

PA1:

K-Nearest Neighbors (KNN)
- distance functions
- normalization
Decision Trees
- pruning

PA2:

Binary and multiclass classification
linear regression

PA3:

MultiLayer Perceptron (MLP)
- Activation Functions (forward and backward): linear, relu, tanh
- dropout

PA4:

K-Means
- basic K-means clustering algorithm
- K-means++ algorithm
Hidden Markov Model (HMM)
- forward function, backward function, sequence probability, posterior probability, viterbi algorithm
- part-of-speech tagging

Comments:

PA4_HMM: my implementation of speech tagging achieves a 24.5% improvement in testing accuracy over the class's expected maximum