Skip to content

kaixi-wang/machine-learning

Repository files navigation

Machine Learning Algorithms

(Programming Assignments)

  • all algorithms implemented in Python v3.6.4
  • Packaged limited to:
    • Numpy (1.13.1)
    • Scipy (0.19.1)
    • Matplotlib (2.0.2)
    • Pandas (0.20.3)

PA1:

  • K-Nearest Neighbors (KNN)
    • distance functions
    • normalization
  • Decision Trees
    • pruning

PA2:

  • Binary and multiclass classification
  • linear regression

PA3:

  • MultiLayer Perceptron (MLP)
    • Activation Functions (forward and backward): linear, relu, tanh
    • dropout

PA4:

  • K-Means
    • basic K-means clustering algorithm
    • K-means++ algorithm
  • Hidden Markov Model (HMM)
    • forward function, backward function, sequence probability, posterior probability, viterbi algorithm
    • part-of-speech tagging

Comments:

  • PA4_HMM: my implementation of speech tagging achieves a 24.5% improvement in testing accuracy over the class's expected maximum