Machine Learning Algorithms

This repository consists of my understanding and implementations of various Machine Learning Algorithms

1. KNN (K-Nearest Neighbor)

A reported understanding of this supervised ML algorithm along with its scratch implementation on iris dataset for classification.

View Implementation

1.1 Resources Utilized

• Youtube Video Tutorial
  
• Article I
  
• Article II
  
• A Journal Covering the Theoritical Grounds

---

2. Multivariate Regression

An implementation of the foundational regression algorithm to to predict the medical charges based on the patients' age , sex , children , region and charges along with the use of the optimization algorithm i.e. gradient descent with the learning rate of 0.0001 over 10000 iterations.

View Implementation

2.1 Dataset Used

Go to Dataset

---

3. Logistic Regression

A procedural implementation of logistic regression classifier to classify the strength of password as either weak, medium or strong.

View Implementation

---

3. Gradient Descent

A simple scratch implementation of the gradient descent optimization algorithm for finding the optimal value of m and b for a predictive function under the Linear Regression algorithm.

View Implementation

---

4. Ordinary Least Squares

A simple implementation of the analytical approach for finding the parameters of the algorithm to find the optimal value of m and b for a predictive function under the Simple Linear Regression algorithm.

View Implementation

---

5. ID3 Decision Tree

A simple implementation of the Decision Tree algorithm using the ID3 method.

View Implementation

---