Scripts of Machine Learning Algorithms from Scratch. Implementations of machine learning models and algorithms using nothing but NumPy with a focus on accessibility. Aims to cover everything from basic to advance.

Last update: Nov 26, 2022

Overview

Algo-ScriptML

Python implementations of some of the fundamental Machine Learning models and algorithms from scratch.

The goal of this project is not to create algorithms that are as streamlined and computationally efficient as possible, but rather to present their inner workings in a clear and usable manner.

Algorithms:

⚙️ Contribution Guidelines

Please go through the whole Contributing Guidelines here.

Make sure you do not copy codes from external sources because that work will not be considered. Plagiarism is strictly not allowed.
You can only work on issues that you have been assigned to you.
If you want to contribute for an existing algorithm, we prefer that you create an issue before making a PR and link your PR to that issue.
If you have modified/added code work, make sure the code compiles before submitting.
Strictly use snake_case (underscore_separated) in your file_name and push it in correct folder.
Do not update the README.md.

📂 Where to upload the files

Your files should be uploaded inside the *code folder into the corresponding language folder (For instance, if you wrote code for an K-Means Implementation, it goes inside the K-Means folder).
Under no circumstances create new folders within the language folders to upload your code unless specifically told to do so.
Edit the corresponding README.md file to add the link to your code in the corresponding section (GitHub Markdown Guide)

The value of a strong contribution stays beyond everything and gives you satisfaction 👍🌟

📖 Code Of Conduct

You can find our Code of Conduct here.

📝 License

This project follows the MIT License.

😇 Maintainers

_{Aditya Kumar Gupta}

_{Kritika Parmar}

Comments

KNN - Base

Hello @kritikaparmar-programmer. I am a GSSOC'21 participant. I would like to work on the issue of the K Nearest Neighbours Algorithm using Python. Please assign this issue to me.
gssoc21 Level3 Base

opened by ananyade2412 21
Random Forest - Base

I am a GSSoC 21 participant (DISCORD username: smoky237 #5411), I can contribute to the Random Forest algorithm(including bagging concept) with proper implementation and Documentation on a dataset. Kindly assign this work to me @geekquad @kritikaparmar-programmer @MAJOR-BEAST #GSSoc
gssoc21 Level3 Base

opened by ayush237 17
Decision Tree - Base

I am a GSSoC 21 participant (DISCORD username: smoky237 #5411), I can contribute to the Decision Trees algorithm with proper implementation and Documentation on a dataset. Kindly assign this work to me @geekquad @kritikaparmar-programmer @MAJOR-BEAST #GSSoc
gssoc21 Level3 Base

opened by ayush237 12
C5.0 Decision Tree

There is no implementation of the C5.0 Decision Tree in Python available anywhere on the internet.

Even scikit-learn has C4.0 or C4.5 or CART algorithm implemented under the hood.

So it would be great to have C5.0 Decision Tree implemented over the same.

(P.S. - It is not an easy task,)
gssoc21 Level3 Unassigned

opened by khanfarhan10 12
Locally Weighted Regression (LOWESS)

I am a GSSoC 21 participant. I can contribute to locally weighted regression(LOWESS) with proper implementation and Documentation. Kindly assign this work to me @kritikaparmar-programmer @geekquad @MAJOR-BEAST DISCORD: diksha#6684
gssoc21 Level3 Base Unassigned

opened by dikshajoshi18 11
code for gradient descent

i have written a code for batch gradient descent and have tried to explain the same.please have a look through it and suggest for some changes @ashwani-rathee sir

opened by Sibasish-Padhy 9
Pruning of neural network

Pruning of neural network remove the less contributing node(means weight of node which has low weight than others node) from the neural network. It increases the accuracy of neural network models.

opened by Atul-Kashyap 2
Stepwise Regression - Documentation and Implementation

Hey, I am a GSSoC'21 participant and I will like to work on the documentation and implementation of Stepwise Regression. I have already described briefly about this technique in one of my earlier blogs here: https://towardsdatascience.com/the-family-of-unfamiliar-regression-algorithms-ae7eff9e9463

opened by thisisashwinraj 1
Batch-gradient descent

A very helpful optimization technique that is quite time efficient and even reduces space complexity. It proves to come in quite handy when the gradient descent seems to have a relatively fast learning rate or follows non convex optimization. I would like to code the optimization technique and prepare a well documented readme file for it explaining it in detail. Please assign this issue to me under the label of gssoc21.Thank you
gssoc21 Level3

opened by Sibasish-Padhy 13

Owner

Algo Phantoms

Open Source organization focusses on Data Structure and Algorithms

GitHub

Neural-net-from-scratch - A simple Neural Network from scratch in Python using the Pymathrix library

A Simple Neural Network from scratch A Simple Neural Network from scratch in Pyt

2 Jan 7, 2022

Minimal deep learning library written from scratch in Python, using NumPy/CuPy.

SmallPebble Project status: experimental, unstable. SmallPebble is a minimal/toy automatic differentiation/deep learning library written from scratch

92 Dec 30, 2022

Keras like implementation of Deep Learning architectures from scratch using numpy.

Mini-Keras Keras like implementation of Deep Learning architectures from scratch using numpy. How to contribute? The project contains implementations

5 Oct 10, 2021

A texturizer that I just made. Nothing special here.

texturizer This is a little project that I did with an hour's time. It texturizes an image given a image and a texture to texturize it with. There is

1 Nov 11, 2021

Composable transformations of Python+NumPy programsComposable transformations of Python+NumPy programs

Chex Chex is a library of utilities for helping to write reliable JAX code. This includes utils to help: Instrument your code (e.g. assertions) Debug

506 Jan 8, 2023

MLP-Numpy - A simple modular implementation of Multi Layer Perceptron in pure Numpy.

MLP-Numpy A simple modular implementation of Multi Layer Perceptron in pure Numpy. I used the Iris dataset from scikit-learn library for the experimen

1 Jan 1, 2022

This repository builds a basic vision transformer from scratch so that one beginner can understand the theory of vision transformer.

vision-transformer-from-scratch This repository includes several kinds of vision transformers from scratch so that one beginner can understand the the

1 Dec 24, 2021

In this work, we will implement some basic but important algorithm of machine learning step by step.

WoRkS continued English 中文 Français Probability Density Estimation-Non-Parametric Methods(概率密度估计-非参数方法) 1. Kernel / k-Nearest Neighborhood Density Est

1 Dec 30, 2021

LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentation (NeurIPS2021 Benchmark and Dataset Track)

LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentation by Junjue Wang, Zhuo Zheng, Ailong Ma, Xiaoyan Lu, and Yanfei Zh

174 Dec 22, 2022

Python implementation of cover trees, near-drop-in replacement for scipy.spatial.kdtree

This is a Python implementation of cover trees, a data structure for finding nearest neighbors in a general metric space (e.g., a 3D box with periodic

28 Nov 25, 2022

LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentation

LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentation by Junjue Wang, Zhuo Zheng, Ailong Ma, Xiaoyan Lu, and Yanfei Zh

8 Nov 21, 2022

Independent and minimal implementations of some reinforcement learning algorithms using PyTorch (including PPO, A3C, A2C, ...).

PyTorch RL Minimal Implementations There are implementations of some reinforcement learning algorithms, whose characteristics are as follow: Less pack

4 Dec 31, 2022

Real-ESRGAN aims at developing Practical Algorithms for General Image Restoration.

Real-ESRGAN Colab Demo for Real-ESRGAN . Portable Windows executable file. You can find more information here. Real-ESRGAN aims at developing Practica

17.2k Jan 2, 2023

This project is based on RIFE and aims to make RIFE more practical for users by adding various features and design new models

This project is based on RIFE and aims to make RIFE more practical for users by adding various features and design new models. Because improving the PSNR index is not compatible with subjective effects, we hope this part of work and our academic research are independent of each other.

190 Jan 8, 2023

Everything you want about DP-Based Federated Learning, including Papers and Code. (Mechanism: Laplace or Gaussian, Dataset: femnist, shakespeare, mnist, cifar-10 and fashion-mnist. )

Differential Privacy (DP) Based Federated Learning (FL) Everything about DP-based FL you need is here. （所有你需要的DP-based FL的信息都在这里） Code Tip: the code o

83 Dec 24, 2022

LaneDet is an open source lane detection toolbox based on PyTorch that aims to pull together a wide variety of state-of-the-art lane detection models

LaneDet is an open source lane detection toolbox based on PyTorch that aims to pull together a wide variety of state-of-the-art lane detection models. Developers can reproduce these SOTA methods and build their own methods.

405 Jan 4, 2023

PyTorch implementations of deep reinforcement learning algorithms and environments

Deep Reinforcement Learning Algorithms with PyTorch This repository contains PyTorch implementations of deep reinforcement learning algorithms and env

4.7k Jan 4, 2023

Pytorch implementations of popular off-policy multi-agent reinforcement learning algorithms, including QMix, VDN, MADDPG, and MATD3.

Off-Policy Multi-Agent Reinforcement Learning (MARL) Algorithms This repository contains implementations of various off-policy multi-agent reinforceme

183 Dec 28, 2022

BasicNeuralNetwork - This project looks over the basic structure of a neural network and how machine learning training algorithms work

BasicNeuralNetwork - This project looks over the basic structure of a neural network and how machine learning training algorithms work. For this project, I used the sigmoid function as an activation function along with stochastic gradient descent to adjust the weights and biases.

1 Jan 22, 2022