A python application for manipulating pandas data frames from the comfort of your web browser

Related tags

flowpy
Overview

FlowPy

A python application for manipulating pandas data frames from the comfort of your web browser. Data flows are represented as a Directed Acyclic Graph, and nodes can be ran individually as the user sees fit.

Currently there are two components to this application, they are:

  • flowpyapi - the python backend
  • flowpystudio - the react web front end

Prealpha flowpystudio

Prealpha flowpystudio Node Settings

Prealpha flowpyapi Node Run

Technically the react front end can be built and expressed via FastAPI's static funcitonality, but right now in pre alpha they are just run from seperate terminals to keep development as smooth as possible.

Usage

python -m venv venv
source ./venv/bin/activate

pip install -r requirements.txt

python -m flowpyapi

# in another terminal window:
cd flowpystudio
yarn start

Author

  • Patrick Coffey (schlerp)
Issues
  • Additional features

    Additional features

    Hi @schlerp , I happened to come across your medium article and had a similar idea parked for a while now: to profile existing data processing pipelines/scripts/notebooks to build a representation of the data flow. I believe this could be a future feature to this module, so this is very exciting to me. I work in Data Science and would find this extremely useful.

    I'd like to contribute to adding new features on the pandas front, since I do not know much on the UI side of things. A few regular operations I use are listed below:

    1. Basic feature/column computations
    2. Aggregation using groupby
    3. Resampling time indices
    4. Replacing and imputing values
    5. Pivot, melt and stacking

    Before I try to modify anything, I'd like to know if there's a tracker of sorts for current development activity and upcoming features already being worked on.

    opened by ashwin100196 2
  • Add instructions how to install yarn

    Add instructions how to install yarn

    Hi, I tried to install and run flowpy with the help of the instructions in the README.md. But at least on the machines (Windows 7 and MacOS) which I tried to run flowpy the yarn-program was always missing. Can you add instructions on how to install the missing program? It seems that it does not get installed by the python modules in the requirements.txt. For someone who does have it already installed, it could deter them from trying out flowpy.

    opened by skbormann 3
  • Design Discussion to provide field inputs/parameters as dropdowns

    Design Discussion to provide field inputs/parameters as dropdowns

    Hi @schlerp, I have been thinking it would be useful provide input fields with drop downs to the user. As a reference, I use bamboolib for personal projects and they do this very well. Link: https://docs.bamboolib.8080labs.com/documentation/getting-started

    Started this issue to discuss on a design for implementation since the same design would be usable for the majority of the app, ranging from column name selection all the way to hyper parameters to aggregation functions like datetime format/resampling frequency etc.

    Boolean parameters will still be kept as check boxes, as has been implemented for index in csv output block.

    opened by ashwin100196 1
  • New feature: Conditionals

    New feature: Conditionals

    This feature would allow adding conditions on the DataFrame and then assigning value for a new column

    Example

    A > 5 & B < 10; Create Flag as 1, else Flag as 0

    This could then be used to create masks on the data to be used by the already present Filter block. (for future enhancements)

    opened by ashwin100196 1
  • New Feature: Aggregate and calculate

    New Feature: Aggregate and calculate

    This feature would emulate the typical pandas groupby operations and provide calculating metrics like mean, count, min max etc

    Example

    Groupby key - Multiselect for columns Metric - mean, count, std, min, max etc.

    Inclusion of a custom groupby metric (as a function) can be thought of for future enhancements

    opened by ashwin100196 0
  • New feature: Compute

    New feature: Compute

    This feature would involve creating a new column from existing ones. Support for formulas like the excel formula bar would be the expected functionality.

    Example

    A**2 A + B / C A == C A = 0

    Target column name would also need to be provided here, which can be a new column or an existing one.

    I would like to start contributing from this feature, will generate a pull request once complete. Any thoughts?

    opened by ashwin100196 1
Owner
Schlerp
I like data analysis, machine learning, automation and systems integration.
Schlerp
A cool, modern and responsive django admin application based on bootstrap 5

django-baton A cool, modern and responsive django admin application based on bootstrap 5 Documentation: readthedocs Live Demo Now you can try django-b

Otto srl 494 Oct 19, 2021
Jet Bridge (Universal) for Jet Admin – API-based Admin Panel Framework for your application

Jet Bridge for Jet Admin – Admin panel framework for your application Description About Jet Admin: https://about.jetadmin.io Live Demo: https://app.je

Jet Admin 1k Oct 14, 2021
DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing

DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing

null 63 Oct 12, 2021
xarray: N-D labeled arrays and datasets

xarray is an open source project and Python package that makes working with labelled multi-dimensional arrays simple, efficient, and fun!

Python for Data 2.3k Oct 17, 2021
Python books free to read online or download

Python books free to read online or download

Paolo Amoroso 2.9k Oct 15, 2021
Django Smuggler is a pluggable application for Django Web Framework that helps you to import/export fixtures via the automatically-generated administration interface.

Django Smuggler Django Smuggler is a pluggable application for Django Web Framework to easily dump/load fixtures via the automatically-generated admin

semente 359 Sep 28, 2021
Modern responsive template for the Django admin interface with improved functionality. We are proud to announce completely new Jet. Please check out Live Demo

Django JET Modern template for Django admin interface with improved functionality Attention! NEW JET We are proud to announce completely new Jet. Plea

Geex Arts 3.2k Oct 18, 2021
Legacy django jet rebooted , supports only Django 3

Django JET Reboot Rebooting the original project : django-jet. Django Jet is modern template for Django admin interface with improved functionality. W

null 41 Oct 9, 2021
An improved django-admin-tools dashboard for Django projects

django-fluent-dashboard The fluent_dashboard module offers a custom admin dashboard, built on top of django-admin-tools (docs). The django-admin-tools

django-fluent 295 Sep 9, 2021
📱 An extension for Django admin that makes interface mobile-friendly. Merged into Django 2.0

Django Flat Responsive django-flat-responsive is included as part of Django from version 2.0! ?? Use this app if your project is powered by an older D

elky 248 Jul 28, 2021
WebVirtCloud is virtualization web interface for admins and users

WebVirtCloud is a virtualization web interface for admins and users. It can delegate Virtual Machine's to users. A noVNC viewer presents a full graphical console to the guest domain. KVM is currently the only hypervisor supported.

Anatoliy Guskov 1.1k Oct 17, 2021
FLEX (Federated Learning EXchange,FLEX) protocol is a set of standardized federal learning agreements designed by Tongdun AI Research Group。

Click to view Chinese version FLEX (Federated Learning Exchange) protocol is a set of standardized federal learning agreements designed by Tongdun AI

同盾科技 40 Sep 18, 2021
django's default admin interface made customizable. popup windows replaced by modals. :mage: :zap:

django-admin-interface django-admin-interface is a modern responsive flat admin interface customizable by the admin itself. Features Beautiful default

Fabio Caccamo 947 Oct 22, 2021
Simple and extensible administrative interface framework for Flask

Flask-Admin The project was recently moved into its own organization. Please update your references to [email protected]:flask-admin/flask-admin.git. Int

Flask-Admin 4.9k Oct 21, 2021
Simple and extensible administrative interface framework for Flask

Flask-Admin The project was recently moved into its own organization. Please update your references to [email protected]:flask-admin/flask-admin.git. Int

Flask-Admin 4.6k Feb 7, 2021
Nginx UI allows you to access and modify the nginx configurations files without cli.

nginx ui Table of Contents nginx ui Introduction Setup Example Docker UI Authentication Configure the auth file Configure nginx Introduction We use ng

David Schenk 4k Oct 24, 2021
A high-level app and dashboarding solution for Python

Panel provides tools for easily composing widgets, plots, tables, and other viewable objects and controls into custom analysis tools, apps, and dashboards.

HoloViz 1.4k Oct 23, 2021
Python code for "Machine learning: a probabilistic perspective" (2nd edition)

Python code for "Machine learning: a probabilistic perspective" (2nd edition)

Probabilistic machine learning 4.1k Oct 15, 2021
A Django app that creates automatic web UIs for Python scripts.

Wooey is a simple web interface to run command line Python scripts. Think of it as an easy way to get your scripts up on the web for routine data anal

Wooey 1.7k Oct 20, 2021